Jul 15 11:58:54.169847 ip-10-0-139-5 systemd[1]: Starting Kubernetes Kubelet... Jul 15 11:58:54.616911 ip-10-0-139-5 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 11:58:54.616911 ip-10-0-139-5 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 11:58:54.616911 ip-10-0-139-5 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 11:58:54.616911 ip-10-0-139-5 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 11:58:54.616911 ip-10-0-139-5 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 11:58:54.619044 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.618955 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 11:58:54.624715 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624698 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 11:58:54.624715 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624716 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624720 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624724 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624727 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624730 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624734 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624737 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624740 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624742 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624745 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624748 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624751 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624753 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624756 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624758 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624761 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624764 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624766 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624769 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624778 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 11:58:54.624797 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624781 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624783 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624786 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624788 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624791 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624794 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624796 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624799 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624802 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624805 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624808 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624810 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624816 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624821 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624824 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624827 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624830 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624832 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624835 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 11:58:54.625290 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624839 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624843 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624845 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624848 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624850 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624853 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624855 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624858 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624860 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624863 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624865 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624868 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624870 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624878 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624881 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624885 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624888 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624890 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624893 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624896 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 11:58:54.625882 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624898 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624901 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624904 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624906 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624909 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624911 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624914 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624916 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624919 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624921 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624924 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624926 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624929 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624931 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624934 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624938 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624941 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624943 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624946 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624948 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 11:58:54.626364 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624952 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624955 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624959 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624961 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624964 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624966 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624974 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624979 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624982 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624984 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624987 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624989 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624992 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624994 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.624997 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.625000 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.625008 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.625010 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.625013 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626653 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 11:58:54.626905 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626660 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626663 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626666 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626669 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626672 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626675 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626677 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626680 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626682 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626685 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626687 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626690 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626693 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626695 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626698 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626701 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626703 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626706 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626708 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626713 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 11:58:54.627388 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626716 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626719 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626722 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626725 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626727 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626730 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626732 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626735 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626737 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626740 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626743 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626746 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626748 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626750 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626753 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626756 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626758 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626761 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626765 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626769 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 11:58:54.627913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626772 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626775 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626778 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626781 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626783 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626786 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626789 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626791 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626794 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626796 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626799 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626803 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626807 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626811 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626814 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626817 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626820 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626822 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626825 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 11:58:54.628398 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626828 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626830 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626833 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626835 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626838 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626840 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626843 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626845 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626848 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626851 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626853 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626856 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626858 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626861 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626863 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626865 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626868 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626870 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626873 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626875 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 11:58:54.628875 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626878 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626880 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626883 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626886 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626889 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626891 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626895 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626900 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626903 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626906 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626909 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626912 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626915 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626918 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626921 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626923 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626926 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626929 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.626931 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 11:58:54.629368 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627309 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627313 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627316 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627318 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627321 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627324 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627326 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627330 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627333 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627336 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627340 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627344 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627348 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627351 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627354 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627356 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627359 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627362 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627364 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 11:58:54.629852 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627367 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627370 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627373 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627375 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627378 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627380 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627383 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627386 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627388 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627391 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627394 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627397 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627399 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627402 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627405 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627408 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627410 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627412 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627415 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627418 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 11:58:54.630329 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627420 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627422 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627425 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627428 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627430 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627433 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627435 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627437 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627440 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627442 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627445 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627448 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627450 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627453 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627457 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627459 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627462 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627464 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627468 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 11:58:54.630828 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627472 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627475 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627477 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627480 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627483 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627486 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627488 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627491 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627494 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627511 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627514 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627517 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627521 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627524 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627527 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627530 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627533 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627535 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627538 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627541 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 11:58:54.631282 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627543 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627546 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627548 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627551 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627554 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627557 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627559 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627562 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627565 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627568 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627570 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627573 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627575 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627579 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627581 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627584 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627587 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627589 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627592 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627594 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 11:58:54.631817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.627596 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627663 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627672 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627677 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627682 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627686 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627689 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627694 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627699 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627702 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627705 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627709 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627712 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627715 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627723 2559 flags.go:64] FLAG: --cgroup-root="" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627726 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627729 2559 flags.go:64] FLAG: --client-ca-file="" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627732 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627735 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627739 2559 flags.go:64] FLAG: --cluster-domain="" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627742 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627745 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627749 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627752 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 11:58:54.632296 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627756 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627759 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627762 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627765 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627768 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627771 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627775 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627778 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627780 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627784 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627787 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627790 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627793 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627796 2559 flags.go:64] FLAG: --enable-server="true" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627799 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627804 2559 flags.go:64] FLAG: --event-burst="100" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627807 2559 flags.go:64] FLAG: --event-qps="50" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627810 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627812 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627815 2559 flags.go:64] FLAG: --eviction-hard="" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627819 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627822 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627826 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627829 2559 flags.go:64] FLAG: --eviction-soft="" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627832 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 11:58:54.632910 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627835 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627838 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627841 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627844 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627847 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627850 2559 flags.go:64] FLAG: --feature-gates="" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627854 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627857 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627860 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627863 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627866 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627869 2559 flags.go:64] FLAG: --help="false" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627872 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-139-5.ec2.internal" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627875 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627878 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627881 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627884 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627888 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627890 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627893 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627896 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627899 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627902 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627905 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 11:58:54.633545 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627908 2559 flags.go:64] FLAG: --kube-reserved="" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627911 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627913 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627917 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627920 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627925 2559 flags.go:64] FLAG: --lock-file="" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627928 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627931 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627934 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627940 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627943 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627946 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627950 2559 flags.go:64] FLAG: --logging-format="text" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627974 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627978 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627981 2559 flags.go:64] FLAG: --manifest-url="" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627984 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627996 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.627999 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628004 2559 flags.go:64] FLAG: --max-pods="110" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628007 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628010 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628013 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628016 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628019 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 11:58:54.634142 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628023 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628026 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628033 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628036 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628039 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628042 2559 flags.go:64] FLAG: --pod-cidr="" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628045 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628051 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628053 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628057 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628059 2559 flags.go:64] FLAG: --port="10250" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628063 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628065 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d24c15f2ff3ee25" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628071 2559 flags.go:64] FLAG: --qos-reserved="" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628074 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628077 2559 flags.go:64] FLAG: --register-node="true" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628080 2559 flags.go:64] FLAG: --register-with-taints="" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628083 2559 flags.go:64] FLAG: --registry-burst="10" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628086 2559 flags.go:64] FLAG: --registry-qps="5" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628090 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628093 2559 flags.go:64] FLAG: --reserved-memory="" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628097 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628101 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628104 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628107 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 11:58:54.634769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628109 2559 flags.go:64] FLAG: --runonce="false" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628112 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628115 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628118 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628121 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628124 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628127 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628130 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628133 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628136 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628139 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628142 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628144 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628147 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628150 2559 flags.go:64] FLAG: --system-cgroups="" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628153 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628158 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628161 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628164 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628167 2559 flags.go:64] FLAG: --tls-min-version="" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628171 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628174 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628177 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628180 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628183 2559 flags.go:64] FLAG: --v="2" Jul 15 11:58:54.635431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628187 2559 flags.go:64] FLAG: --version="false" Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628192 2559 flags.go:64] FLAG: --vmodule="" Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628196 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.628200 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628315 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628319 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628323 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628326 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628328 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628332 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628335 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628338 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628340 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628343 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628345 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628347 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628350 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628352 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628355 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628359 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 11:58:54.636204 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628362 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628365 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628368 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628370 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628373 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628376 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628378 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628382 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628385 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628388 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628390 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628393 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628396 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628400 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628402 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628405 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628409 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628413 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628416 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 11:58:54.637017 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628419 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628422 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628425 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628428 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628430 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628433 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628435 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628437 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628440 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628442 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628445 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628447 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628450 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628453 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628455 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628458 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628460 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628463 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628465 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628468 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 11:58:54.637814 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628471 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628474 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628476 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628479 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628481 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628484 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628488 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628490 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628493 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628496 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628512 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628515 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628518 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628520 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628523 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628526 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628529 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628531 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628534 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628536 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 11:58:54.638863 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628539 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628543 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628546 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628549 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628551 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628554 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628556 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628559 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628561 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628564 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628567 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628569 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628572 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628574 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628577 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628579 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628582 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628584 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628588 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 11:58:54.639451 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628591 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628593 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628596 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628598 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.628601 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.629388 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.639034 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 11:58:54.639939 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.639057 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 11:58:54.640180 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.640070 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 11:58:54.640180 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.640091 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640186 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640197 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640205 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640210 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640215 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640220 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640224 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640229 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640234 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640239 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640243 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640247 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640252 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640256 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640262 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640266 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640271 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640275 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640279 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 11:58:54.640281 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640284 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640289 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640293 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640297 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640301 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640306 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640310 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640314 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640319 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640322 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640327 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640331 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640335 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640339 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640343 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640346 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640351 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640355 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640359 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640363 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 11:58:54.641142 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640367 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640372 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640376 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640382 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640388 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640395 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640401 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640407 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640412 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640417 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640421 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640426 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640431 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640435 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640441 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640445 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640450 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640455 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640459 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 11:58:54.641880 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640463 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640467 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640472 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640476 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640480 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640485 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640489 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640493 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640513 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640519 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640523 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640527 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640531 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640535 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640539 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640543 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640548 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640552 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640556 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640561 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 11:58:54.642344 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640565 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640572 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640576 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640580 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640585 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640589 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640594 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640599 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640603 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640608 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640612 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640616 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640620 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640624 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640628 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640633 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640637 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640641 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640646 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640650 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 11:58:54.643088 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640654 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.640662 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640854 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640864 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640869 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640874 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640878 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640883 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640888 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640892 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640897 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640901 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640905 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640910 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640916 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640921 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 11:58:54.643641 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640926 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640930 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640934 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640938 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640943 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640947 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640951 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640955 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640960 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640964 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640969 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640973 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640977 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640982 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640986 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640991 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640995 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.640999 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641003 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 11:58:54.644031 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641007 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641012 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641015 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641020 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641024 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641028 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641032 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641038 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641042 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641046 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641052 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641056 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641061 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641066 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641070 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641074 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641079 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641083 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641087 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641091 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 11:58:54.644546 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641095 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641100 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641104 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641108 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641112 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641116 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641120 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641125 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641129 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641133 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641137 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641141 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641145 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641150 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641156 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641162 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641167 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641172 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641185 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 11:58:54.645052 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641190 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641195 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641199 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641204 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641208 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641213 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641219 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641223 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641227 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641231 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641236 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641240 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641245 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641249 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641254 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641258 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641262 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641268 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641275 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 11:58:54.645851 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641281 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641286 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641291 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641295 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641300 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641304 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641309 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:54.641314 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.641323 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 11:58:54.646424 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.641487 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 11:58:54.646818 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.646800 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 11:58:54.648560 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.648545 2559 server.go:1019] "Starting client certificate rotation" Jul 15 11:58:54.648669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.648650 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 11:58:54.648709 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.648691 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 11:58:54.653269 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.653252 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 11:58:54.654538 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.654510 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 11:58:54.666464 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.666441 2559 log.go:25] "Validated CRI v1 runtime API" Jul 15 11:58:54.671075 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.671059 2559 log.go:25] "Validated CRI v1 image API" Jul 15 11:58:54.671961 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.671947 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 11:58:54.678474 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.678449 2559 fs.go:135] Filesystem UUIDs: map[02e64cbf-d8e3-4acd-b112-35f0aa59cfdd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cef01e6d-df55-43b1-82ff-51c6329ec1f4:/dev/nvme0n1p4] Jul 15 11:58:54.678573 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.678473 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 11:58:54.683646 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.683622 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 11:58:54.684521 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.684399 2559 manager.go:216] Machine: {Timestamp:2026-07-15 11:58:54.682973828 +0000 UTC m=+0.383943558 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098888 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec299e4c7688f129c508fdd086648fd7 SystemUUID:ec299e4c-7688-f129-c508-fdd086648fd7 BootID:389ebe87-eddd-494f-a00b-f6bab4dda1f6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:02:8e:1d:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:02:8e:1d:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:da:af:a1:d5:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 11:58:54.684521 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.684524 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 11:58:54.684710 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.684694 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 11:58:54.687799 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.687775 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 11:58:54.687948 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.687803 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 11:58:54.688565 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.688555 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 11:58:54.688598 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.688567 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 11:58:54.688598 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.688574 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 11:58:54.690015 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.690004 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 11:58:54.691411 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.691402 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 11:58:54.695548 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695537 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 15 11:58:54.695655 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695646 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 11:58:54.695685 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695676 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 15 11:58:54.695716 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695693 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 11:58:54.695716 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695712 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 11:58:54.695803 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695722 2559 kubelet.go:398] "Adding apiserver pod source" Jul 15 11:58:54.695803 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.695731 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 11:58:54.696158 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.696147 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 11:58:54.696189 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.696168 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 11:58:54.698447 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.698426 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 11:58:54.700372 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.700357 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 11:58:54.700429 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.700389 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 11:58:54.701427 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701407 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701428 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701437 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701444 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701456 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701464 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701473 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701480 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 11:58:54.701486 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701490 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 11:58:54.701698 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701509 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 11:58:54.701698 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701518 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 11:58:54.701698 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.701525 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 11:58:54.702963 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.702952 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 11:58:54.702963 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.702962 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 11:58:54.704677 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.704662 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 11:58:54.704928 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.704900 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 11:58:54.705190 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.705165 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 11:58:54.706317 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.706304 2559 server.go:1268] "Started kubelet" Jul 15 11:58:54.706426 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.706366 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 11:58:54.706512 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.706416 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 11:58:54.706569 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.706554 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 11:58:54.707365 ip-10-0-139-5 systemd[1]: Started Kubernetes Kubelet. Jul 15 11:58:54.708016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.707965 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 11:58:54.708907 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.708892 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 15 11:58:54.709620 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.709599 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqlrf" Jul 15 11:58:54.711275 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.711258 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 11:58:54.713090 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713070 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 11:58:54.713192 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713077 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 11:58:54.713250 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.713193 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:54.713790 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713772 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 11:58:54.713871 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713775 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 11:58:54.713871 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713805 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 11:58:54.713976 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713887 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 15 11:58:54.713976 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.713898 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 15 11:58:54.714332 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714312 2559 factory.go:153] Registering CRI-O factory Jul 15 11:58:54.714417 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714335 2559 factory.go:223] Registration of the crio container factory successfully Jul 15 11:58:54.714417 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714392 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 11:58:54.714417 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714402 2559 factory.go:55] Registering systemd factory Jul 15 11:58:54.714417 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714409 2559 factory.go:223] Registration of the systemd container factory successfully Jul 15 11:58:54.714579 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714431 2559 factory.go:103] Registering Raw factory Jul 15 11:58:54.714579 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714444 2559 manager.go:1196] Started watching for new ooms in manager Jul 15 11:58:54.714951 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.714939 2559 manager.go:349] Starting recovery of all containers Jul 15 11:58:54.718824 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.718797 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqlrf" Jul 15 11:58:54.718915 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.718840 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 11:58:54.718979 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.718917 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 11:58:54.723516 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.718937 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-5.ec2.internal.18c274b7b1ff5ef9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-5.ec2.internal,UID:ip-10-0-139-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-5.ec2.internal,},FirstTimestamp:2026-07-15 11:58:54.706278137 +0000 UTC m=+0.407247867,LastTimestamp:2026-07-15 11:58:54.706278137 +0000 UTC m=+0.407247867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-5.ec2.internal,}" Jul 15 11:58:54.730643 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.730624 2559 manager.go:354] Recovery completed Jul 15 11:58:54.734731 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.734717 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.736601 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.736584 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.736669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.736615 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.736669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.736628 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.737194 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737171 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 11:58:54.737194 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737192 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 11:58:54.737326 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737193 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.737326 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737207 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 15 11:58:54.737964 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737949 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.738040 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737979 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.738040 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.737994 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.739255 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.739159 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-5.ec2.internal.18c274b7b3ce0c63 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-5.ec2.internal,UID:ip-10-0-139-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-5.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-5.ec2.internal,},FirstTimestamp:2026-07-15 11:58:54.736600163 +0000 UTC m=+0.437569893,LastTimestamp:2026-07-15 11:58:54.736600163 +0000 UTC m=+0.437569893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-5.ec2.internal,}" Jul 15 11:58:54.739328 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.739246 2559 policy_none.go:49] "None policy: Start" Jul 15 11:58:54.739360 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.739333 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 11:58:54.739360 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.739344 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 11:58:54.741463 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.741449 2559 policy_none.go:47] "Start" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.776938 2559 manager.go:337] "Starting Device Plugin manager" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.777153 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.777164 2559 server.go:87] "Starting device plugin registration server" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.777948 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.777964 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.778048 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.778176 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.778188 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.778815 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 11:58:54.797795 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.778856 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:54.845856 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.845807 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 11:58:54.847096 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.847078 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 11:58:54.847180 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.847116 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 11:58:54.847180 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.847138 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 11:58:54.847271 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.847179 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 11:58:54.849961 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.849936 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 11:58:54.878839 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.878754 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.880057 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.880041 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.880171 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.880071 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.880171 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.880082 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.880171 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.880107 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-5.ec2.internal" Jul 15 11:58:54.892090 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.892064 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-5.ec2.internal" Jul 15 11:58:54.892166 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.892097 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-5.ec2.internal\": node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:54.918456 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.918426 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:54.948239 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.948212 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal"] Jul 15 11:58:54.948340 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.948285 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.949209 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.949191 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.949283 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.949220 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.949283 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.949229 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.951333 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.951321 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.951454 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.951436 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:54.951522 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.951477 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.952277 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.952252 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.952366 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.952285 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.952366 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.952300 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.952366 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.952254 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.952366 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.952329 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.952366 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.952343 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.954447 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.954434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" Jul 15 11:58:54.954510 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.954459 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 11:58:54.956120 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.955966 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientMemory" Jul 15 11:58:54.956120 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.955993 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 11:58:54.956120 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:54.956005 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeHasSufficientPID" Jul 15 11:58:54.974197 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.974167 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-5.ec2.internal\" not found" node="ip-10-0-139-5.ec2.internal" Jul 15 11:58:54.977855 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:54.977830 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-5.ec2.internal\" not found" node="ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.015707 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.015673 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6ebb36ca37781fc37fae13a9dd7afd9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-5.ec2.internal\" (UID: \"e6ebb36ca37781fc37fae13a9dd7afd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.015707 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.015706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8ca1c5ecdd84678229e70c51fd74036-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal\" (UID: \"c8ca1c5ecdd84678229e70c51fd74036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.015905 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.015724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ca1c5ecdd84678229e70c51fd74036-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal\" (UID: \"c8ca1c5ecdd84678229e70c51fd74036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.018528 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.018494 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:55.116913 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.116879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6ebb36ca37781fc37fae13a9dd7afd9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-5.ec2.internal\" (UID: \"e6ebb36ca37781fc37fae13a9dd7afd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.116913 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.116910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8ca1c5ecdd84678229e70c51fd74036-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal\" (UID: \"c8ca1c5ecdd84678229e70c51fd74036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.117139 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.116929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ca1c5ecdd84678229e70c51fd74036-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal\" (UID: \"c8ca1c5ecdd84678229e70c51fd74036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.117139 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.116962 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ca1c5ecdd84678229e70c51fd74036-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal\" (UID: \"c8ca1c5ecdd84678229e70c51fd74036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.117139 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.116989 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8ca1c5ecdd84678229e70c51fd74036-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal\" (UID: \"c8ca1c5ecdd84678229e70c51fd74036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.117139 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.116985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6ebb36ca37781fc37fae13a9dd7afd9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-5.ec2.internal\" (UID: \"e6ebb36ca37781fc37fae13a9dd7afd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.118970 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.118952 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:55.219131 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.219051 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:55.277268 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.277239 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.280389 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.280367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.319410 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.319378 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:55.419963 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.419927 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:55.520091 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.520007 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-5.ec2.internal\" not found" Jul 15 11:58:55.520339 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.520321 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 11:58:55.613754 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.613728 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.630880 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.630707 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 11:58:55.633915 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.633891 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" Jul 15 11:58:55.645854 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.645824 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 11:58:55.647863 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.647835 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 11:58:55.648000 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.647981 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 11:58:55.648039 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.648007 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 11:58:55.696188 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.696157 2559 apiserver.go:52] "Watching apiserver" Jul 15 11:58:55.712854 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.712832 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 11:58:55.713016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.713000 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 11:58:55.713376 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.713353 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-t98pg","kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk","openshift-dns/node-resolver-z62h2","openshift-multus/multus-additional-cni-plugins-ncdvw","openshift-multus/multus-sw96m","openshift-network-diagnostics/network-check-target-cnvtc","openshift-network-operator/iptables-alerter-7qblc","kube-system/global-pull-secret-syncer-8ww5q","openshift-cluster-node-tuning-operator/tuned-2hwt9","openshift-image-registry/node-ca-4v7g7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal","openshift-multus/network-metrics-daemon-vx6r2","openshift-ovn-kubernetes/ovnkube-node-gvb46"] Jul 15 11:58:55.713431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.713390 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 11:58:55.715930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.715911 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.717850 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.717833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.719985 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.719971 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.720150 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-system-cni-dir\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720248 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cnibin\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720248 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-os-release\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720248 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720248 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720400 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720400 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.720400 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.720320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcs64\" (UniqueName: \"kubernetes.io/projected/5ce41496-fd6f-410f-8d9a-7d795391c6cb-kube-api-access-fcs64\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.722063 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.722045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.724171 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.724155 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:55.724258 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.724222 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:58:55.724607 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.724589 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 11:58:55.724701 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.724684 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 11:58:55.724802 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.724782 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 11:53:55 +0000 UTC" deadline="2028-01-11 18:25:08.315690122 +0000 UTC" Jul 15 11:58:55.724837 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.724802 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13086h26m12.590889947s" Jul 15 11:58:55.726307 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.726295 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.728375 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.728363 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.728853 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.728834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.728950 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.728838 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.728950 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.728842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tl5r8\"" Jul 15 11:58:55.728950 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.728916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 11:58:55.729172 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.729154 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.729263 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.729171 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 11:58:55.729263 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.729201 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 11:58:55.729263 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.729159 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.729435 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.729263 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 11:58:55.730395 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.730319 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-59sdv\"" Jul 15 11:58:55.730478 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.730418 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.730478 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.730436 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 11:58:55.730669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.730651 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.730939 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rp8l6\"" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.730999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.731065 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.731068 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.731296 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4gf2x\"" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.731395 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.731704 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.731432 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qgpfq\"" Jul 15 11:58:55.733421 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.733403 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.733754 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.733734 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 11:58:55.733846 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.733738 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t6llw\"" Jul 15 11:58:55.734104 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.734087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.736531 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.736307 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.736531 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.736359 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.736531 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.736376 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.736761 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.736747 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-znv67\"" Jul 15 11:58:55.738798 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.738780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:55.738863 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.738840 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:58:55.739383 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.739367 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 11:58:55.739458 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.739384 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.739530 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.739459 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.739644 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.739626 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fxxl9\"" Jul 15 11:58:55.741103 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.741088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.744947 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.744930 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 11:58:55.745597 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.745584 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 11:58:55.745661 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.745646 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 11:58:55.746039 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.746023 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w2p9m\"" Jul 15 11:58:55.746195 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.746181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 11:58:55.747602 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.747588 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 11:58:55.747675 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.747589 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 11:58:55.772943 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.772884 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m64js" Jul 15 11:58:55.783094 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.783073 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m64js" Jul 15 11:58:55.816027 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.816003 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 11:58:55.820475 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b8be811-7791-4ea4-8d99-4a92b17f8b75-iptables-alerter-script\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.820574 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.820626 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-cni-bin\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.820626 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-daemon-config\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.820697 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/613fec8e-7c9c-4503-88a9-5280c9eedb91-hosts-file\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.820740 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-systemd\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.820740 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-ovn\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.820804 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.820804 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-k8s-cni-cncf-io\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.820880 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4s46\" (UniqueName: \"kubernetes.io/projected/613fec8e-7c9c-4503-88a9-5280c9eedb91-kube-api-access-m4s46\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.820880 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-cni-netd\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.820880 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovn-node-metrics-cert\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821005 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.821005 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.820979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-os-release\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821106 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821010 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysconfig\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821106 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysctl-d\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821106 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-registration-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.821106 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c54d391c-9d7c-478f-80cb-7c86953b3bc9-dbus\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.821293 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-kubernetes\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821293 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-etc-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821293 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821293 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-node-log\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821293 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-log-socket\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-sys-fs\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cnibin\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-etc-kubernetes\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c41e8f72-5305-46d4-a545-964ec34d6f82-agent-certs\") pod \"konnectivity-agent-t98pg\" (UID: \"c41e8f72-5305-46d4-a545-964ec34d6f82\") " pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-systemd-units\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821433 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.821468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovnkube-script-lib\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821435 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cnibin\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b8be811-7791-4ea4-8d99-4a92b17f8b75-host-slash\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-socket-dir-parent\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-lib-modules\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-env-overrides\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysctl-conf\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-run\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-var-lib-kubelet\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-cnibin\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-system-cni-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-cni-multus\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-conf-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcs64\" (UniqueName: \"kubernetes.io/projected/5ce41496-fd6f-410f-8d9a-7d795391c6cb-kube-api-access-fcs64\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.821780 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-hostroot\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74ks4\" (UniqueName: \"kubernetes.io/projected/707c6293-fcb2-45dd-8b6e-6e30b111807a-kube-api-access-74ks4\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-modprobe-d\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bf1465d-ebb1-4032-922b-b39f09857e33-tmp\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbm6b\" (UniqueName: \"kubernetes.io/projected/086725e8-d715-4862-8203-b5908c21de18-kube-api-access-mbm6b\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-cni-bin\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovnkube-config\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-os-release\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-netns\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821992 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-os-release\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.821988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-sys\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-slash\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-device-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-multus-certs\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c54d391c-9d7c-478f-80cb-7c86953b3bc9-kubelet-config\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.822403 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-host\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96ggs\" (UniqueName: \"kubernetes.io/projected/2bf1465d-ebb1-4032-922b-b39f09857e33-kube-api-access-96ggs\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/086725e8-d715-4862-8203-b5908c21de18-serviceca\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-socket-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-var-lib-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd4pq\" (UniqueName: \"kubernetes.io/projected/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-kube-api-access-hd4pq\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf77h\" (UniqueName: \"kubernetes.io/projected/5b8be811-7791-4ea4-8d99-4a92b17f8b75-kube-api-access-jf77h\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-cni-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9f80684-f407-4f95-a868-cb44e8579ab0-cni-binary-copy\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822430 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-system-cni-dir\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822558 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-system-cni-dir\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-run-netns\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khlt2\" (UniqueName: \"kubernetes.io/projected/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-kube-api-access-khlt2\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.823035 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-kubelet\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613fec8e-7c9c-4503-88a9-5280c9eedb91-tmp-dir\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086725e8-d715-4862-8203-b5908c21de18-host\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-kubelet\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-systemd\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhr5z\" (UniqueName: \"kubernetes.io/projected/b9f80684-f407-4f95-a868-cb44e8579ab0-kube-api-access-lhr5z\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-etc-selinux\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c41e8f72-5305-46d4-a545-964ec34d6f82-konnectivity-ca\") pod \"konnectivity-agent-t98pg\" (UID: \"c41e8f72-5305-46d4-a545-964ec34d6f82\") " pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-tuned\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.822971 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ce41496-fd6f-410f-8d9a-7d795391c6cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.823635 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.823105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ce41496-fd6f-410f-8d9a-7d795391c6cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.832014 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.831991 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 11:58:55.835224 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.835204 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcs64\" (UniqueName: \"kubernetes.io/projected/5ce41496-fd6f-410f-8d9a-7d795391c6cb-kube-api-access-fcs64\") pod \"multus-additional-cni-plugins-ncdvw\" (UID: \"5ce41496-fd6f-410f-8d9a-7d795391c6cb\") " pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:55.916604 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:55.916569 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ebb36ca37781fc37fae13a9dd7afd9.slice/crio-efb097b5eda46a454c8e19b91d22b0d80ba27f88a07b5f0a049c23dc3dad4351 WatchSource:0}: Error finding container efb097b5eda46a454c8e19b91d22b0d80ba27f88a07b5f0a049c23dc3dad4351: Status 404 returned error can't find the container with id efb097b5eda46a454c8e19b91d22b0d80ba27f88a07b5f0a049c23dc3dad4351 Jul 15 11:58:55.920703 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.920688 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 11:58:55.923479 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-etc-kubernetes\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.923574 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c41e8f72-5305-46d4-a545-964ec34d6f82-agent-certs\") pod \"konnectivity-agent-t98pg\" (UID: \"c41e8f72-5305-46d4-a545-964ec34d6f82\") " pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.923574 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-systemd-units\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.923574 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.923574 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923564 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-systemd-units\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-etc-kubernetes\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovnkube-script-lib\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b8be811-7791-4ea4-8d99-4a92b17f8b75-host-slash\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-socket-dir-parent\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923652 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-lib-modules\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-env-overrides\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysctl-conf\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.923789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b8be811-7791-4ea4-8d99-4a92b17f8b75-host-slash\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923799 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-run\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923801 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-lib-modules\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923707 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-run\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923826 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysctl-conf\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-socket-dir-parent\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-var-lib-kubelet\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-cnibin\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923898 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-var-lib-kubelet\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-system-cni-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923919 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-cni-multus\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-conf-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923983 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-cni-multus\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-system-cni-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-hostroot\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.923946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-cnibin\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ks4\" (UniqueName: \"kubernetes.io/projected/707c6293-fcb2-45dd-8b6e-6e30b111807a-kube-api-access-74ks4\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:55.924108 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-modprobe-d\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-conf-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bf1465d-ebb1-4032-922b-b39f09857e33-tmp\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbm6b\" (UniqueName: \"kubernetes.io/projected/086725e8-d715-4862-8203-b5908c21de18-kube-api-access-mbm6b\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924110 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-hostroot\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-cni-bin\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovnkube-config\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-netns\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924107 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovnkube-script-lib\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-sys\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924177 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-modprobe-d\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-env-overrides\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-slash\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924265 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-sys\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924295 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-netns\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924302 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-slash\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-device-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924335 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-cni-bin\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-multus-certs\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924372 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-device-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c54d391c-9d7c-478f-80cb-7c86953b3bc9-kubelet-config\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-host\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-multus-certs\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ggs\" (UniqueName: \"kubernetes.io/projected/2bf1465d-ebb1-4032-922b-b39f09857e33-kube-api-access-96ggs\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924436 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c54d391c-9d7c-478f-80cb-7c86953b3bc9-kubelet-config\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/086725e8-d715-4862-8203-b5908c21de18-serviceca\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924472 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-host\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-socket-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-var-lib-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd4pq\" (UniqueName: \"kubernetes.io/projected/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-kube-api-access-hd4pq\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf77h\" (UniqueName: \"kubernetes.io/projected/5b8be811-7791-4ea4-8d99-4a92b17f8b75-kube-api-access-jf77h\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-cni-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924601 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-socket-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9f80684-f407-4f95-a868-cb44e8579ab0-cni-binary-copy\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:55.925930 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-run-netns\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khlt2\" (UniqueName: \"kubernetes.io/projected/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-kube-api-access-khlt2\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovnkube-config\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-kubelet\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613fec8e-7c9c-4503-88a9-5280c9eedb91-tmp-dir\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924818 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-var-lib-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086725e8-d715-4862-8203-b5908c21de18-host\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-kubelet\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-systemd\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhr5z\" (UniqueName: \"kubernetes.io/projected/b9f80684-f407-4f95-a868-cb44e8579ab0-kube-api-access-lhr5z\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.924985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-kubelet\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925001 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-systemd\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925013 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613fec8e-7c9c-4503-88a9-5280c9eedb91-tmp-dir\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/086725e8-d715-4862-8203-b5908c21de18-host\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925103 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-run-netns\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.925135 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9f80684-f407-4f95-a868-cb44e8579ab0-cni-binary-copy\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.926774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.925223 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 11:58:56.425201684 +0000 UTC m=+2.126171422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925225 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-kubelet\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925233 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-cni-dir\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-etc-selinux\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.925277 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c41e8f72-5305-46d4-a545-964ec34d6f82-konnectivity-ca\") pod \"konnectivity-agent-t98pg\" (UID: \"c41e8f72-5305-46d4-a545-964ec34d6f82\") " pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925382 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-etc-selinux\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925442 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-tuned\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.925461 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 11:58:56.42544518 +0000 UTC m=+2.126414913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b8be811-7791-4ea4-8d99-4a92b17f8b75-iptables-alerter-script\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925583 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/086725e8-d715-4862-8203-b5908c21de18-serviceca\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925598 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-cni-bin\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925694 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-daemon-config\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927303 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-var-lib-cni-bin\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/613fec8e-7c9c-4503-88a9-5280c9eedb91-hosts-file\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-systemd\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-ovn\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925827 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/613fec8e-7c9c-4503-88a9-5280c9eedb91-hosts-file\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925872 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c41e8f72-5305-46d4-a545-964ec34d6f82-konnectivity-ca\") pod \"konnectivity-agent-t98pg\" (UID: \"c41e8f72-5305-46d4-a545-964ec34d6f82\") " pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-k8s-cni-cncf-io\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4s46\" (UniqueName: \"kubernetes.io/projected/613fec8e-7c9c-4503-88a9-5280c9eedb91-kube-api-access-m4s46\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-cni-netd\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-ovn\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovn-node-metrics-cert\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925982 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-host-run-k8s-cni-cncf-io\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.925999 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-systemd\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926026 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-host-cni-netd\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-os-release\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysconfig\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.927806 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b8be811-7791-4ea4-8d99-4a92b17f8b75-iptables-alerter-script\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysctl-d\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-registration-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c54d391c-9d7c-478f-80cb-7c86953b3bc9-dbus\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-kubernetes\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-etc-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-node-log\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-log-socket\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926422 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysctl-d\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-sys-fs\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bf1465d-ebb1-4032-922b-b39f09857e33-tmp\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926481 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c54d391c-9d7c-478f-80cb-7c86953b3bc9-dbus\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926532 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9f80684-f407-4f95-a868-cb44e8579ab0-multus-daemon-config\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-sys-fs\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-sysconfig\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926569 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-kubernetes\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926580 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-run-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.928539 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926581 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-node-log\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926593 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-log-socket\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926613 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-registration-dir\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926624 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-etc-openvswitch\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926703 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c41e8f72-5305-46d4-a545-964ec34d6f82-agent-certs\") pod \"konnectivity-agent-t98pg\" (UID: \"c41e8f72-5305-46d4-a545-964ec34d6f82\") " pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.926640 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9f80684-f407-4f95-a868-cb44e8579ab0-os-release\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.928034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bf1465d-ebb1-4032-922b-b39f09857e33-etc-tuned\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.929059 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.928230 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-ovn-node-metrics-cert\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.937799 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.937777 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbm6b\" (UniqueName: \"kubernetes.io/projected/086725e8-d715-4862-8203-b5908c21de18-kube-api-access-mbm6b\") pod \"node-ca-4v7g7\" (UID: \"086725e8-d715-4862-8203-b5908c21de18\") " pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:55.938204 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.938185 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4s46\" (UniqueName: \"kubernetes.io/projected/613fec8e-7c9c-4503-88a9-5280c9eedb91-kube-api-access-m4s46\") pod \"node-resolver-z62h2\" (UID: \"613fec8e-7c9c-4503-88a9-5280c9eedb91\") " pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:55.939848 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.939829 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74ks4\" (UniqueName: \"kubernetes.io/projected/707c6293-fcb2-45dd-8b6e-6e30b111807a-kube-api-access-74ks4\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:55.942397 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.942377 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:58:55.942462 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.942404 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:58:55.942462 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.942442 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:58:55.942583 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:55.942540 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 11:58:56.442520297 +0000 UTC m=+2.143490033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:58:55.943522 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.943478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96ggs\" (UniqueName: \"kubernetes.io/projected/2bf1465d-ebb1-4032-922b-b39f09857e33-kube-api-access-96ggs\") pod \"tuned-2hwt9\" (UID: \"2bf1465d-ebb1-4032-922b-b39f09857e33\") " pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:55.943622 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.943606 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khlt2\" (UniqueName: \"kubernetes.io/projected/3c9f6ed2-b96e-4378-aecc-a8ff27c98810-kube-api-access-khlt2\") pod \"aws-ebs-csi-driver-node-w82qk\" (UID: \"3c9f6ed2-b96e-4378-aecc-a8ff27c98810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:55.944369 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.944352 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhr5z\" (UniqueName: \"kubernetes.io/projected/b9f80684-f407-4f95-a868-cb44e8579ab0-kube-api-access-lhr5z\") pod \"multus-sw96m\" (UID: \"b9f80684-f407-4f95-a868-cb44e8579ab0\") " pod="openshift-multus/multus-sw96m" Jul 15 11:58:55.944702 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.944685 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd4pq\" (UniqueName: \"kubernetes.io/projected/ab6cd076-4bb6-4544-af0f-23f06e8b89d5-kube-api-access-hd4pq\") pod \"ovnkube-node-gvb46\" (UID: \"ab6cd076-4bb6-4544-af0f-23f06e8b89d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:55.944864 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:55.944849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf77h\" (UniqueName: \"kubernetes.io/projected/5b8be811-7791-4ea4-8d99-4a92b17f8b75-kube-api-access-jf77h\") pod \"iptables-alerter-7qblc\" (UID: \"5b8be811-7791-4ea4-8d99-4a92b17f8b75\") " pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:56.053135 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.053042 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" Jul 15 11:58:56.062821 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.062794 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce41496_fd6f_410f_8d9a_7d795391c6cb.slice/crio-cfe5c7581975edb64a0f41e8899eeb31e10f5fb98c952583cb40a7f3298e553b WatchSource:0}: Error finding container cfe5c7581975edb64a0f41e8899eeb31e10f5fb98c952583cb40a7f3298e553b: Status 404 returned error can't find the container with id cfe5c7581975edb64a0f41e8899eeb31e10f5fb98c952583cb40a7f3298e553b Jul 15 11:58:56.078758 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.078738 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qblc" Jul 15 11:58:56.086913 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.086883 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8be811_7791_4ea4_8d99_4a92b17f8b75.slice/crio-bc8f7113211f3110111e36fb01dbc5b08bd6c9cde5d9e427c31bbc0efdbffe21 WatchSource:0}: Error finding container bc8f7113211f3110111e36fb01dbc5b08bd6c9cde5d9e427c31bbc0efdbffe21: Status 404 returned error can't find the container with id bc8f7113211f3110111e36fb01dbc5b08bd6c9cde5d9e427c31bbc0efdbffe21 Jul 15 11:58:56.104630 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.104604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" Jul 15 11:58:56.113600 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.113572 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9f6ed2_b96e_4378_aecc_a8ff27c98810.slice/crio-93d8bf8d9da5c144724c480e83e5f09941fed3c86ddb315acbbc691dd8ab2376 WatchSource:0}: Error finding container 93d8bf8d9da5c144724c480e83e5f09941fed3c86ddb315acbbc691dd8ab2376: Status 404 returned error can't find the container with id 93d8bf8d9da5c144724c480e83e5f09941fed3c86ddb315acbbc691dd8ab2376 Jul 15 11:58:56.116634 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.116584 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:58:56.125457 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.125435 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41e8f72_5305_46d4_a545_964ec34d6f82.slice/crio-2f6a4e985f98edc8f47b14271ac1a1a8870e0699d4485c71a639d5a7878ef6b1 WatchSource:0}: Error finding container 2f6a4e985f98edc8f47b14271ac1a1a8870e0699d4485c71a639d5a7878ef6b1: Status 404 returned error can't find the container with id 2f6a4e985f98edc8f47b14271ac1a1a8870e0699d4485c71a639d5a7878ef6b1 Jul 15 11:58:56.128544 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.128528 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sw96m" Jul 15 11:58:56.138837 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.138811 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f80684_f407_4f95_a868_cb44e8579ab0.slice/crio-d89a661bdb4b85d7d8acc03f5f1d33393ec98ff06a981eb9c251a0dec7b781e5 WatchSource:0}: Error finding container d89a661bdb4b85d7d8acc03f5f1d33393ec98ff06a981eb9c251a0dec7b781e5: Status 404 returned error can't find the container with id d89a661bdb4b85d7d8acc03f5f1d33393ec98ff06a981eb9c251a0dec7b781e5 Jul 15 11:58:56.144249 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.144233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z62h2" Jul 15 11:58:56.151817 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.151796 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613fec8e_7c9c_4503_88a9_5280c9eedb91.slice/crio-f8163698da4e5a17093bfe709f3ee19cb459b7b8258427b6d6a9affb264709dd WatchSource:0}: Error finding container f8163698da4e5a17093bfe709f3ee19cb459b7b8258427b6d6a9affb264709dd: Status 404 returned error can't find the container with id f8163698da4e5a17093bfe709f3ee19cb459b7b8258427b6d6a9affb264709dd Jul 15 11:58:56.157768 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.157748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" Jul 15 11:58:56.165271 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.165247 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf1465d_ebb1_4032_922b_b39f09857e33.slice/crio-3f8e69bc64466b887d8e8e39c5ea1f776202125a68a611e10c62a9c9d6d316b6 WatchSource:0}: Error finding container 3f8e69bc64466b887d8e8e39c5ea1f776202125a68a611e10c62a9c9d6d316b6: Status 404 returned error can't find the container with id 3f8e69bc64466b887d8e8e39c5ea1f776202125a68a611e10c62a9c9d6d316b6 Jul 15 11:58:56.176912 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.176881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4v7g7" Jul 15 11:58:56.181957 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.181938 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:58:56.185361 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.185341 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086725e8_d715_4862_8203_b5908c21de18.slice/crio-fc306015112ddc40da289dd04485b71f34a864d9cc31cc66e9a15b404ea6dd20 WatchSource:0}: Error finding container fc306015112ddc40da289dd04485b71f34a864d9cc31cc66e9a15b404ea6dd20: Status 404 returned error can't find the container with id fc306015112ddc40da289dd04485b71f34a864d9cc31cc66e9a15b404ea6dd20 Jul 15 11:58:56.190276 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.190255 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6cd076_4bb6_4544_af0f_23f06e8b89d5.slice/crio-191d6ee60e9ea53e1cbcc53b5edd6f149ddd2ebafc7665cdb6d72ea56126df85 WatchSource:0}: Error finding container 191d6ee60e9ea53e1cbcc53b5edd6f149ddd2ebafc7665cdb6d72ea56126df85: Status 404 returned error can't find the container with id 191d6ee60e9ea53e1cbcc53b5edd6f149ddd2ebafc7665cdb6d72ea56126df85 Jul 15 11:58:56.282598 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.282568 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 11:58:56.429957 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.429870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:56.429957 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.429923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:56.430159 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.430038 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:58:56.430159 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.430042 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:58:56.430159 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.430104 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 11:58:57.430085 +0000 UTC m=+3.131054720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:58:56.430159 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.430124 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 11:58:57.430114216 +0000 UTC m=+3.131083938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:58:56.509683 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:58:56.509646 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ca1c5ecdd84678229e70c51fd74036.slice/crio-e2c0237b0db2efac6df0e82db55c1f3aeccd0bce94b18632c4571c171a4688ad WatchSource:0}: Error finding container e2c0237b0db2efac6df0e82db55c1f3aeccd0bce94b18632c4571c171a4688ad: Status 404 returned error can't find the container with id e2c0237b0db2efac6df0e82db55c1f3aeccd0bce94b18632c4571c171a4688ad Jul 15 11:58:56.531022 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:56.530986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:56.531192 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.531175 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:58:56.531259 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.531201 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:58:56.531259 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.531215 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:58:56.531366 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:56.531273 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 11:58:57.531255287 +0000 UTC m=+3.232225018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:58:57.813960 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.813779 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 11:53:56 +0000 UTC" deadline="2028-02-04 16:28:22.356553798 +0000 UTC" Jul 15 11:58:57.813960 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.813845 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13660h29m24.542713593s" Jul 15 11:58:57.876608 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.875798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:57.876608 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:57.875928 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:58:57.876608 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.876348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:57.876608 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:57.876443 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:58:57.895213 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.895145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" event={"ID":"c8ca1c5ecdd84678229e70c51fd74036","Type":"ContainerStarted","Data":"e2c0237b0db2efac6df0e82db55c1f3aeccd0bce94b18632c4571c171a4688ad"} Jul 15 11:58:57.905997 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.905848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"191d6ee60e9ea53e1cbcc53b5edd6f149ddd2ebafc7665cdb6d72ea56126df85"} Jul 15 11:58:57.911207 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.911166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z62h2" event={"ID":"613fec8e-7c9c-4503-88a9-5280c9eedb91","Type":"ContainerStarted","Data":"f8163698da4e5a17093bfe709f3ee19cb459b7b8258427b6d6a9affb264709dd"} Jul 15 11:58:57.915937 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.915905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sw96m" event={"ID":"b9f80684-f407-4f95-a868-cb44e8579ab0","Type":"ContainerStarted","Data":"d89a661bdb4b85d7d8acc03f5f1d33393ec98ff06a981eb9c251a0dec7b781e5"} Jul 15 11:58:57.917769 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.917739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t98pg" event={"ID":"c41e8f72-5305-46d4-a545-964ec34d6f82","Type":"ContainerStarted","Data":"2f6a4e985f98edc8f47b14271ac1a1a8870e0699d4485c71a639d5a7878ef6b1"} Jul 15 11:58:57.920649 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.920621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" event={"ID":"3c9f6ed2-b96e-4378-aecc-a8ff27c98810","Type":"ContainerStarted","Data":"93d8bf8d9da5c144724c480e83e5f09941fed3c86ddb315acbbc691dd8ab2376"} Jul 15 11:58:57.930531 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.930490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerStarted","Data":"cfe5c7581975edb64a0f41e8899eeb31e10f5fb98c952583cb40a7f3298e553b"} Jul 15 11:58:57.936062 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.935949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" event={"ID":"e6ebb36ca37781fc37fae13a9dd7afd9","Type":"ContainerStarted","Data":"efb097b5eda46a454c8e19b91d22b0d80ba27f88a07b5f0a049c23dc3dad4351"} Jul 15 11:58:57.944356 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.944280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4v7g7" event={"ID":"086725e8-d715-4862-8203-b5908c21de18","Type":"ContainerStarted","Data":"fc306015112ddc40da289dd04485b71f34a864d9cc31cc66e9a15b404ea6dd20"} Jul 15 11:58:57.946749 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.946687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" event={"ID":"2bf1465d-ebb1-4032-922b-b39f09857e33","Type":"ContainerStarted","Data":"3f8e69bc64466b887d8e8e39c5ea1f776202125a68a611e10c62a9c9d6d316b6"} Jul 15 11:58:57.951598 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.951570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qblc" event={"ID":"5b8be811-7791-4ea4-8d99-4a92b17f8b75","Type":"ContainerStarted","Data":"bc8f7113211f3110111e36fb01dbc5b08bd6c9cde5d9e427c31bbc0efdbffe21"} Jul 15 11:58:57.982838 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:57.982806 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 11:58:58.466231 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.466190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:58.466427 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.466249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:58.466427 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.466406 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:58:58.466547 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.466473 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:00.46645253 +0000 UTC m=+5.139887491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:58:58.466884 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.466864 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:58:58.466983 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.466916 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 11:59:00.466902618 +0000 UTC m=+5.140337566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:58:58.529651 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.529441 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 11:58:58.568063 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.567551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:58.568063 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.567768 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:58:58.568063 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.567791 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:58:58.568063 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.567804 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:58:58.568063 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.567860 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:00.56784171 +0000 UTC m=+5.241276670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:58:58.814927 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.814835 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 11:53:56 +0000 UTC" deadline="2028-03-31 17:04:24.625597086 +0000 UTC" Jul 15 11:58:58.814927 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.814877 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15005h5m25.810724365s" Jul 15 11:58:58.875174 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:58.875143 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:58:58.875357 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:58.875273 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:58:59.879445 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:59.879300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:58:59.879445 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:58:59.879337 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:58:59.879445 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:59.879430 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:58:59.879989 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:58:59.879520 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:00.482201 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:00.482166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:00.482369 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:00.482219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:00.482369 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.482336 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:00.482503 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.482419 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 11:59:04.482397612 +0000 UTC m=+9.155832573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:00.482503 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.482343 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:00.482503 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.482497 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:04.482480261 +0000 UTC m=+9.155915213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:00.583002 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:00.582964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:00.583198 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.583175 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:59:00.583198 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.583196 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:59:00.583307 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.583209 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:00.583307 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.583266 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:04.583249128 +0000 UTC m=+9.256684090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:00.875938 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:00.875839 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:00.876129 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:00.875991 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:01.878547 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:01.875500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:01.878547 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:01.875635 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:01.878547 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:01.876051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:01.878547 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:01.876145 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:02.876311 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:02.875767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:02.876311 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:02.875922 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:03.875369 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:03.875335 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:03.875851 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:03.875472 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:03.875851 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:03.875507 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:03.875851 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:03.875587 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:04.519116 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:04.518851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:04.519116 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:04.518912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:04.519116 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.518967 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:04.519116 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.519049 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 11:59:12.519013384 +0000 UTC m=+17.192448343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:04.519116 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.519053 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:04.519116 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.519090 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:12.519079593 +0000 UTC m=+17.192514553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:04.620475 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:04.619795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:04.620475 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.619972 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:59:04.620475 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.619995 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:59:04.620475 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.620008 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:04.620475 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.620084 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:12.6200641 +0000 UTC m=+17.293499045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:04.875893 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:04.875809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:04.876368 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:04.875959 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:05.878986 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:05.878961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:05.879459 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:05.879070 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:05.879459 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:05.879141 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:05.879459 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:05.879206 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:06.875275 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:06.874891 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:06.875275 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:06.875058 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:07.878177 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:07.878147 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:07.878627 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:07.878182 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:07.878627 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:07.878264 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:07.878627 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:07.878358 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:08.875588 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:08.875553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:08.875782 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:08.875705 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:09.877913 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:09.877883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:09.878342 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:09.877886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:09.878342 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:09.877988 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:09.878342 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:09.878113 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:10.874844 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:10.874811 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:10.875019 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:10.874948 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:11.875221 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:11.875187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:11.875664 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:11.875316 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:11.875664 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:11.875365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:11.875664 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:11.875462 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:12.578359 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:12.578266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:12.578359 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:12.578322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:12.578693 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.578434 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:12.578693 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.578466 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:12.578693 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.578510 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 11:59:28.578488936 +0000 UTC m=+33.251923901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:12.578693 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.578532 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:28.578522675 +0000 UTC m=+33.251957620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:12.679134 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:12.679095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:12.679322 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.679303 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:59:12.679392 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.679327 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:59:12.679392 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.679341 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:12.679486 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.679412 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:28.679393169 +0000 UTC m=+33.352828130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:12.875771 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:12.875696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:12.876199 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:12.875821 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:13.875630 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:13.875589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:13.875824 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:13.875728 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:13.875824 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:13.875793 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:13.876265 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:13.875918 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:14.875078 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:14.874841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:14.875230 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:14.875192 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:15.875426 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:15.875397 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:15.875913 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:15.875504 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:15.875913 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:15.875578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:15.875913 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:15.875666 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:16.875322 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:16.875286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:16.875470 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:16.875400 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:17.875873 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.875534 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:17.876582 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.875551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:17.876582 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:17.875959 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:17.876582 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:17.876057 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:17.995158 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.995119 2559 generic.go:356] "Generic (PLEG): container finished" podID="c8ca1c5ecdd84678229e70c51fd74036" containerID="6f08f4bf68c1a70d1e2bc872aeee1a57131d2738456e3282fa3237dba84474bb" exitCode=0 Jul 15 11:59:17.995327 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.995220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" event={"ID":"c8ca1c5ecdd84678229e70c51fd74036","Type":"ContainerDied","Data":"6f08f4bf68c1a70d1e2bc872aeee1a57131d2738456e3282fa3237dba84474bb"} Jul 15 11:59:17.998887 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.998869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 11:59:17.999339 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999275 2559 generic.go:356] "Generic (PLEG): container finished" podID="ab6cd076-4bb6-4544-af0f-23f06e8b89d5" containerID="d366243a75853726a13b57d85e843c6b9e6b0eb392710f06cd66068ea3ac87bf" exitCode=1 Jul 15 11:59:17.999339 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999305 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"bc99df0ec6ea403cecc0f578fa2223ab4e9efc53b8b1620dccef277705c22e87"} Jul 15 11:59:17.999507 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999377 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"7641454be81edb4a88ef73bd6faa584349f63f71aedc215ef699e5ebb191b27a"} Jul 15 11:59:17.999507 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"123694a726b2072c38097c003164525385a2b17e4ab0dc668a3d0c29f328635f"} Jul 15 11:59:17.999507 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"376444f062c740d50c443c436a2d3ed16c788150de6a54762b53ade7f2e01f61"} Jul 15 11:59:17.999507 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerDied","Data":"d366243a75853726a13b57d85e843c6b9e6b0eb392710f06cd66068ea3ac87bf"} Jul 15 11:59:17.999702 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:17.999537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"53c2806bc817c4283c9e63894ece56740253b5c50a9dad05d75600724beac4f7"} Jul 15 11:59:18.000959 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.000931 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z62h2" event={"ID":"613fec8e-7c9c-4503-88a9-5280c9eedb91","Type":"ContainerStarted","Data":"29f15ee31270999e1ad958601956eb57cb3c228b6159be2f3c12aaded8d28033"} Jul 15 11:59:18.004143 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.004119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sw96m" event={"ID":"b9f80684-f407-4f95-a868-cb44e8579ab0","Type":"ContainerStarted","Data":"8cc4381d000c531efbc935f6caf7e96c62a78e45436f206fc263e9b490ca15e6"} Jul 15 11:59:18.006578 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.006546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t98pg" event={"ID":"c41e8f72-5305-46d4-a545-964ec34d6f82","Type":"ContainerStarted","Data":"b0e4326cbd7bf319873968b540be50c058528d0b22ee62438c8eeb750f5c5792"} Jul 15 11:59:18.008156 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.008135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" event={"ID":"3c9f6ed2-b96e-4378-aecc-a8ff27c98810","Type":"ContainerStarted","Data":"0572b7668cf36f45832d7523a768c579e0007659a213b7f50e26e47601966aa2"} Jul 15 11:59:18.009912 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.009887 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ce41496-fd6f-410f-8d9a-7d795391c6cb" containerID="49fde918e6dc0ff6c9ad9c3c5afc46c94b1e79e998b652ac3e52c60a719a99aa" exitCode=0 Jul 15 11:59:18.010016 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.009970 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerDied","Data":"49fde918e6dc0ff6c9ad9c3c5afc46c94b1e79e998b652ac3e52c60a719a99aa"} Jul 15 11:59:18.011513 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.011485 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" event={"ID":"e6ebb36ca37781fc37fae13a9dd7afd9","Type":"ContainerStarted","Data":"24c9f76a587e33a231a7e1d81aa2052aa2891f7f5f3e6009d7f4c90e543f6cb8"} Jul 15 11:59:18.013214 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.013196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4v7g7" event={"ID":"086725e8-d715-4862-8203-b5908c21de18","Type":"ContainerStarted","Data":"939a3a0fd84cf9b0057dafd37620b31c208e792aac3f3fbfe2a17f63b361c7be"} Jul 15 11:59:18.014747 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.014727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" event={"ID":"2bf1465d-ebb1-4032-922b-b39f09857e33","Type":"ContainerStarted","Data":"6781951426fee45d4973d0b82f65b60a58e2b18b9e50d991aff8d85083f8d4e2"} Jul 15 11:59:18.068613 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.068553 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hwt9" podStartSLOduration=2.171539558 podStartE2EDuration="22.068528789s" totalImagesPullingTime="19.896989231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:18.06820473 +0000 UTC m=+22.741639700" watchObservedRunningTime="2026-07-15 11:59:18.068528789 +0000 UTC m=+22.741963758" Jul 15 11:59:18.085354 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.085310 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-5.ec2.internal" podStartSLOduration=22.085294412 podStartE2EDuration="22.085294412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:18.085092264 +0000 UTC m=+22.758527230" watchObservedRunningTime="2026-07-15 11:59:18.085294412 +0000 UTC m=+22.758729378" Jul 15 11:59:18.109735 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.109680 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t98pg" podStartSLOduration=3.199317622 podStartE2EDuration="23.109665099s" totalImagesPullingTime="19.910347477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:18.109426605 +0000 UTC m=+22.782861574" watchObservedRunningTime="2026-07-15 11:59:18.109665099 +0000 UTC m=+22.783100066" Jul 15 11:59:18.158790 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.158741 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sw96m" podStartSLOduration=2.145414783 podStartE2EDuration="22.158723109s" totalImagesPullingTime="20.013308326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:18.138272421 +0000 UTC m=+22.811707390" watchObservedRunningTime="2026-07-15 11:59:18.158723109 +0000 UTC m=+22.832158085" Jul 15 11:59:18.209940 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.209886 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z62h2" podStartSLOduration=2.339753891 podStartE2EDuration="22.209868182s" totalImagesPullingTime="19.870114291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:18.158862148 +0000 UTC m=+22.832297148" watchObservedRunningTime="2026-07-15 11:59:18.209868182 +0000 UTC m=+22.883303148" Jul 15 11:59:18.751569 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.751505 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 11:59:18.819478 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.819383 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T11:59:18.751528386Z","UUID":"8c59e7b2-331d-459e-a7e5-86938fd51d80","Handler":null,"Name":"","Endpoint":""} Jul 15 11:59:18.822263 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.822243 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 11:59:18.822396 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.822277 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 11:59:18.875446 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:18.875418 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:18.875637 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:18.875543 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:19.018898 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.018818 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" event={"ID":"3c9f6ed2-b96e-4378-aecc-a8ff27c98810","Type":"ContainerStarted","Data":"3c5278ac6e22bf70c82aaa81229cfc5085548baac6bf2188c1996830d4eb52db"} Jul 15 11:59:19.020326 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.020300 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qblc" event={"ID":"5b8be811-7791-4ea4-8d99-4a92b17f8b75","Type":"ContainerStarted","Data":"68285ffaa04450ca8bd57db191f43264b6e079586e85087a6230873f25412e1a"} Jul 15 11:59:19.022075 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.021985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" event={"ID":"c8ca1c5ecdd84678229e70c51fd74036","Type":"ContainerStarted","Data":"6f0feaa9c6ebdd8129a7027100ec6c363f19ceb00d9e11e6a0b6a6295b7cb703"} Jul 15 11:59:19.041129 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.041083 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4v7g7" podStartSLOduration=3.204836033 podStartE2EDuration="23.041068231s" totalImagesPullingTime="19.836232198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:18.210249737 +0000 UTC m=+22.883684707" watchObservedRunningTime="2026-07-15 11:59:19.041068231 +0000 UTC m=+23.714503197" Jul 15 11:59:19.066758 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.066706 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7qblc" podStartSLOduration=4.090148853 podStartE2EDuration="24.066689517s" totalImagesPullingTime="19.976540664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:19.041646224 +0000 UTC m=+23.715081190" watchObservedRunningTime="2026-07-15 11:59:19.066689517 +0000 UTC m=+23.740124475" Jul 15 11:59:19.560235 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.560201 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:59:19.561098 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.561066 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:59:19.578479 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.578418 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-5.ec2.internal" podStartSLOduration=23.578396742 podStartE2EDuration="23.578396742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:19.066979449 +0000 UTC m=+23.740414416" watchObservedRunningTime="2026-07-15 11:59:19.578396742 +0000 UTC m=+24.251831710" Jul 15 11:59:19.875019 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.874929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:19.875202 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:19.874929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:19.875202 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:19.875076 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:19.875202 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:19.875154 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:20.025671 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:20.025630 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:59:20.026128 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:20.025902 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t98pg" Jul 15 11:59:20.875603 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:20.875514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:20.875774 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:20.875642 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:21.031133 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:21.031106 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 11:59:21.031588 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:21.031551 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"61318c58e966045600af8003dcf81bf8bcfb5259f095d03935eabe4e1ce97b8b"} Jul 15 11:59:21.033963 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:21.033940 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" event={"ID":"3c9f6ed2-b96e-4378-aecc-a8ff27c98810","Type":"ContainerStarted","Data":"e8732c1d0e3b1fc49e0c286341649ba303af88b916334d5418e1b452f02a3a64"} Jul 15 11:59:21.055168 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:21.055116 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w82qk" podStartSLOduration=11.524715132 podStartE2EDuration="26.055101721s" totalImagesPullingTime="14.530386589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:21.054919898 +0000 UTC m=+25.728354866" watchObservedRunningTime="2026-07-15 11:59:21.055101721 +0000 UTC m=+25.728536687" Jul 15 11:59:21.875462 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:21.875428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:21.875638 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:21.875558 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:21.875638 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:21.875596 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:21.875742 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:21.875713 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:22.875062 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:22.874916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:22.875433 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:22.875143 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:23.041868 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.041848 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 11:59:23.042227 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.042201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"86f888b5fdb451a9b39f2bdf6c98a3fe754cb384853155bf524f0bf0dac70799"} Jul 15 11:59:23.042483 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.042463 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:59:23.042666 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.042628 2559 scope.go:117] "RemoveContainer" containerID="d366243a75853726a13b57d85e843c6b9e6b0eb392710f06cd66068ea3ac87bf" Jul 15 11:59:23.057150 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.057127 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:59:23.875682 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.875648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:23.876463 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:23.875806 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:23.876463 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:23.875847 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:23.876463 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:23.875913 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:24.045980 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.045951 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ce41496-fd6f-410f-8d9a-7d795391c6cb" containerID="e0e7beb77c82a5bfd2a30effe2795a4ca9acf9705153ff3380702a3c3343bdbc" exitCode=0 Jul 15 11:59:24.046175 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.046056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerDied","Data":"e0e7beb77c82a5bfd2a30effe2795a4ca9acf9705153ff3380702a3c3343bdbc"} Jul 15 11:59:24.049886 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.049869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 11:59:24.050232 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.050212 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" event={"ID":"ab6cd076-4bb6-4544-af0f-23f06e8b89d5","Type":"ContainerStarted","Data":"9dea1f73cfad545eef67a4ef1a1e2166eb28f8fd275085a9ca82cce0a4c61bd7"} Jul 15 11:59:24.050423 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.050395 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:59:24.050523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.050480 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:59:24.065837 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.065813 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:59:24.098579 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.098539 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" podStartSLOduration=8.191498089 podStartE2EDuration="28.098525004s" totalImagesPullingTime="19.907026915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:24.09735305 +0000 UTC m=+28.770788017" watchObservedRunningTime="2026-07-15 11:59:24.098525004 +0000 UTC m=+28.771959970" Jul 15 11:59:24.875174 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:24.874975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:24.875333 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:24.875256 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:25.151468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:25.151441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8ww5q"] Jul 15 11:59:25.151766 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:25.151575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:25.151766 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:25.151661 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:25.154712 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:25.154680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cnvtc"] Jul 15 11:59:25.154825 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:25.154784 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:25.154912 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:25.154889 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:25.155580 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:25.155561 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vx6r2"] Jul 15 11:59:25.155671 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:25.155639 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:25.155739 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:25.155721 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:26.056349 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:26.056305 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ce41496-fd6f-410f-8d9a-7d795391c6cb" containerID="bdcb736c525dc27cacd6498c9cf709cbca7227dd10c6071c229dbc50bf4bb75f" exitCode=0 Jul 15 11:59:26.056515 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:26.056371 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerDied","Data":"bdcb736c525dc27cacd6498c9cf709cbca7227dd10c6071c229dbc50bf4bb75f"} Jul 15 11:59:26.875314 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:26.875277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:26.875688 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:26.875413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:26.875688 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:26.875437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:26.875688 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:26.875434 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:26.875688 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:26.875531 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:26.875688 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:26.875591 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:27.063005 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:27.062978 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ce41496-fd6f-410f-8d9a-7d795391c6cb" containerID="941ddc1dd941177f1aa028e9e5296a9b701a7d138f586d080c253f323b4f17df" exitCode=0 Jul 15 11:59:27.063147 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:27.063020 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerDied","Data":"941ddc1dd941177f1aa028e9e5296a9b701a7d138f586d080c253f323b4f17df"} Jul 15 11:59:28.598643 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:28.598600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:28.598643 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:28.598659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:28.599154 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.598770 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:28.599154 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.598772 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:28.599154 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.598840 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret podName:c54d391c-9d7c-478f-80cb-7c86953b3bc9 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:00.598821385 +0000 UTC m=+65.272256332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret") pod "global-pull-secret-syncer-8ww5q" (UID: "c54d391c-9d7c-478f-80cb-7c86953b3bc9") : object "kube-system"/"original-pull-secret" not registered Jul 15 11:59:28.599154 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.598861 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 12:00:00.598850893 +0000 UTC m=+65.272285843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 11:59:28.699292 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:28.699250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:28.699489 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.699387 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 11:59:28.699489 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.699411 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 11:59:28.699489 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.699444 2559 projected.go:196] Error preparing data for projected volume kube-api-access-f7npk for pod openshift-network-diagnostics/network-check-target-cnvtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:28.699640 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.699515 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk podName:30e8efbb-591c-4428-a449-0ad905171543 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:00.69949213 +0000 UTC m=+65.372927076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7npk" (UniqueName: "kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk") pod "network-check-target-cnvtc" (UID: "30e8efbb-591c-4428-a449-0ad905171543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 11:59:28.875991 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:28.875864 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:28.875991 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:28.875908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:28.875991 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:28.875992 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:28.876295 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.876011 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:28.876295 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.876101 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:28.876295 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:28.876190 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:30.875795 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:30.875536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:30.876317 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:30.875576 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:30.876317 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:30.875912 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6r2" podUID="707c6293-fcb2-45dd-8b6e-6e30b111807a" Jul 15 11:59:30.876317 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:30.875581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:30.876317 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:30.875970 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnvtc" podUID="30e8efbb-591c-4428-a449-0ad905171543" Jul 15 11:59:30.876317 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:30.876028 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ww5q" podUID="c54d391c-9d7c-478f-80cb-7c86953b3bc9" Jul 15 11:59:31.191166 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.191141 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-5.ec2.internal" event="NodeReady" Jul 15 11:59:31.191321 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.191304 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 11:59:31.244662 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.244585 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mz2s5"] Jul 15 11:59:31.262890 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.262855 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-md752"] Jul 15 11:59:31.263066 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.262981 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.265954 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.265910 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqsqx\"" Jul 15 11:59:31.266118 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.266070 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 11:59:31.266198 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.266168 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 11:59:31.277497 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.277475 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mz2s5"] Jul 15 11:59:31.277605 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.277511 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-md752"] Jul 15 11:59:31.277605 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.277588 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.280231 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.280206 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 11:59:31.280358 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.280282 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zh86n\"" Jul 15 11:59:31.280358 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.280297 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 11:59:31.280450 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.280382 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 11:59:31.422286 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.422250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.422286 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.422291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a3f9511-123a-47a7-8227-36c91e824fbc-cert\") pod \"ingress-canary-md752\" (UID: \"5a3f9511-123a-47a7-8227-36c91e824fbc\") " pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.422495 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.422312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vlk4\" (UniqueName: \"kubernetes.io/projected/5a3f9511-123a-47a7-8227-36c91e824fbc-kube-api-access-8vlk4\") pod \"ingress-canary-md752\" (UID: \"5a3f9511-123a-47a7-8227-36c91e824fbc\") " pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.422495 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.422329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36f480ce-7808-4f4c-9f44-066b97a5e083-config-volume\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.422495 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.422431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44gcj\" (UniqueName: \"kubernetes.io/projected/36f480ce-7808-4f4c-9f44-066b97a5e083-kube-api-access-44gcj\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.422495 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.422471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36f480ce-7808-4f4c-9f44-066b97a5e083-tmp-dir\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.523610 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.523543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44gcj\" (UniqueName: \"kubernetes.io/projected/36f480ce-7808-4f4c-9f44-066b97a5e083-kube-api-access-44gcj\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.523610 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.523578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36f480ce-7808-4f4c-9f44-066b97a5e083-tmp-dir\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.523731 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.523621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.523731 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.523641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a3f9511-123a-47a7-8227-36c91e824fbc-cert\") pod \"ingress-canary-md752\" (UID: \"5a3f9511-123a-47a7-8227-36c91e824fbc\") " pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.523731 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.523660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vlk4\" (UniqueName: \"kubernetes.io/projected/5a3f9511-123a-47a7-8227-36c91e824fbc-kube-api-access-8vlk4\") pod \"ingress-canary-md752\" (UID: \"5a3f9511-123a-47a7-8227-36c91e824fbc\") " pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.523731 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.523681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36f480ce-7808-4f4c-9f44-066b97a5e083-config-volume\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.523908 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:31.523753 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 11:59:31.523908 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:31.523832 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:32.023811443 +0000 UTC m=+36.697246393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 11:59:31.524101 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.524071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36f480ce-7808-4f4c-9f44-066b97a5e083-tmp-dir\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.524274 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.524257 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36f480ce-7808-4f4c-9f44-066b97a5e083-config-volume\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.527812 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.527795 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a3f9511-123a-47a7-8227-36c91e824fbc-cert\") pod \"ingress-canary-md752\" (UID: \"5a3f9511-123a-47a7-8227-36c91e824fbc\") " pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.533160 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.533132 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44gcj\" (UniqueName: \"kubernetes.io/projected/36f480ce-7808-4f4c-9f44-066b97a5e083-kube-api-access-44gcj\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:31.533264 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.533228 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vlk4\" (UniqueName: \"kubernetes.io/projected/5a3f9511-123a-47a7-8227-36c91e824fbc-kube-api-access-8vlk4\") pod \"ingress-canary-md752\" (UID: \"5a3f9511-123a-47a7-8227-36c91e824fbc\") " pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.586369 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.586331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-md752" Jul 15 11:59:31.774436 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:31.774343 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-md752"] Jul 15 11:59:31.779383 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:31.779357 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3f9511_123a_47a7_8227_36c91e824fbc.slice/crio-8003412d01e803afd624d246b66f66ac2b30d9e9ed6e149e99048b6a49d0e866 WatchSource:0}: Error finding container 8003412d01e803afd624d246b66f66ac2b30d9e9ed6e149e99048b6a49d0e866: Status 404 returned error can't find the container with id 8003412d01e803afd624d246b66f66ac2b30d9e9ed6e149e99048b6a49d0e866 Jul 15 11:59:32.027817 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.027714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:32.028520 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:32.027893 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 11:59:32.028520 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:32.027958 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:33.027941515 +0000 UTC m=+37.701376464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 11:59:32.075679 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.075639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-md752" event={"ID":"5a3f9511-123a-47a7-8227-36c91e824fbc","Type":"ContainerStarted","Data":"8003412d01e803afd624d246b66f66ac2b30d9e9ed6e149e99048b6a49d0e866"} Jul 15 11:59:32.078274 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.078245 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ce41496-fd6f-410f-8d9a-7d795391c6cb" containerID="7349e1862e2f431712537791baeac7a7baffceed7500e7a796bfa422d7ddda7a" exitCode=0 Jul 15 11:59:32.078398 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.078290 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerDied","Data":"7349e1862e2f431712537791baeac7a7baffceed7500e7a796bfa422d7ddda7a"} Jul 15 11:59:32.875499 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.875466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 11:59:32.875687 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.875513 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 11:59:32.875746 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.875732 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 11:59:32.878591 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.878433 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 11:59:32.878591 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.878471 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f876h\"" Jul 15 11:59:32.878591 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.878489 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 11:59:32.879621 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.879353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 11:59:32.879621 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.879400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7c5z8\"" Jul 15 11:59:32.879621 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:32.879454 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 11:59:33.036647 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:33.036601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:33.037147 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:33.036741 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 11:59:33.037147 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:33.036799 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:35.036783627 +0000 UTC m=+39.710218589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 11:59:33.084585 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:33.084554 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ce41496-fd6f-410f-8d9a-7d795391c6cb" containerID="bc60f97cc92ef2d5507778901bf0529bcc5906a0d2187ff028cb403a824ae980" exitCode=0 Jul 15 11:59:33.084778 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:33.084599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerDied","Data":"bc60f97cc92ef2d5507778901bf0529bcc5906a0d2187ff028cb403a824ae980"} Jul 15 11:59:34.089653 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:34.089618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" event={"ID":"5ce41496-fd6f-410f-8d9a-7d795391c6cb","Type":"ContainerStarted","Data":"01525830e540c79f54a64d8795b658d1a07c52c7930d8e18b04080399e87a47a"} Jul 15 11:59:34.117293 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:34.117240 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ncdvw" podStartSLOduration=8.821874888 podStartE2EDuration="39.117222278s" totalImagesPullingTime="30.29534739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:34.116529157 +0000 UTC m=+38.789964120" watchObservedRunningTime="2026-07-15 11:59:34.117222278 +0000 UTC m=+38.790657246" Jul 15 11:59:35.052923 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:35.052879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:35.053114 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:35.053009 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 11:59:35.053114 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:35.053088 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:39.053070359 +0000 UTC m=+43.726505304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 11:59:35.093596 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:35.093564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-md752" event={"ID":"5a3f9511-123a-47a7-8227-36c91e824fbc","Type":"ContainerStarted","Data":"60c7e7694aa66e6932b38f03ee983ef95404b17b655d5f4ae4743b5a68bf2acd"} Jul 15 11:59:39.083214 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:39.083003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:39.083611 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:39.083162 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 11:59:39.083611 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:39.083334 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:47.083317035 +0000 UTC m=+51.756751984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 11:59:47.138842 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:47.138805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 11:59:47.139321 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:47.138959 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 11:59:47.139321 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:47.139056 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:03.139002922 +0000 UTC m=+67.812437887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 11:59:50.754146 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.751868 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-md752" podStartSLOduration=17.301044645 podStartE2EDuration="19.751846188s" totalImagesPullingTime="2.450801543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:35.111017459 +0000 UTC m=+39.784452427" watchObservedRunningTime="2026-07-15 11:59:50.751846188 +0000 UTC m=+55.425281156" Jul 15 11:59:50.754146 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.752895 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c"] Jul 15 11:59:50.755664 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.755640 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.757456 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.757428 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-tshx5"] Jul 15 11:59:50.758907 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.758894 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 11:59:50.759003 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.758986 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.759439 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.759414 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 11:59:50.761581 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.761562 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 11:59:50.762001 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.761986 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ps6mw\"" Jul 15 11:59:50.762111 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.762001 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 11:59:50.762111 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.762001 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 11:59:50.769608 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.769591 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 11:59:50.769881 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.769862 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 11:59:50.770096 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.770082 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 11:59:50.770752 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.770735 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-r7795\"" Jul 15 11:59:50.775341 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.775323 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 11:59:50.782134 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.782114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c"] Jul 15 11:59:50.785397 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.785375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-tshx5"] Jul 15 11:59:50.846398 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.846368 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4"] Jul 15 11:59:50.848168 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.848149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" Jul 15 11:59:50.850112 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.850090 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d"] Jul 15 11:59:50.850866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.850843 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gfzkz\"" Jul 15 11:59:50.851882 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.851868 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:50.855434 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.855419 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 11:59:50.855745 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.855712 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 11:59:50.855745 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.855726 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 11:59:50.855983 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.855965 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 11:59:50.856084 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.856067 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-92l4l\"" Jul 15 11:59:50.862078 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc9f363-78b5-4d62-bcef-69abe703aa31-serving-cert\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.862158 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8h7l\" (UniqueName: \"kubernetes.io/projected/1cc9f363-78b5-4d62-bcef-69abe703aa31-kube-api-access-b8h7l\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.862158 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5st\" (UniqueName: \"kubernetes.io/projected/dca5e471-88a5-400a-bbd7-33206d77b0ac-kube-api-access-dz5st\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.862225 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862187 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dca5e471-88a5-400a-bbd7-33206d77b0ac-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.862258 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.862290 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc9f363-78b5-4d62-bcef-69abe703aa31-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.862330 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cc9f363-78b5-4d62-bcef-69abe703aa31-tmp\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.862330 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1cc9f363-78b5-4d62-bcef-69abe703aa31-snapshots\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.862389 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.862339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc9f363-78b5-4d62-bcef-69abe703aa31-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.866789 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.866771 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4"] Jul 15 11:59:50.867586 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.867567 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d"] Jul 15 11:59:50.963317 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8h7l\" (UniqueName: \"kubernetes.io/projected/1cc9f363-78b5-4d62-bcef-69abe703aa31-kube-api-access-b8h7l\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.963523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5st\" (UniqueName: \"kubernetes.io/projected/dca5e471-88a5-400a-bbd7-33206d77b0ac-kube-api-access-dz5st\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.963523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dca5e471-88a5-400a-bbd7-33206d77b0ac-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.963523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.963523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc9f363-78b5-4d62-bcef-69abe703aa31-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.963523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69846c5d-09ed-408c-911a-f74e504d1bbe-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:50.963523 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb54q\" (UniqueName: \"kubernetes.io/projected/69846c5d-09ed-408c-911a-f74e504d1bbe-kube-api-access-cb54q\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cc9f363-78b5-4d62-bcef-69abe703aa31-tmp\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1cc9f363-78b5-4d62-bcef-69abe703aa31-snapshots\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:50.963615 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69846c5d-09ed-408c-911a-f74e504d1bbe-config\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:50.963732 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls podName:dca5e471-88a5-400a-bbd7-33206d77b0ac nodeName:}" failed. No retries permitted until 2026-07-15 11:59:51.463714014 +0000 UTC m=+56.137148964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jtg9c" (UID: "dca5e471-88a5-400a-bbd7-33206d77b0ac") : secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc9f363-78b5-4d62-bcef-69abe703aa31-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc9f363-78b5-4d62-bcef-69abe703aa31-serving-cert\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.963866 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsnvl\" (UniqueName: \"kubernetes.io/projected/41441c70-d6f3-4956-b033-5a8f9010d74c-kube-api-access-nsnvl\") pod \"network-check-source-869dcfcdcd-cm6s4\" (UID: \"41441c70-d6f3-4956-b033-5a8f9010d74c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" Jul 15 11:59:50.964215 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.963942 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cc9f363-78b5-4d62-bcef-69abe703aa31-tmp\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.964215 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.964153 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc9f363-78b5-4d62-bcef-69abe703aa31-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.964215 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.964197 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dca5e471-88a5-400a-bbd7-33206d77b0ac-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:50.964315 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.964251 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1cc9f363-78b5-4d62-bcef-69abe703aa31-snapshots\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.964784 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.964764 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc9f363-78b5-4d62-bcef-69abe703aa31-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.967886 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.967864 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc9f363-78b5-4d62-bcef-69abe703aa31-serving-cert\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.974648 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.974625 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8h7l\" (UniqueName: \"kubernetes.io/projected/1cc9f363-78b5-4d62-bcef-69abe703aa31-kube-api-access-b8h7l\") pod \"insights-operator-68d9dd94cf-tshx5\" (UID: \"1cc9f363-78b5-4d62-bcef-69abe703aa31\") " pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:50.975496 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:50.975480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5st\" (UniqueName: \"kubernetes.io/projected/dca5e471-88a5-400a-bbd7-33206d77b0ac-kube-api-access-dz5st\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:51.064592 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.064560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69846c5d-09ed-408c-911a-f74e504d1bbe-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.064735 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.064599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb54q\" (UniqueName: \"kubernetes.io/projected/69846c5d-09ed-408c-911a-f74e504d1bbe-kube-api-access-cb54q\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.064735 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.064631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69846c5d-09ed-408c-911a-f74e504d1bbe-config\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.064735 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.064657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsnvl\" (UniqueName: \"kubernetes.io/projected/41441c70-d6f3-4956-b033-5a8f9010d74c-kube-api-access-nsnvl\") pod \"network-check-source-869dcfcdcd-cm6s4\" (UID: \"41441c70-d6f3-4956-b033-5a8f9010d74c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" Jul 15 11:59:51.065245 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.065224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69846c5d-09ed-408c-911a-f74e504d1bbe-config\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.066735 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.066715 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69846c5d-09ed-408c-911a-f74e504d1bbe-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.070770 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.070751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" Jul 15 11:59:51.073276 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.073256 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb54q\" (UniqueName: \"kubernetes.io/projected/69846c5d-09ed-408c-911a-f74e504d1bbe-kube-api-access-cb54q\") pod \"service-ca-operator-7695fc6c8c-7zt7d\" (UID: \"69846c5d-09ed-408c-911a-f74e504d1bbe\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.073501 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.073480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsnvl\" (UniqueName: \"kubernetes.io/projected/41441c70-d6f3-4956-b033-5a8f9010d74c-kube-api-access-nsnvl\") pod \"network-check-source-869dcfcdcd-cm6s4\" (UID: \"41441c70-d6f3-4956-b033-5a8f9010d74c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" Jul 15 11:59:51.158043 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.158001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" Jul 15 11:59:51.162564 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.162494 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" Jul 15 11:59:51.218501 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.218467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-tshx5"] Jul 15 11:59:51.290436 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.290400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4"] Jul 15 11:59:51.293338 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:51.293314 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41441c70_d6f3_4956_b033_5a8f9010d74c.slice/crio-096fac5f72b3465fba7d640878cb79b65ed27e08b9973f80eb5f38c8d74ca51c WatchSource:0}: Error finding container 096fac5f72b3465fba7d640878cb79b65ed27e08b9973f80eb5f38c8d74ca51c: Status 404 returned error can't find the container with id 096fac5f72b3465fba7d640878cb79b65ed27e08b9973f80eb5f38c8d74ca51c Jul 15 11:59:51.314172 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.314151 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d"] Jul 15 11:59:51.317150 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:51.317131 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69846c5d_09ed_408c_911a_f74e504d1bbe.slice/crio-747f12cd868f8f807d8ce0fae3077b8fbae9a9a3f9a1b80d711607b75e727a0a WatchSource:0}: Error finding container 747f12cd868f8f807d8ce0fae3077b8fbae9a9a3f9a1b80d711607b75e727a0a: Status 404 returned error can't find the container with id 747f12cd868f8f807d8ce0fae3077b8fbae9a9a3f9a1b80d711607b75e727a0a Jul 15 11:59:51.468310 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:51.468266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:51.468476 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:51.468443 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:51.468537 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:51.468526 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls podName:dca5e471-88a5-400a-bbd7-33206d77b0ac nodeName:}" failed. No retries permitted until 2026-07-15 11:59:52.468504353 +0000 UTC m=+57.141939298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jtg9c" (UID: "dca5e471-88a5-400a-bbd7-33206d77b0ac") : secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:52.136206 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:52.136162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" event={"ID":"41441c70-d6f3-4956-b033-5a8f9010d74c","Type":"ContainerStarted","Data":"096fac5f72b3465fba7d640878cb79b65ed27e08b9973f80eb5f38c8d74ca51c"} Jul 15 11:59:52.138025 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:52.137960 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" event={"ID":"1cc9f363-78b5-4d62-bcef-69abe703aa31","Type":"ContainerStarted","Data":"81acb49094aee5eabf33c04ca8f7d31a259c2fc8b3eb8203ca32c8b2ae49da80"} Jul 15 11:59:52.139657 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:52.139631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" event={"ID":"69846c5d-09ed-408c-911a-f74e504d1bbe","Type":"ContainerStarted","Data":"747f12cd868f8f807d8ce0fae3077b8fbae9a9a3f9a1b80d711607b75e727a0a"} Jul 15 11:59:52.477004 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:52.476897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:52.477199 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:52.477092 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:52.477199 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:52.477160 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls podName:dca5e471-88a5-400a-bbd7-33206d77b0ac nodeName:}" failed. No retries permitted until 2026-07-15 11:59:54.477141621 +0000 UTC m=+59.150576569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jtg9c" (UID: "dca5e471-88a5-400a-bbd7-33206d77b0ac") : secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:54.491736 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:54.491693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:54.492258 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:54.491868 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:54.492258 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:54.491937 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls podName:dca5e471-88a5-400a-bbd7-33206d77b0ac nodeName:}" failed. No retries permitted until 2026-07-15 11:59:58.491920437 +0000 UTC m=+63.165355387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jtg9c" (UID: "dca5e471-88a5-400a-bbd7-33206d77b0ac") : secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:55.587476 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.587443 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp"] Jul 15 11:59:55.589726 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.589703 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" Jul 15 11:59:55.592351 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.592326 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6w592\"" Jul 15 11:59:55.593370 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.593353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 11:59:55.593499 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.593355 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 11:59:55.602385 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.602312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grfnq\" (UniqueName: \"kubernetes.io/projected/e9356eb7-6782-44bc-a77f-49c4a962b2fd-kube-api-access-grfnq\") pod \"migrator-7f59b54f6c-hkbpp\" (UID: \"e9356eb7-6782-44bc-a77f-49c4a962b2fd\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" Jul 15 11:59:55.603826 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.603803 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp"] Jul 15 11:59:55.703682 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.703601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grfnq\" (UniqueName: \"kubernetes.io/projected/e9356eb7-6782-44bc-a77f-49c4a962b2fd-kube-api-access-grfnq\") pod \"migrator-7f59b54f6c-hkbpp\" (UID: \"e9356eb7-6782-44bc-a77f-49c4a962b2fd\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" Jul 15 11:59:55.712256 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.712224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grfnq\" (UniqueName: \"kubernetes.io/projected/e9356eb7-6782-44bc-a77f-49c4a962b2fd-kube-api-access-grfnq\") pod \"migrator-7f59b54f6c-hkbpp\" (UID: \"e9356eb7-6782-44bc-a77f-49c4a962b2fd\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" Jul 15 11:59:55.900986 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.900956 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6w592\"" Jul 15 11:59:55.908512 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:55.908483 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" Jul 15 11:59:56.042689 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.042657 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp"] Jul 15 11:59:56.045950 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:56.045919 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9356eb7_6782_44bc_a77f_49c4a962b2fd.slice/crio-cfdcda5ae0d5c5a2ebca385d1a7f64c2bd2fba1134ae8f0ab0cd7f0a170a47da WatchSource:0}: Error finding container cfdcda5ae0d5c5a2ebca385d1a7f64c2bd2fba1134ae8f0ab0cd7f0a170a47da: Status 404 returned error can't find the container with id cfdcda5ae0d5c5a2ebca385d1a7f64c2bd2fba1134ae8f0ab0cd7f0a170a47da Jul 15 11:59:56.068095 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.068060 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvb46" Jul 15 11:59:56.152310 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.152262 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" event={"ID":"69846c5d-09ed-408c-911a-f74e504d1bbe","Type":"ContainerStarted","Data":"2277d1eb87cc5f6de41c3fb82b9df3cce5c7779c931eb0051d0ce461a987ae98"} Jul 15 11:59:56.153660 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.153634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" event={"ID":"e9356eb7-6782-44bc-a77f-49c4a962b2fd","Type":"ContainerStarted","Data":"cfdcda5ae0d5c5a2ebca385d1a7f64c2bd2fba1134ae8f0ab0cd7f0a170a47da"} Jul 15 11:59:56.155404 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.155338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" event={"ID":"41441c70-d6f3-4956-b033-5a8f9010d74c","Type":"ContainerStarted","Data":"ed9f39f05b469ddd9429ffb9ac4e2cfa0db1d6f86e9aaf31deeaec1b0c01b24d"} Jul 15 11:59:56.156977 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.156953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" event={"ID":"1cc9f363-78b5-4d62-bcef-69abe703aa31","Type":"ContainerStarted","Data":"ced059c2d096bb691b1af03d7e64a944a5ceae6f19e145b48cfab27dd03ba752"} Jul 15 11:59:56.170774 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.170720 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" podStartSLOduration=2.171986769 podStartE2EDuration="6.170704652s" totalImagesPullingTime="3.998717883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:56.170050632 +0000 UTC m=+60.843485598" watchObservedRunningTime="2026-07-15 11:59:56.170704652 +0000 UTC m=+60.844139598" Jul 15 11:59:56.189666 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.189608 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" podStartSLOduration=2.099872188 podStartE2EDuration="6.189586419s" totalImagesPullingTime="4.089714231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:56.188241263 +0000 UTC m=+60.861676234" watchObservedRunningTime="2026-07-15 11:59:56.189586419 +0000 UTC m=+60.863021387" Jul 15 11:59:56.207110 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:56.207017 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cm6s4" podStartSLOduration=2.17459183 podStartE2EDuration="6.206996899s" totalImagesPullingTime="4.032405069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:56.20679127 +0000 UTC m=+60.880226259" watchObservedRunningTime="2026-07-15 11:59:56.206996899 +0000 UTC m=+60.880431867" Jul 15 11:59:57.418951 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.418878 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tfghd"] Jul 15 11:59:57.421052 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.421016 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.423554 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.423534 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 11:59:57.423672 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.423612 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 11:59:57.424079 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.424060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7kwbt\"" Jul 15 11:59:57.434123 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.434103 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tfghd"] Jul 15 11:59:57.525106 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.525074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.525285 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.525129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6d895c7-2502-4d0c-befa-ab46124f3ab6-crio-socket\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.525285 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.525184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6d895c7-2502-4d0c-befa-ab46124f3ab6-data-volume\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.525285 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.525219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55j8\" (UniqueName: \"kubernetes.io/projected/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-api-access-b55j8\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.525401 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.525299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626302 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626475 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6d895c7-2502-4d0c-befa-ab46124f3ab6-crio-socket\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626475 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626384 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6d895c7-2502-4d0c-befa-ab46124f3ab6-crio-socket\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626475 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:57.626388 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 11:59:57.626475 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6d895c7-2502-4d0c-befa-ab46124f3ab6-data-volume\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626475 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55j8\" (UniqueName: \"kubernetes.io/projected/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-api-access-b55j8\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626475 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:57.626455 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:58.126440538 +0000 UTC m=+62.799875515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : configmap "kube-rbac-proxy" not found Jul 15 11:59:57.626707 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.626707 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:57.626661 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 11:59:57.626782 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:57.626725 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:58.126708993 +0000 UTC m=+62.800143940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : secret "insights-runtime-extractor-tls" not found Jul 15 11:59:57.626867 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.626787 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6d895c7-2502-4d0c-befa-ab46124f3ab6-data-volume\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:57.641129 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:57.641101 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55j8\" (UniqueName: \"kubernetes.io/projected/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-api-access-b55j8\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:58.130512 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.130474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:58.130692 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:58.130616 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 11:59:58.130692 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.130648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:58.130692 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:58.130676 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:59.130660878 +0000 UTC m=+63.804095823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : configmap "kube-rbac-proxy" not found Jul 15 11:59:58.130803 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:58.130736 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 11:59:58.130803 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:58.130779 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 11:59:59.130768412 +0000 UTC m=+63.804203357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : secret "insights-runtime-extractor-tls" not found Jul 15 11:59:58.165311 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.165276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" event={"ID":"e9356eb7-6782-44bc-a77f-49c4a962b2fd","Type":"ContainerStarted","Data":"b204e6fd30d851af5496cfd55dfb3a66a5766d558cdcda974542ceff17449e37"} Jul 15 11:59:58.165464 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.165332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" event={"ID":"e9356eb7-6782-44bc-a77f-49c4a962b2fd","Type":"ContainerStarted","Data":"eeb95bf6768e786b96993129a93d0c03b1c24c310a2b855d496e689f4da0e715"} Jul 15 11:59:58.182517 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.182466 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkbpp" podStartSLOduration=2.105112112 podStartE2EDuration="3.182450385s" totalImagesPullingTime="1.077338273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:59:58.181950399 +0000 UTC m=+62.855385380" watchObservedRunningTime="2026-07-15 11:59:58.182450385 +0000 UTC m=+62.855885331" Jul 15 11:59:58.344370 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.344331 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh"] Jul 15 11:59:58.346706 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.346686 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8"] Jul 15 11:59:58.346841 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.346825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.348420 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.348404 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.349989 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.349967 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 11:59:58.350093 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.350058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 11:59:58.350143 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.350095 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 11:59:58.351105 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.351084 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 11:59:58.351199 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.351086 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 11:59:58.351257 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.351086 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 11:59:58.351312 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.351092 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 11:59:58.352443 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.352416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 11:59:58.362677 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.359699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8"] Jul 15 11:59:58.364029 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.364004 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh"] Jul 15 11:59:58.433202 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-hub\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.433202 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.433202 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-ca\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.433202 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3aa734f4-e8e5-457b-b910-fc4bb80d5724-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.433669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9kbh\" (UniqueName: \"kubernetes.io/projected/3aa734f4-e8e5-457b-b910-fc4bb80d5724-kube-api-access-f9kbh\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.433669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.433669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lfnd\" (UniqueName: \"kubernetes.io/projected/97e8c05f-6ecd-4096-a909-6b35a8f083a8-kube-api-access-5lfnd\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.433669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa734f4-e8e5-457b-b910-fc4bb80d5724-tmp\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.433669 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.433481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e8c05f-6ecd-4096-a909-6b35a8f083a8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-hub\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534468 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534648 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-ca\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534648 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3aa734f4-e8e5-457b-b910-fc4bb80d5724-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.534648 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9kbh\" (UniqueName: \"kubernetes.io/projected/3aa734f4-e8e5-457b-b910-fc4bb80d5724-kube-api-access-f9kbh\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.534648 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 11:59:58.534904 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534904 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lfnd\" (UniqueName: \"kubernetes.io/projected/97e8c05f-6ecd-4096-a909-6b35a8f083a8-kube-api-access-5lfnd\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534904 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa734f4-e8e5-457b-b910-fc4bb80d5724-tmp\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.534904 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.534804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e8c05f-6ecd-4096-a909-6b35a8f083a8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.534904 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:58.534804 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:58.535180 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:58.534920 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls podName:dca5e471-88a5-400a-bbd7-33206d77b0ac nodeName:}" failed. No retries permitted until 2026-07-15 12:00:06.53490014 +0000 UTC m=+71.208335086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jtg9c" (UID: "dca5e471-88a5-400a-bbd7-33206d77b0ac") : secret "cluster-monitoring-operator-tls" not found Jul 15 11:59:58.535642 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.535612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa734f4-e8e5-457b-b910-fc4bb80d5724-tmp\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.535815 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.535783 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e8c05f-6ecd-4096-a909-6b35a8f083a8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.537294 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.537264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-hub\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.537431 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.537407 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-ca\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.537536 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.537517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3aa734f4-e8e5-457b-b910-fc4bb80d5724-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.537599 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.537540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.537656 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.537618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97e8c05f-6ecd-4096-a909-6b35a8f083a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.543580 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.543559 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9kbh\" (UniqueName: \"kubernetes.io/projected/3aa734f4-e8e5-457b-b910-fc4bb80d5724-kube-api-access-f9kbh\") pod \"klusterlet-addon-workmgr-b8454b44b-7w5s8\" (UID: \"3aa734f4-e8e5-457b-b910-fc4bb80d5724\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.543772 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.543753 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lfnd\" (UniqueName: \"kubernetes.io/projected/97e8c05f-6ecd-4096-a909-6b35a8f083a8-kube-api-access-5lfnd\") pod \"cluster-proxy-proxy-agent-6697f5c4b8-pqfbh\" (UID: \"97e8c05f-6ecd-4096-a909-6b35a8f083a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.667686 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.667653 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 11:59:58.674110 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.674086 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 11:59:58.804507 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.804462 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh"] Jul 15 11:59:58.806634 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:58.806602 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e8c05f_6ecd_4096_a909_6b35a8f083a8.slice/crio-ca38f32e62b6c7b5f6012d72198fc3b2043adf40d9d621507e6ed595a73d6ff3 WatchSource:0}: Error finding container ca38f32e62b6c7b5f6012d72198fc3b2043adf40d9d621507e6ed595a73d6ff3: Status 404 returned error can't find the container with id ca38f32e62b6c7b5f6012d72198fc3b2043adf40d9d621507e6ed595a73d6ff3 Jul 15 11:59:58.816604 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:58.816582 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8"] Jul 15 11:59:58.821468 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:58.821440 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa734f4_e8e5_457b_b910_fc4bb80d5724.slice/crio-9a1405f57e408d274952329586cf145f24346c3311445f406478d94f5d71d6ed WatchSource:0}: Error finding container 9a1405f57e408d274952329586cf145f24346c3311445f406478d94f5d71d6ed: Status 404 returned error can't find the container with id 9a1405f57e408d274952329586cf145f24346c3311445f406478d94f5d71d6ed Jul 15 11:59:59.140695 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.140651 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:59.140912 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.140715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 11:59:59.140912 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:59.140807 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 11:59:59.140912 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:59.140836 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 11:59:59.140912 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:59.140861 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:01.140846703 +0000 UTC m=+65.814281648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : configmap "kube-rbac-proxy" not found Jul 15 11:59:59.140912 ip-10-0-139-5 kubenswrapper[2559]: E0715 11:59:59.140914 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:01.140895882 +0000 UTC m=+65.814330845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : secret "insights-runtime-extractor-tls" not found Jul 15 11:59:59.170588 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.170553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" event={"ID":"3aa734f4-e8e5-457b-b910-fc4bb80d5724","Type":"ContainerStarted","Data":"9a1405f57e408d274952329586cf145f24346c3311445f406478d94f5d71d6ed"} Jul 15 11:59:59.171643 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.171613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" event={"ID":"97e8c05f-6ecd-4096-a909-6b35a8f083a8","Type":"ContainerStarted","Data":"ca38f32e62b6c7b5f6012d72198fc3b2043adf40d9d621507e6ed595a73d6ff3"} Jul 15 11:59:59.356224 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.356189 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jxfpw"] Jul 15 11:59:59.358773 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.358753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.361441 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.361419 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 11:59:59.361441 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.361433 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 11:59:59.361611 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.361521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-z8j46\"" Jul 15 11:59:59.361611 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.361570 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 11:59:59.362370 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.362350 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 11:59:59.369923 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.369905 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jxfpw"] Jul 15 11:59:59.443264 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.443180 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkkgh\" (UniqueName: \"kubernetes.io/projected/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-kube-api-access-dkkgh\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.443264 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.443245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-signing-key\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.443660 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.443342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-signing-cabundle\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.543867 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.543830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-signing-cabundle\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.544021 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.543902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkkgh\" (UniqueName: \"kubernetes.io/projected/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-kube-api-access-dkkgh\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.544021 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.543944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-signing-key\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.544590 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.544551 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-signing-cabundle\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.546317 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.546298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-signing-key\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.552686 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.552662 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkkgh\" (UniqueName: \"kubernetes.io/projected/c8cd35c7-8027-4ce0-a3f4-74ade6f87d40-kube-api-access-dkkgh\") pod \"service-ca-79f68b9f4f-jxfpw\" (UID: \"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.667936 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.667897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" Jul 15 11:59:59.842880 ip-10-0-139-5 kubenswrapper[2559]: I0715 11:59:59.842847 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jxfpw"] Jul 15 11:59:59.851421 ip-10-0-139-5 kubenswrapper[2559]: W0715 11:59:59.851386 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cd35c7_8027_4ce0_a3f4_74ade6f87d40.slice/crio-57e3eace4eb8c75ece61a10a7ddd41ae7626e28d6c72f28ab3e99a5383b0ade7 WatchSource:0}: Error finding container 57e3eace4eb8c75ece61a10a7ddd41ae7626e28d6c72f28ab3e99a5383b0ade7: Status 404 returned error can't find the container with id 57e3eace4eb8c75ece61a10a7ddd41ae7626e28d6c72f28ab3e99a5383b0ade7 Jul 15 12:00:00.186068 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.185256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" event={"ID":"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40","Type":"ContainerStarted","Data":"0f598ad70a07b5f906eb61042478a569451756bcf59a319fa8d6f303345b8e12"} Jul 15 12:00:00.186068 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.185321 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" event={"ID":"c8cd35c7-8027-4ce0-a3f4-74ade6f87d40","Type":"ContainerStarted","Data":"57e3eace4eb8c75ece61a10a7ddd41ae7626e28d6c72f28ab3e99a5383b0ade7"} Jul 15 12:00:00.401840 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.401774 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z62h2_613fec8e-7c9c-4503-88a9-5280c9eedb91/dns-node-resolver/0.log" Jul 15 12:00:00.665282 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.664760 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 12:00:00.665282 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.664817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 12:00:00.668069 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.667963 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 12:00:00.668636 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.668388 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 12:00:00.675504 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:00.675477 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 12:00:00.675673 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:00.675559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs podName:707c6293-fcb2-45dd-8b6e-6e30b111807a nodeName:}" failed. No retries permitted until 2026-07-15 12:01:04.675536768 +0000 UTC m=+129.348971718 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs") pod "network-metrics-daemon-vx6r2" (UID: "707c6293-fcb2-45dd-8b6e-6e30b111807a") : secret "metrics-daemon-secret" not found Jul 15 12:00:00.680208 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.680183 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c54d391c-9d7c-478f-80cb-7c86953b3bc9-original-pull-secret\") pod \"global-pull-secret-syncer-8ww5q\" (UID: \"c54d391c-9d7c-478f-80cb-7c86953b3bc9\") " pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 12:00:00.766790 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.766209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 12:00:00.772794 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.772735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7npk\" (UniqueName: \"kubernetes.io/projected/30e8efbb-591c-4428-a449-0ad905171543-kube-api-access-f7npk\") pod \"network-check-target-cnvtc\" (UID: \"30e8efbb-591c-4428-a449-0ad905171543\") " pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 12:00:00.801198 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.801157 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v7g7_086725e8-d715-4862-8203-b5908c21de18/node-ca/0.log" Jul 15 12:00:00.801467 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.801446 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7c5z8\"" Jul 15 12:00:00.803689 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.803661 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ww5q" Jul 15 12:00:00.809120 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:00.809097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 12:00:01.024525 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:01.024391 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-jxfpw" podStartSLOduration=2.024367096 podStartE2EDuration="2.024367096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:00.206991589 +0000 UTC m=+64.880426557" watchObservedRunningTime="2026-07-15 12:00:01.024367096 +0000 UTC m=+65.697802064" Jul 15 12:00:01.027160 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:01.026637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8ww5q"] Jul 15 12:00:01.044649 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:01.044592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cnvtc"] Jul 15 12:00:01.171816 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:01.171467 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:01.171816 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:01.171536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:01.171816 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:01.171638 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:00:01.171816 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:01.171654 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:00:01.172192 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:01.171860 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:05.171683758 +0000 UTC m=+69.845118710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : configmap "kube-rbac-proxy" not found Jul 15 12:00:01.172192 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:01.171897 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:05.171878633 +0000 UTC m=+69.845313593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : secret "insights-runtime-extractor-tls" not found Jul 15 12:00:02.007725 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:02.007625 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-md752_5a3f9511-123a-47a7-8227-36c91e824fbc/serve-healthcheck-canary/0.log" Jul 15 12:00:02.207000 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:02.206954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkbpp_e9356eb7-6782-44bc-a77f-49c4a962b2fd/migrator/0.log" Jul 15 12:00:02.404054 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:02.403418 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkbpp_e9356eb7-6782-44bc-a77f-49c4a962b2fd/graceful-termination/0.log" Jul 15 12:00:03.193568 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:03.193529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 12:00:03.194078 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:03.193715 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:00:03.194078 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:03.193786 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls podName:36f480ce-7808-4f4c-9f44-066b97a5e083 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:35.193770098 +0000 UTC m=+99.867205043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls") pod "dns-default-mz2s5" (UID: "36f480ce-7808-4f4c-9f44-066b97a5e083") : secret "dns-default-metrics-tls" not found Jul 15 12:00:03.203165 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:03.203127 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cnvtc" event={"ID":"30e8efbb-591c-4428-a449-0ad905171543","Type":"ContainerStarted","Data":"f8607ab9c4316fc36b7094d061e08e499d7fd13581f536d43d823fd28a0bd9e9"} Jul 15 12:00:03.203331 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:03.203192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cnvtc" event={"ID":"30e8efbb-591c-4428-a449-0ad905171543","Type":"ContainerStarted","Data":"b831ba2e2ca8ac81946407a14dde7954b2a5cd850e94db141fdfc69ea296c16d"} Jul 15 12:00:03.203331 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:03.203255 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 12:00:03.204784 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:03.204759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8ww5q" event={"ID":"c54d391c-9d7c-478f-80cb-7c86953b3bc9","Type":"ContainerStarted","Data":"91f419c8298be6d9daaae4a37b0878313a6cd80fdc72aba87a51a0890c56215f"} Jul 15 12:00:03.220755 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:03.220684 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cnvtc" podStartSLOduration=67.220664211 podStartE2EDuration="1m7.220664211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:03.219686055 +0000 UTC m=+67.893121024" watchObservedRunningTime="2026-07-15 12:00:03.220664211 +0000 UTC m=+67.894099178" Jul 15 12:00:05.213099 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.212986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:05.213099 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.213070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:05.213614 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:05.213162 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:00:05.213614 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:05.213226 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:00:05.213614 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:05.213242 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:13.213218321 +0000 UTC m=+77.886653280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : secret "insights-runtime-extractor-tls" not found Jul 15 12:00:05.213614 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:05.213277 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm podName:d6d895c7-2502-4d0c-befa-ab46124f3ab6 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:13.213263799 +0000 UTC m=+77.886698744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tfghd" (UID: "d6d895c7-2502-4d0c-befa-ab46124f3ab6") : configmap "kube-rbac-proxy" not found Jul 15 12:00:05.214368 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.214330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" event={"ID":"3aa734f4-e8e5-457b-b910-fc4bb80d5724","Type":"ContainerStarted","Data":"6cad418156208c0b6348358262411c63bcc1e7f4fde23194c42894e41decafc4"} Jul 15 12:00:05.214679 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.214497 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 12:00:05.216427 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.216408 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" Jul 15 12:00:05.216758 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.216727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" event={"ID":"97e8c05f-6ecd-4096-a909-6b35a8f083a8","Type":"ContainerStarted","Data":"0850c52a254217c00c83b5705ed37338a161b1fa02bd284669c9f1f3c078d2cb"} Jul 15 12:00:05.216823 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.216758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" event={"ID":"97e8c05f-6ecd-4096-a909-6b35a8f083a8","Type":"ContainerStarted","Data":"c6dc62ecb6085b4baf9977b8cfbd50e311640043ce74fd46299e77a88d51a9d7"} Jul 15 12:00:05.216823 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.216777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" event={"ID":"97e8c05f-6ecd-4096-a909-6b35a8f083a8","Type":"ContainerStarted","Data":"bb6a37a20ed0ecded3937807d3cae376ee335c0f675f39567dfa52eb9ed68c8f"} Jul 15 12:00:05.236798 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.236730 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8454b44b-7w5s8" podStartSLOduration=1.1053078219999999 podStartE2EDuration="7.236702585s" totalImagesPullingTime="6.131394763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:05.236257704 +0000 UTC m=+69.909692670" watchObservedRunningTime="2026-07-15 12:00:05.236702585 +0000 UTC m=+69.910137553" Jul 15 12:00:05.261551 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:05.261496 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" podStartSLOduration=1.116418685 podStartE2EDuration="7.261461986s" totalImagesPullingTime="6.145043301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:05.259461799 +0000 UTC m=+69.932896765" watchObservedRunningTime="2026-07-15 12:00:05.261461986 +0000 UTC m=+69.934896953" Jul 15 12:00:06.626744 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:06.626695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 12:00:06.627182 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:06.626881 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:00:06.627182 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:06.626968 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls podName:dca5e471-88a5-400a-bbd7-33206d77b0ac nodeName:}" failed. No retries permitted until 2026-07-15 12:00:22.626945775 +0000 UTC m=+87.300380724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jtg9c" (UID: "dca5e471-88a5-400a-bbd7-33206d77b0ac") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:00:08.671566 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:08.671499 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" podUID="97e8c05f-6ecd-4096-a909-6b35a8f083a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 12:00:09.232541 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:09.232503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8ww5q" event={"ID":"c54d391c-9d7c-478f-80cb-7c86953b3bc9","Type":"ContainerStarted","Data":"9ecd0ab327a539eaec997c72210ab6eb0c3a797308e244bc69529ef1e5693a17"} Jul 15 12:00:09.249569 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:09.249512 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8ww5q" podStartSLOduration=66.736712201 podStartE2EDuration="1m13.249493379s" totalImagesPullingTime="6.512781178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:09.248598959 +0000 UTC m=+73.922033927" watchObservedRunningTime="2026-07-15 12:00:09.249493379 +0000 UTC m=+73.922928349" Jul 15 12:00:13.291604 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:13.291566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:13.292074 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:13.291684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:13.292228 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:13.292208 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d895c7-2502-4d0c-befa-ab46124f3ab6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:13.294051 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:13.294005 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d895c7-2502-4d0c-befa-ab46124f3ab6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfghd\" (UID: \"d6d895c7-2502-4d0c-befa-ab46124f3ab6\") " pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:13.330188 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:13.330149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tfghd" Jul 15 12:00:13.456250 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:13.456214 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tfghd"] Jul 15 12:00:13.458947 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:00:13.458914 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d895c7_2502_4d0c_befa_ab46124f3ab6.slice/crio-982b99a4476a6276a3446945196507fba92a880bda556c4d0024bb80931bd7d8 WatchSource:0}: Error finding container 982b99a4476a6276a3446945196507fba92a880bda556c4d0024bb80931bd7d8: Status 404 returned error can't find the container with id 982b99a4476a6276a3446945196507fba92a880bda556c4d0024bb80931bd7d8 Jul 15 12:00:14.251827 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:14.251752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfghd" event={"ID":"d6d895c7-2502-4d0c-befa-ab46124f3ab6","Type":"ContainerStarted","Data":"982b99a4476a6276a3446945196507fba92a880bda556c4d0024bb80931bd7d8"} Jul 15 12:00:18.669467 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:18.669423 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" podUID="97e8c05f-6ecd-4096-a909-6b35a8f083a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 12:00:19.272604 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:19.272569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfghd" event={"ID":"d6d895c7-2502-4d0c-befa-ab46124f3ab6","Type":"ContainerStarted","Data":"78b6d3c0add7605c7bfe8e75203b967cc6748dcb58d0645e723d3f4e1bf3d065"} Jul 15 12:00:21.637102 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.637058 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-647b7685c4-l7n2p"] Jul 15 12:00:21.663548 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.663517 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647b7685c4-l7n2p"] Jul 15 12:00:21.663699 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.663628 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.666418 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.666389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vl9cw\"" Jul 15 12:00:21.666577 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.666392 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 12:00:21.667308 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.667281 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 12:00:21.667435 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.667389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 12:00:21.671258 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.671235 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 12:00:21.769691 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-ca-trust-extracted\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.769901 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-image-registry-private-configuration\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.769901 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-trusted-ca\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.769901 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-registry-tls\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.769901 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769861 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-bound-sa-token\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.770078 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-registry-certificates\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.770078 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.769951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-installation-pull-secrets\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.770078 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.770070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4jgj\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-kube-api-access-v4jgj\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871122 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-installation-pull-secrets\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871445 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4jgj\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-kube-api-access-v4jgj\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871579 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-ca-trust-extracted\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871579 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-image-registry-private-configuration\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871579 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-trusted-ca\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871737 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-registry-tls\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871737 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-bound-sa-token\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871737 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-registry-certificates\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.871884 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.871870 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-ca-trust-extracted\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.872677 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.872628 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-registry-certificates\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.872677 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.872654 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-trusted-ca\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.874194 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.874170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-installation-pull-secrets\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.874473 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.874449 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-image-registry-private-configuration\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.874712 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.874690 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-registry-tls\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.883193 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.883165 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-bound-sa-token\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.883430 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.883406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4jgj\" (UniqueName: \"kubernetes.io/projected/adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f-kube-api-access-v4jgj\") pod \"image-registry-647b7685c4-l7n2p\" (UID: \"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f\") " pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:21.973178 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:21.973096 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:22.535130 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:22.535095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647b7685c4-l7n2p"] Jul 15 12:00:22.537757 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:00:22.537725 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf4a0d9_e06c_4b04_b6a0_ef2ea98ac73f.slice/crio-9ae2e744742f2265e3de01dee94fecf3a29806842092ab027bb29d8834f757c5 WatchSource:0}: Error finding container 9ae2e744742f2265e3de01dee94fecf3a29806842092ab027bb29d8834f757c5: Status 404 returned error can't find the container with id 9ae2e744742f2265e3de01dee94fecf3a29806842092ab027bb29d8834f757c5 Jul 15 12:00:22.678402 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:22.678315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 12:00:22.680641 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:22.680621 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5e471-88a5-400a-bbd7-33206d77b0ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jtg9c\" (UID: \"dca5e471-88a5-400a-bbd7-33206d77b0ac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 12:00:22.869313 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:22.869284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ps6mw\"" Jul 15 12:00:22.877016 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:22.876990 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" Jul 15 12:00:23.009127 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:23.009092 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c"] Jul 15 12:00:23.012650 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:00:23.012612 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca5e471_88a5_400a_bbd7_33206d77b0ac.slice/crio-9b3a0451c661e0b91a48cd7192c97906409f848b293d21a6b790b09de3ee0bdb WatchSource:0}: Error finding container 9b3a0451c661e0b91a48cd7192c97906409f848b293d21a6b790b09de3ee0bdb: Status 404 returned error can't find the container with id 9b3a0451c661e0b91a48cd7192c97906409f848b293d21a6b790b09de3ee0bdb Jul 15 12:00:23.290298 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:23.290260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfghd" event={"ID":"d6d895c7-2502-4d0c-befa-ab46124f3ab6","Type":"ContainerStarted","Data":"7ba7589555d1ba9c11d6b6c995513ba1d94587bfc9b8a752cfd1b4ea39082fb7"} Jul 15 12:00:23.291569 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:23.291541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" event={"ID":"dca5e471-88a5-400a-bbd7-33206d77b0ac","Type":"ContainerStarted","Data":"9b3a0451c661e0b91a48cd7192c97906409f848b293d21a6b790b09de3ee0bdb"} Jul 15 12:00:23.293171 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:23.293144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" event={"ID":"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f","Type":"ContainerStarted","Data":"dae89deebbc33202aa1ab7212d787edeb5aa63c6686d0c9eecd0cfafeccde966"} Jul 15 12:00:23.293271 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:23.293192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" event={"ID":"adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f","Type":"ContainerStarted","Data":"9ae2e744742f2265e3de01dee94fecf3a29806842092ab027bb29d8834f757c5"} Jul 15 12:00:23.293271 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:23.293251 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:27.309929 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:27.309892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfghd" event={"ID":"d6d895c7-2502-4d0c-befa-ab46124f3ab6","Type":"ContainerStarted","Data":"dca80260878c3f1823d9e4f30fcba4d2b8ddb03b7f91c915db92021f2b394b39"} Jul 15 12:00:27.311907 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:27.311879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" event={"ID":"dca5e471-88a5-400a-bbd7-33206d77b0ac","Type":"ContainerStarted","Data":"51b6d16a83ee7a965164d4ed3d48f3407a6b4595d4cb34824dbf1a53871ab4e0"} Jul 15 12:00:27.330961 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:27.330905 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tfghd" podStartSLOduration=17.240007584 podStartE2EDuration="30.330888587s" totalImagesPullingTime="13.090881003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:59:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:27.330745936 +0000 UTC m=+92.004180931" watchObservedRunningTime="2026-07-15 12:00:27.330888587 +0000 UTC m=+92.004323555" Jul 15 12:00:27.331459 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:27.331418 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" podStartSLOduration=6.331407811 podStartE2EDuration="6.331407811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:23.316454298 +0000 UTC m=+87.989889289" watchObservedRunningTime="2026-07-15 12:00:27.331407811 +0000 UTC m=+92.004842755" Jul 15 12:00:27.362075 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:27.361997 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jtg9c" podStartSLOduration=33.697551605 podStartE2EDuration="37.361980928s" totalImagesPullingTime="3.664429323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:27.361724239 +0000 UTC m=+92.035159209" watchObservedRunningTime="2026-07-15 12:00:27.361980928 +0000 UTC m=+92.035415896" Jul 15 12:00:28.669122 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:28.669081 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" podUID="97e8c05f-6ecd-4096-a909-6b35a8f083a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 12:00:28.669560 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:28.669153 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" Jul 15 12:00:28.669648 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:28.669607 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0850c52a254217c00c83b5705ed37338a161b1fa02bd284669c9f1f3c078d2cb"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 15 12:00:28.669686 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:28.669670 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" podUID="97e8c05f-6ecd-4096-a909-6b35a8f083a8" containerName="service-proxy" containerID="cri-o://0850c52a254217c00c83b5705ed37338a161b1fa02bd284669c9f1f3c078d2cb" gracePeriod=30 Jul 15 12:00:29.321627 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:29.321596 2559 generic.go:356] "Generic (PLEG): container finished" podID="97e8c05f-6ecd-4096-a909-6b35a8f083a8" containerID="0850c52a254217c00c83b5705ed37338a161b1fa02bd284669c9f1f3c078d2cb" exitCode=2 Jul 15 12:00:29.321792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:29.321654 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" event={"ID":"97e8c05f-6ecd-4096-a909-6b35a8f083a8","Type":"ContainerDied","Data":"0850c52a254217c00c83b5705ed37338a161b1fa02bd284669c9f1f3c078d2cb"} Jul 15 12:00:29.321792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:29.321689 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6697f5c4b8-pqfbh" event={"ID":"97e8c05f-6ecd-4096-a909-6b35a8f083a8","Type":"ContainerStarted","Data":"418d2290c281cdef08d33d15e3a80a1c2d2911e6c919bb8cd40a6d4fa6dfd112"} Jul 15 12:00:34.212212 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:34.212177 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cnvtc" Jul 15 12:00:35.281468 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:35.281417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 12:00:35.283691 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:35.283668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f480ce-7808-4f4c-9f44-066b97a5e083-metrics-tls\") pod \"dns-default-mz2s5\" (UID: \"36f480ce-7808-4f4c-9f44-066b97a5e083\") " pod="openshift-dns/dns-default-mz2s5" Jul 15 12:00:35.475984 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:35.475955 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqsqx\"" Jul 15 12:00:35.484260 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:35.484217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mz2s5" Jul 15 12:00:35.611958 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:35.611933 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mz2s5"] Jul 15 12:00:35.614622 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:00:35.614597 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f480ce_7808_4f4c_9f44_066b97a5e083.slice/crio-ea8713f6b8fd04c80574cc96f917daffa86348649038ece352c1a79ca1c4ee14 WatchSource:0}: Error finding container ea8713f6b8fd04c80574cc96f917daffa86348649038ece352c1a79ca1c4ee14: Status 404 returned error can't find the container with id ea8713f6b8fd04c80574cc96f917daffa86348649038ece352c1a79ca1c4ee14 Jul 15 12:00:36.349465 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:36.349431 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz2s5" event={"ID":"36f480ce-7808-4f4c-9f44-066b97a5e083","Type":"ContainerStarted","Data":"ea8713f6b8fd04c80574cc96f917daffa86348649038ece352c1a79ca1c4ee14"} Jul 15 12:00:37.669058 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.668519 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pd6mg"] Jul 15 12:00:37.683055 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.682998 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.686409 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.686086 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 12:00:37.686409 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.686095 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-262w7\"" Jul 15 12:00:37.686409 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.686259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 12:00:37.686409 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.686327 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 12:00:37.688339 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.687221 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 12:00:37.801108 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-sys\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801319 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-textfile\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801319 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-wtmp\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801319 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrtwb\" (UniqueName: \"kubernetes.io/projected/50730f27-3c82-4ac6-84b0-b02a3405bb50-kube-api-access-xrtwb\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801319 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-accelerators-collector-config\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801539 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801539 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-root\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801539 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801423 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50730f27-3c82-4ac6-84b0-b02a3405bb50-metrics-client-ca\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.801539 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.801459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-tls\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.902931 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.902872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-tls\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.903156 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:37.903051 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 12:00:37.903377 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:00:37.903314 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-tls podName:50730f27-3c82-4ac6-84b0-b02a3405bb50 nodeName:}" failed. No retries permitted until 2026-07-15 12:00:38.403267757 +0000 UTC m=+103.076702720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-tls") pod "node-exporter-pd6mg" (UID: "50730f27-3c82-4ac6-84b0-b02a3405bb50") : secret "node-exporter-tls" not found Jul 15 12:00:37.903694 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.903506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-sys\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.903694 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.903660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-textfile\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.903891 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.903584 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-sys\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904249 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904222 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-textfile\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904249 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904030 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-wtmp\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904249 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904223 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-wtmp\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904515 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrtwb\" (UniqueName: \"kubernetes.io/projected/50730f27-3c82-4ac6-84b0-b02a3405bb50-kube-api-access-xrtwb\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904515 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-accelerators-collector-config\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904515 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904351 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904515 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-root\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.904515 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.904438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50730f27-3c82-4ac6-84b0-b02a3405bb50-metrics-client-ca\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.905165 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.905050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50730f27-3c82-4ac6-84b0-b02a3405bb50-metrics-client-ca\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.905165 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.905112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50730f27-3c82-4ac6-84b0-b02a3405bb50-root\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.905481 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.905439 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-accelerators-collector-config\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.908359 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.908325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:37.914961 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:37.914914 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrtwb\" (UniqueName: \"kubernetes.io/projected/50730f27-3c82-4ac6-84b0-b02a3405bb50-kube-api-access-xrtwb\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:38.409752 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:38.409697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-tls\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:38.412498 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:38.412466 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50730f27-3c82-4ac6-84b0-b02a3405bb50-node-exporter-tls\") pod \"node-exporter-pd6mg\" (UID: \"50730f27-3c82-4ac6-84b0-b02a3405bb50\") " pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:38.597255 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:38.596916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pd6mg" Jul 15 12:00:38.726268 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:00:38.726233 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50730f27_3c82_4ac6_84b0_b02a3405bb50.slice/crio-8944b6526c213b2bc78cc4310f1ba927d9df2485de2dc91c6f4b618eb1dad808 WatchSource:0}: Error finding container 8944b6526c213b2bc78cc4310f1ba927d9df2485de2dc91c6f4b618eb1dad808: Status 404 returned error can't find the container with id 8944b6526c213b2bc78cc4310f1ba927d9df2485de2dc91c6f4b618eb1dad808 Jul 15 12:00:39.364206 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:39.364174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz2s5" event={"ID":"36f480ce-7808-4f4c-9f44-066b97a5e083","Type":"ContainerStarted","Data":"059f06e0e58d3b28cc2d8d1909370b8ef628f74b1f4dc7801cee32e5024a922c"} Jul 15 12:00:39.364431 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:39.364233 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz2s5" event={"ID":"36f480ce-7808-4f4c-9f44-066b97a5e083","Type":"ContainerStarted","Data":"9f62c6e510fe10558941ddd92ea4b8433fddbb1ca76ab97a3f35a17f2b7a7a4c"} Jul 15 12:00:39.364431 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:39.364288 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mz2s5" Jul 15 12:00:39.365483 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:39.365459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pd6mg" event={"ID":"50730f27-3c82-4ac6-84b0-b02a3405bb50","Type":"ContainerStarted","Data":"8944b6526c213b2bc78cc4310f1ba927d9df2485de2dc91c6f4b618eb1dad808"} Jul 15 12:00:39.385066 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:39.385005 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mz2s5" podStartSLOduration=65.010653046 podStartE2EDuration="1m8.384989325s" totalImagesPullingTime="3.374336279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:39.383480542 +0000 UTC m=+104.056915508" watchObservedRunningTime="2026-07-15 12:00:39.384989325 +0000 UTC m=+104.058424292" Jul 15 12:00:41.375134 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:41.375103 2559 generic.go:356] "Generic (PLEG): container finished" podID="50730f27-3c82-4ac6-84b0-b02a3405bb50" containerID="687d9f8e96b40d3ddeb2583b04972fab91ad43cd652bdd3c698555d07f990ec2" exitCode=0 Jul 15 12:00:41.375544 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:41.375192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pd6mg" event={"ID":"50730f27-3c82-4ac6-84b0-b02a3405bb50","Type":"ContainerDied","Data":"687d9f8e96b40d3ddeb2583b04972fab91ad43cd652bdd3c698555d07f990ec2"} Jul 15 12:00:41.977920 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:41.977884 2559 patch_prober.go:28] interesting pod/image-registry-647b7685c4-l7n2p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 12:00:41.978097 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:41.977934 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" podUID="adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 12:00:42.380732 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:42.380698 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pd6mg" event={"ID":"50730f27-3c82-4ac6-84b0-b02a3405bb50","Type":"ContainerStarted","Data":"793b0819dd310ea4071b87f0768610480c2352864effe449eff544e216066f87"} Jul 15 12:00:42.381189 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:42.380761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pd6mg" event={"ID":"50730f27-3c82-4ac6-84b0-b02a3405bb50","Type":"ContainerStarted","Data":"148846eb4919114447be16f4b878e033b247aa0838f25b5cb0450a904bf916ab"} Jul 15 12:00:42.405472 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:42.405420 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pd6mg" podStartSLOduration=3.154741027 podStartE2EDuration="5.405404382s" totalImagesPullingTime="2.15444285s" totalInitContainerRuntime="96.220505ms" isStatefulPod=true podCreationTimestamp="2026-07-15 12:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:00:42.404203505 +0000 UTC m=+107.077638471" watchObservedRunningTime="2026-07-15 12:00:42.405404382 +0000 UTC m=+107.078839350" Jul 15 12:00:44.302824 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:44.302794 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-647b7685c4-l7n2p" Jul 15 12:00:49.372921 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:00:49.372891 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mz2s5" Jul 15 12:01:04.731773 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:04.731736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 12:01:04.734198 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:04.734172 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/707c6293-fcb2-45dd-8b6e-6e30b111807a-metrics-certs\") pod \"network-metrics-daemon-vx6r2\" (UID: \"707c6293-fcb2-45dd-8b6e-6e30b111807a\") " pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 12:01:04.991232 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:04.991149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f876h\"" Jul 15 12:01:04.999243 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:04.999215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6r2" Jul 15 12:01:05.170897 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:05.170852 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vx6r2"] Jul 15 12:01:05.174680 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:01:05.174651 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707c6293_fcb2_45dd_8b6e_6e30b111807a.slice/crio-447591e371698df09078e8834751699438aef6c2ae97dc07b79cbace7f954101 WatchSource:0}: Error finding container 447591e371698df09078e8834751699438aef6c2ae97dc07b79cbace7f954101: Status 404 returned error can't find the container with id 447591e371698df09078e8834751699438aef6c2ae97dc07b79cbace7f954101 Jul 15 12:01:05.466099 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:05.466062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx6r2" event={"ID":"707c6293-fcb2-45dd-8b6e-6e30b111807a","Type":"ContainerStarted","Data":"447591e371698df09078e8834751699438aef6c2ae97dc07b79cbace7f954101"} Jul 15 12:01:08.478643 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:08.478609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx6r2" event={"ID":"707c6293-fcb2-45dd-8b6e-6e30b111807a","Type":"ContainerStarted","Data":"3b3999e3542543111dc31ce51398372b65033e5f3af8f596caf5944ab10fd341"} Jul 15 12:01:08.479030 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:08.478663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx6r2" event={"ID":"707c6293-fcb2-45dd-8b6e-6e30b111807a","Type":"ContainerStarted","Data":"b7bb076aa1f8f9ed9e26d41dc2aa5a56efe4eaa628ca75ad96d7a3a500f49272"} Jul 15 12:01:08.497356 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:08.497309 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vx6r2" podStartSLOduration=129.675187503 podStartE2EDuration="2m12.497293284s" totalImagesPullingTime="2.822105781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:01:08.49551741 +0000 UTC m=+133.168952394" watchObservedRunningTime="2026-07-15 12:01:08.497293284 +0000 UTC m=+133.170728286" Jul 15 12:01:11.490015 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:11.489979 2559 generic.go:356] "Generic (PLEG): container finished" podID="69846c5d-09ed-408c-911a-f74e504d1bbe" containerID="2277d1eb87cc5f6de41c3fb82b9df3cce5c7779c931eb0051d0ce461a987ae98" exitCode=0 Jul 15 12:01:11.490504 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:11.490063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" event={"ID":"69846c5d-09ed-408c-911a-f74e504d1bbe","Type":"ContainerDied","Data":"2277d1eb87cc5f6de41c3fb82b9df3cce5c7779c931eb0051d0ce461a987ae98"} Jul 15 12:01:11.490504 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:11.490497 2559 scope.go:117] "RemoveContainer" containerID="2277d1eb87cc5f6de41c3fb82b9df3cce5c7779c931eb0051d0ce461a987ae98" Jul 15 12:01:11.491592 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:11.491570 2559 generic.go:356] "Generic (PLEG): container finished" podID="1cc9f363-78b5-4d62-bcef-69abe703aa31" containerID="ced059c2d096bb691b1af03d7e64a944a5ceae6f19e145b48cfab27dd03ba752" exitCode=0 Jul 15 12:01:11.491689 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:11.491614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" event={"ID":"1cc9f363-78b5-4d62-bcef-69abe703aa31","Type":"ContainerDied","Data":"ced059c2d096bb691b1af03d7e64a944a5ceae6f19e145b48cfab27dd03ba752"} Jul 15 12:01:11.491909 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:11.491895 2559 scope.go:117] "RemoveContainer" containerID="ced059c2d096bb691b1af03d7e64a944a5ceae6f19e145b48cfab27dd03ba752" Jul 15 12:01:12.496537 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:12.496507 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tshx5" event={"ID":"1cc9f363-78b5-4d62-bcef-69abe703aa31","Type":"ContainerStarted","Data":"4e323b17ac9e619854aeb1aa29a79b20c6bd1a2a5eea5618fdee57961a130cba"} Jul 15 12:01:12.498145 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:01:12.498119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7zt7d" event={"ID":"69846c5d-09ed-408c-911a-f74e504d1bbe","Type":"ContainerStarted","Data":"a340fcec66a76fef5c845e582ffcff89d7b32653c74a2ede9c20aa7d3c72f639"} Jul 15 12:03:55.762407 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:03:55.762376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:03:55.764336 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:03:55.764312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:03:55.769576 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:03:55.769557 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 12:04:48.580142 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.580067 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj"] Jul 15 12:04:48.583058 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.583027 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.587543 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.587511 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 12:04:48.588858 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.588834 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 12:04:48.588965 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.588845 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 12:04:48.588965 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.588845 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fdwgb\"" Jul 15 12:04:48.589888 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.589872 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 12:04:48.596648 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.596631 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:04:48.602435 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.602415 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj"] Jul 15 12:04:48.737355 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.737322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwdjt\" (UniqueName: \"kubernetes.io/projected/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-kube-api-access-kwdjt\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.737555 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.737369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-metrics-cert\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.737555 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.737439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-manager-config\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.737555 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.737486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-cert\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.838072 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.837955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-cert\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.838072 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.838063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwdjt\" (UniqueName: \"kubernetes.io/projected/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-kube-api-access-kwdjt\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.838271 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.838090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-metrics-cert\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.838271 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.838123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-manager-config\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.838830 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.838806 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-manager-config\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.840576 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.840548 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-metrics-cert\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.840686 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.840594 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-cert\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.846629 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.846606 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwdjt\" (UniqueName: \"kubernetes.io/projected/4ad4cbc7-8143-4a26-9724-28665f9b7f0f-kube-api-access-kwdjt\") pod \"lws-controller-manager-5dc89645fd-krczj\" (UID: \"4ad4cbc7-8143-4a26-9724-28665f9b7f0f\") " pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:48.891789 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:48.891746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:49.022809 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:49.022779 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj"] Jul 15 12:04:49.025826 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:04:49.025791 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad4cbc7_8143_4a26_9724_28665f9b7f0f.slice/crio-ab24b41318ae4681cd3b047da6e40006707ae8377aeda2d8fa5b768f4813a5cf WatchSource:0}: Error finding container ab24b41318ae4681cd3b047da6e40006707ae8377aeda2d8fa5b768f4813a5cf: Status 404 returned error can't find the container with id ab24b41318ae4681cd3b047da6e40006707ae8377aeda2d8fa5b768f4813a5cf Jul 15 12:04:49.027842 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:49.027826 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 12:04:49.253336 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:49.253255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" event={"ID":"4ad4cbc7-8143-4a26-9724-28665f9b7f0f","Type":"ContainerStarted","Data":"ab24b41318ae4681cd3b047da6e40006707ae8377aeda2d8fa5b768f4813a5cf"} Jul 15 12:04:52.266670 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:52.266630 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" event={"ID":"4ad4cbc7-8143-4a26-9724-28665f9b7f0f","Type":"ContainerStarted","Data":"fb9dd2ad9dfd2281874ea0b8e9fb0aa3a237c6a78f2164e746e538da62c282c8"} Jul 15 12:04:52.267166 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:52.266706 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:04:52.285598 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:52.285550 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" podStartSLOduration=1.674751482 podStartE2EDuration="4.285534744s" totalImagesPullingTime="2.610783262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:04:52.284585998 +0000 UTC m=+356.958020966" watchObservedRunningTime="2026-07-15 12:04:52.285534744 +0000 UTC m=+356.958969710" Jul 15 12:04:58.251784 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.251746 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4"] Jul 15 12:04:58.255278 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.255259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.264218 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.264195 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 12:04:58.264357 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.264236 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 12:04:58.264357 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.264336 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 12:04:58.264994 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.264976 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vrmsp\"" Jul 15 12:04:58.265551 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.265536 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 12:04:58.272972 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.272946 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4"] Jul 15 12:04:58.420201 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.420170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.420411 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.420212 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-manifests\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.420411 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.420234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-webhook-cert\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.420411 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.420258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8rbf\" (UniqueName: \"kubernetes.io/projected/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-kube-api-access-g8rbf\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.420411 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.420304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-tmp\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.520994 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.520901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.520994 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.520951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-manifests\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.520994 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.520971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-webhook-cert\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.520994 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.520988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8rbf\" (UniqueName: \"kubernetes.io/projected/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-kube-api-access-g8rbf\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.521338 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.521058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-tmp\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.521495 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.521467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-manifests\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.523459 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.523426 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-tmp\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.523555 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.523505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-webhook-cert\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.523555 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.523539 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.529597 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.529577 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8rbf\" (UniqueName: \"kubernetes.io/projected/fc1bbc0a-9b1d-4c87-a211-42bc46c64495-kube-api-access-g8rbf\") pod \"opendatahub-operator-controller-manager-694c4fcbc8-kkgm4\" (UID: \"fc1bbc0a-9b1d-4c87-a211-42bc46c64495\") " pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.564661 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.564624 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:04:58.702427 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:58.702222 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4"] Jul 15 12:04:58.705331 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:04:58.705301 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1bbc0a_9b1d_4c87_a211_42bc46c64495.slice/crio-e55aafa8f8ee66377e8699e5a503d5c5dffe469d19d2a9f3b7efd0fe1c17fe1a WatchSource:0}: Error finding container e55aafa8f8ee66377e8699e5a503d5c5dffe469d19d2a9f3b7efd0fe1c17fe1a: Status 404 returned error can't find the container with id e55aafa8f8ee66377e8699e5a503d5c5dffe469d19d2a9f3b7efd0fe1c17fe1a Jul 15 12:04:59.292760 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:04:59.292725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" event={"ID":"fc1bbc0a-9b1d-4c87-a211-42bc46c64495","Type":"ContainerStarted","Data":"e55aafa8f8ee66377e8699e5a503d5c5dffe469d19d2a9f3b7efd0fe1c17fe1a"} Jul 15 12:05:02.305947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:02.305913 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" event={"ID":"fc1bbc0a-9b1d-4c87-a211-42bc46c64495","Type":"ContainerStarted","Data":"1964263074f1e3d6e697e9fa1058c5c9497bd9e2f9d5cf9e48ccf940583641fb"} Jul 15 12:05:03.273210 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:03.273129 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dc89645fd-krczj" Jul 15 12:05:03.313605 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:03.313574 2559 generic.go:356] "Generic (PLEG): container finished" podID="fc1bbc0a-9b1d-4c87-a211-42bc46c64495" containerID="1964263074f1e3d6e697e9fa1058c5c9497bd9e2f9d5cf9e48ccf940583641fb" exitCode=0 Jul 15 12:05:03.314134 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:03.313670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" event={"ID":"fc1bbc0a-9b1d-4c87-a211-42bc46c64495","Type":"ContainerDied","Data":"1964263074f1e3d6e697e9fa1058c5c9497bd9e2f9d5cf9e48ccf940583641fb"} Jul 15 12:05:04.321242 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:04.321199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" event={"ID":"fc1bbc0a-9b1d-4c87-a211-42bc46c64495","Type":"ContainerStarted","Data":"090e40f8906a1d65fe7594044b03ee2b7bc98bef4e3f808b1b7575c09b24356d"} Jul 15 12:05:04.321733 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:04.321321 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:05:04.349423 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:04.349373 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" podStartSLOduration=1.96853832 podStartE2EDuration="6.349355789s" totalImagesPullingTime="3.353997054s" totalInitContainerRuntime="1.026820415s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:04:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:05:04.346978394 +0000 UTC m=+369.020413373" watchObservedRunningTime="2026-07-15 12:05:04.349355789 +0000 UTC m=+369.022790755" Jul 15 12:05:15.327576 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:15.327543 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-694c4fcbc8-kkgm4" Jul 15 12:05:27.507276 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.507234 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq"] Jul 15 12:05:27.511848 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.511829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.516061 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.516021 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 12:05:27.517029 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.516997 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 12:05:27.517152 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.517023 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 12:05:27.517152 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.517074 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-r4cdj\"" Jul 15 12:05:27.522946 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.522921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq"] Jul 15 12:05:27.554663 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96672c7f-4628-4911-873f-ed2869d411cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554821 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554821 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554821 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gp7\" (UniqueName: \"kubernetes.io/projected/96672c7f-4628-4911-873f-ed2869d411cd-kube-api-access-42gp7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.554947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96672c7f-4628-4911-873f-ed2869d411cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.555117 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.554963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96672c7f-4628-4911-873f-ed2869d411cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656401 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656401 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656668 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656668 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gp7\" (UniqueName: \"kubernetes.io/projected/96672c7f-4628-4911-873f-ed2869d411cd-kube-api-access-42gp7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656668 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656668 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96672c7f-4628-4911-873f-ed2869d411cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96672c7f-4628-4911-873f-ed2869d411cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96672c7f-4628-4911-873f-ed2869d411cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.656900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.657134 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.656956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.657134 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.657027 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.657244 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.657194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.657423 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.657403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96672c7f-4628-4911-873f-ed2869d411cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.658874 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.658849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96672c7f-4628-4911-873f-ed2869d411cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.659241 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.659225 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96672c7f-4628-4911-873f-ed2869d411cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.673294 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.673264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96672c7f-4628-4911-873f-ed2869d411cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.673495 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.673473 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gp7\" (UniqueName: \"kubernetes.io/projected/96672c7f-4628-4911-873f-ed2869d411cd-kube-api-access-42gp7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mrhcq\" (UID: \"96672c7f-4628-4911-873f-ed2869d411cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.823097 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.823062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:27.981849 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:27.981818 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq"] Jul 15 12:05:27.985071 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:05:27.985047 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96672c7f_4628_4911_873f_ed2869d411cd.slice/crio-73fd9d82f1df95c1298e03992c7f761b981612d65629fc3224521ae7f135d49d WatchSource:0}: Error finding container 73fd9d82f1df95c1298e03992c7f761b981612d65629fc3224521ae7f135d49d: Status 404 returned error can't find the container with id 73fd9d82f1df95c1298e03992c7f761b981612d65629fc3224521ae7f135d49d Jul 15 12:05:28.412723 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:28.412686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" event={"ID":"96672c7f-4628-4911-873f-ed2869d411cd","Type":"ContainerStarted","Data":"73fd9d82f1df95c1298e03992c7f761b981612d65629fc3224521ae7f135d49d"} Jul 15 12:05:30.709010 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:30.708971 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:05:30.709325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:30.709066 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:05:30.709325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:30.709108 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:05:31.200029 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.199990 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s"] Jul 15 12:05:31.203557 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.203531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.206402 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.206214 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vf6dq\"" Jul 15 12:05:31.206402 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.206253 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 12:05:31.217504 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.217429 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s"] Jul 15 12:05:31.290507 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.290476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5w4v\" (UniqueName: \"kubernetes.io/projected/fac403d0-9702-4904-9b62-21141fa14dd2-kube-api-access-g5w4v\") pod \"llmisvc-controller-manager-777c6bd7d5-hn88s\" (UID: \"fac403d0-9702-4904-9b62-21141fa14dd2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.290673 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.290530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fac403d0-9702-4904-9b62-21141fa14dd2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hn88s\" (UID: \"fac403d0-9702-4904-9b62-21141fa14dd2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.391109 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.391066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w4v\" (UniqueName: \"kubernetes.io/projected/fac403d0-9702-4904-9b62-21141fa14dd2-kube-api-access-g5w4v\") pod \"llmisvc-controller-manager-777c6bd7d5-hn88s\" (UID: \"fac403d0-9702-4904-9b62-21141fa14dd2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.391285 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.391134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fac403d0-9702-4904-9b62-21141fa14dd2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hn88s\" (UID: \"fac403d0-9702-4904-9b62-21141fa14dd2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.393609 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.393576 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fac403d0-9702-4904-9b62-21141fa14dd2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hn88s\" (UID: \"fac403d0-9702-4904-9b62-21141fa14dd2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.412082 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.412053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5w4v\" (UniqueName: \"kubernetes.io/projected/fac403d0-9702-4904-9b62-21141fa14dd2-kube-api-access-g5w4v\") pod \"llmisvc-controller-manager-777c6bd7d5-hn88s\" (UID: \"fac403d0-9702-4904-9b62-21141fa14dd2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.427159 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.427127 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" event={"ID":"96672c7f-4628-4911-873f-ed2869d411cd","Type":"ContainerStarted","Data":"133656591c6cf5200bacd1eb81bb635cc931d8f9c06002f0342a5e8aeee6247e"} Jul 15 12:05:31.515269 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.515175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:31.659598 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.659541 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" podStartSLOduration=1.937769049 podStartE2EDuration="4.659524004s" totalImagesPullingTime="2.721754955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:05:31.524470654 +0000 UTC m=+396.197905626" watchObservedRunningTime="2026-07-15 12:05:31.659524004 +0000 UTC m=+396.332958971" Jul 15 12:05:31.659855 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.659837 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s"] Jul 15 12:05:31.663385 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:05:31.663355 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfac403d0_9702_4904_9b62_21141fa14dd2.slice/crio-96a1262cd2912992bcdfb44d4cba186c22233da7e147ef21334cf22ff67b16af WatchSource:0}: Error finding container 96a1262cd2912992bcdfb44d4cba186c22233da7e147ef21334cf22ff67b16af: Status 404 returned error can't find the container with id 96a1262cd2912992bcdfb44d4cba186c22233da7e147ef21334cf22ff67b16af Jul 15 12:05:31.823862 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.823825 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:31.829208 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:31.829181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:32.432845 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:32.432800 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" event={"ID":"fac403d0-9702-4904-9b62-21141fa14dd2","Type":"ContainerStarted","Data":"96a1262cd2912992bcdfb44d4cba186c22233da7e147ef21334cf22ff67b16af"} Jul 15 12:05:32.433171 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:32.433143 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:32.434327 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:32.434299 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mrhcq" Jul 15 12:05:37.457247 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:37.457202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" event={"ID":"fac403d0-9702-4904-9b62-21141fa14dd2","Type":"ContainerStarted","Data":"ce834df92854cc1bd4d9ba4e4fdc68724f201268e2429f728f659b685214d5c2"} Jul 15 12:05:37.457678 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:37.457267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:05:37.477254 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:05:37.477200 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" podStartSLOduration=1.728890876 podStartE2EDuration="6.47718417s" totalImagesPullingTime="4.748293294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:05:37.475264542 +0000 UTC m=+402.148699511" watchObservedRunningTime="2026-07-15 12:05:37.47718417 +0000 UTC m=+402.150619137" Jul 15 12:06:08.463810 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:08.463776 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hn88s" Jul 15 12:06:21.512339 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.512260 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8p4xz"] Jul 15 12:06:21.514508 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.514489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:21.517556 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.517527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 12:06:21.517679 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.517662 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2fkml\"" Jul 15 12:06:21.518450 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.518431 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 12:06:21.534480 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.534449 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8p4xz"] Jul 15 12:06:21.617557 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.617523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdbcn\" (UniqueName: \"kubernetes.io/projected/d9c3ef83-740d-4889-8c2f-ce83bfc55fed-kube-api-access-mdbcn\") pod \"kuadrant-operator-catalog-8p4xz\" (UID: \"d9c3ef83-740d-4889-8c2f-ce83bfc55fed\") " pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:21.718380 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.718329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdbcn\" (UniqueName: \"kubernetes.io/projected/d9c3ef83-740d-4889-8c2f-ce83bfc55fed-kube-api-access-mdbcn\") pod \"kuadrant-operator-catalog-8p4xz\" (UID: \"d9c3ef83-740d-4889-8c2f-ce83bfc55fed\") " pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:21.727238 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.727209 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdbcn\" (UniqueName: \"kubernetes.io/projected/d9c3ef83-740d-4889-8c2f-ce83bfc55fed-kube-api-access-mdbcn\") pod \"kuadrant-operator-catalog-8p4xz\" (UID: \"d9c3ef83-740d-4889-8c2f-ce83bfc55fed\") " pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:21.823355 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.823321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:21.957754 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:21.957727 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8p4xz"] Jul 15 12:06:21.960012 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:06:21.959983 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c3ef83_740d_4889_8c2f_ce83bfc55fed.slice/crio-c9a0cb74c69a496bdc2a2c531306ae7c40944dbd60f49fefc2261216a6f71816 WatchSource:0}: Error finding container c9a0cb74c69a496bdc2a2c531306ae7c40944dbd60f49fefc2261216a6f71816: Status 404 returned error can't find the container with id c9a0cb74c69a496bdc2a2c531306ae7c40944dbd60f49fefc2261216a6f71816 Jul 15 12:06:22.644507 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:22.644472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" event={"ID":"d9c3ef83-740d-4889-8c2f-ce83bfc55fed","Type":"ContainerStarted","Data":"c9a0cb74c69a496bdc2a2c531306ae7c40944dbd60f49fefc2261216a6f71816"} Jul 15 12:06:25.666138 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:25.666096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" event={"ID":"d9c3ef83-740d-4889-8c2f-ce83bfc55fed","Type":"ContainerStarted","Data":"71241e551f11c9ba97e690dad7d71f5450a7d4597ab9ba52027e96984a14c2d3"} Jul 15 12:06:25.697323 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:25.697270 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" podStartSLOduration=1.698154224 podStartE2EDuration="4.697255782s" totalImagesPullingTime="2.999101558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:06:25.697173967 +0000 UTC m=+450.370608935" watchObservedRunningTime="2026-07-15 12:06:25.697255782 +0000 UTC m=+450.370690749" Jul 15 12:06:31.823488 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:31.823427 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:31.824017 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:31.823569 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:31.846714 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:31.846676 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:32.716533 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:32.716498 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8p4xz" Jul 15 12:06:56.175748 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.175716 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r"] Jul 15 12:06:56.178008 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.177991 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:06:56.180508 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.180487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5j8m7\"" Jul 15 12:06:56.180610 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.180490 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 12:06:56.191625 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.191601 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r"] Jul 15 12:06:56.313923 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.313882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s88v2\" (UniqueName: \"kubernetes.io/projected/5a1e7ac8-449d-44bb-b18e-763d8ce32c48-kube-api-access-s88v2\") pod \"dns-operator-controller-manager-864dd78c4c-cgq8r\" (UID: \"5a1e7ac8-449d-44bb-b18e-763d8ce32c48\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:06:56.414734 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.414690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s88v2\" (UniqueName: \"kubernetes.io/projected/5a1e7ac8-449d-44bb-b18e-763d8ce32c48-kube-api-access-s88v2\") pod \"dns-operator-controller-manager-864dd78c4c-cgq8r\" (UID: \"5a1e7ac8-449d-44bb-b18e-763d8ce32c48\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:06:56.426714 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.426653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s88v2\" (UniqueName: \"kubernetes.io/projected/5a1e7ac8-449d-44bb-b18e-763d8ce32c48-kube-api-access-s88v2\") pod \"dns-operator-controller-manager-864dd78c4c-cgq8r\" (UID: \"5a1e7ac8-449d-44bb-b18e-763d8ce32c48\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:06:56.487597 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.487554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:06:56.634024 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.633991 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r"] Jul 15 12:06:56.636971 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:06:56.636941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1e7ac8_449d_44bb_b18e_763d8ce32c48.slice/crio-a1598ce299c707c36f562ee1af6af98d8677b5cb972defc019f8a645cca90f1c WatchSource:0}: Error finding container a1598ce299c707c36f562ee1af6af98d8677b5cb972defc019f8a645cca90f1c: Status 404 returned error can't find the container with id a1598ce299c707c36f562ee1af6af98d8677b5cb972defc019f8a645cca90f1c Jul 15 12:06:56.791947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:56.791916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" event={"ID":"5a1e7ac8-449d-44bb-b18e-763d8ce32c48","Type":"ContainerStarted","Data":"a1598ce299c707c36f562ee1af6af98d8677b5cb972defc019f8a645cca90f1c"} Jul 15 12:06:58.804195 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:58.804159 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" event={"ID":"5a1e7ac8-449d-44bb-b18e-763d8ce32c48","Type":"ContainerStarted","Data":"5bd5f23073c10a7c240b449187a1c111ecbdada5b1adb9ff0c3afe0cdc369724"} Jul 15 12:06:58.804570 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:58.804297 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:06:58.826121 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:58.826072 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" podStartSLOduration=0.748063693 podStartE2EDuration="2.826056991s" totalImagesPullingTime="2.077993298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:06:58.825397445 +0000 UTC m=+483.498832416" watchObservedRunningTime="2026-07-15 12:06:58.826056991 +0000 UTC m=+483.499491949" Jul 15 12:06:59.089303 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.089267 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b"] Jul 15 12:06:59.092399 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.092383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:06:59.095188 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.095167 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n8rcz\"" Jul 15 12:06:59.104926 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.104902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b"] Jul 15 12:06:59.242550 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.242505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwlh\" (UniqueName: \"kubernetes.io/projected/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9-kube-api-access-dbwlh\") pod \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" (UID: \"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:06:59.343939 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.343836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwlh\" (UniqueName: \"kubernetes.io/projected/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9-kube-api-access-dbwlh\") pod \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" (UID: \"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:06:59.377215 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.377186 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwlh\" (UniqueName: \"kubernetes.io/projected/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9-kube-api-access-dbwlh\") pod \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" (UID: \"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:06:59.401994 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.401958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:06:59.546931 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.546904 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b"] Jul 15 12:06:59.549342 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:06:59.549316 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8afa908_7f79_44d1_9d16_1f2ab4afb1f9.slice/crio-8601da19010c2a87c830a23370be52f29645a9173b8b4136eda07e69ede78bfe WatchSource:0}: Error finding container 8601da19010c2a87c830a23370be52f29645a9173b8b4136eda07e69ede78bfe: Status 404 returned error can't find the container with id 8601da19010c2a87c830a23370be52f29645a9173b8b4136eda07e69ede78bfe Jul 15 12:06:59.811713 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:06:59.811676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" event={"ID":"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9","Type":"ContainerStarted","Data":"8601da19010c2a87c830a23370be52f29645a9173b8b4136eda07e69ede78bfe"} Jul 15 12:07:01.821399 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:01.821359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" event={"ID":"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9","Type":"ContainerStarted","Data":"751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64"} Jul 15 12:07:01.821785 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:01.821548 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:01.847009 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:01.846955 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" podStartSLOduration=0.944187031 podStartE2EDuration="2.84693862s" totalImagesPullingTime="1.902751589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:07:01.84597443 +0000 UTC m=+486.519409411" watchObservedRunningTime="2026-07-15 12:07:01.84693862 +0000 UTC m=+486.520373587" Jul 15 12:07:09.814633 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:09.814597 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgq8r" Jul 15 12:07:12.828860 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:12.828831 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.319132 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.319097 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b"] Jul 15 12:07:24.319942 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.319881 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" containerName="manager" containerID="cri-o://751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64" gracePeriod=2 Jul 15 12:07:24.330940 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.330902 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b"] Jul 15 12:07:24.334965 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:24.334934 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8jq8b\": pods \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.342264 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.342237 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l"] Jul 15 12:07:24.342589 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.342573 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" containerName="manager" Jul 15 12:07:24.342695 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.342592 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" containerName="manager" Jul 15 12:07:24.342695 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.342672 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" containerName="manager" Jul 15 12:07:24.345359 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.345341 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:24.359079 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.359051 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l"] Jul 15 12:07:24.376632 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:24.376595 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" is forbidden: User \"system:node:ip-10-0-139-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-5.ec2.internal' and this object" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.455342 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.455299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w22d8\" (UniqueName: \"kubernetes.io/projected/e133cf4e-5aaf-458e-8f45-b61610d59d5a-kube-api-access-w22d8\") pod \"limitador-operator-controller-manager-859d7b78bd-smr2l\" (UID: \"e133cf4e-5aaf-458e-8f45-b61610d59d5a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:24.555756 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.555725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w22d8\" (UniqueName: \"kubernetes.io/projected/e133cf4e-5aaf-458e-8f45-b61610d59d5a-kube-api-access-w22d8\") pod \"limitador-operator-controller-manager-859d7b78bd-smr2l\" (UID: \"e133cf4e-5aaf-458e-8f45-b61610d59d5a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:24.558454 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.558432 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.560657 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:24.560632 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" is forbidden: User \"system:node:ip-10-0-139-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-5.ec2.internal' and this object" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.564737 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.564710 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w22d8\" (UniqueName: \"kubernetes.io/projected/e133cf4e-5aaf-458e-8f45-b61610d59d5a-kube-api-access-w22d8\") pod \"limitador-operator-controller-manager-859d7b78bd-smr2l\" (UID: \"e133cf4e-5aaf-458e-8f45-b61610d59d5a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:24.656758 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.656675 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbwlh\" (UniqueName: \"kubernetes.io/projected/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9-kube-api-access-dbwlh\") pod \"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9\" (UID: \"f8afa908-7f79-44d1-9d16-1f2ab4afb1f9\") " Jul 15 12:07:24.658847 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.658824 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9-kube-api-access-dbwlh" (OuterVolumeSpecName: "kube-api-access-dbwlh") pod "f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" (UID: "f8afa908-7f79-44d1-9d16-1f2ab4afb1f9"). InnerVolumeSpecName "kube-api-access-dbwlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:07:24.698206 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.698166 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:24.757873 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.757831 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbwlh\" (UniqueName: \"kubernetes.io/projected/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9-kube-api-access-dbwlh\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:07:24.855319 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.855294 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l"] Jul 15 12:07:24.856642 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:07:24.856615 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode133cf4e_5aaf_458e_8f45_b61610d59d5a.slice/crio-2e62ca00728cd56ef667fb06583a27a6326f5a62d9fe790e26fb884d06f48bca WatchSource:0}: Error finding container 2e62ca00728cd56ef667fb06583a27a6326f5a62d9fe790e26fb884d06f48bca: Status 404 returned error can't find the container with id 2e62ca00728cd56ef667fb06583a27a6326f5a62d9fe790e26fb884d06f48bca Jul 15 12:07:24.919504 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.919474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" event={"ID":"e133cf4e-5aaf-458e-8f45-b61610d59d5a","Type":"ContainerStarted","Data":"2e62ca00728cd56ef667fb06583a27a6326f5a62d9fe790e26fb884d06f48bca"} Jul 15 12:07:24.921307 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.921281 2559 generic.go:356] "Generic (PLEG): container finished" podID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" containerID="751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64" exitCode=0 Jul 15 12:07:24.921433 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.921333 2559 scope.go:117] "RemoveContainer" containerID="751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64" Jul 15 12:07:24.921433 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.921342 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.924135 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:24.924099 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" is forbidden: User \"system:node:ip-10-0-139-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-5.ec2.internal' and this object" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:24.929975 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.929955 2559 scope.go:117] "RemoveContainer" containerID="751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64" Jul 15 12:07:24.930263 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:24.930238 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64\": container with ID starting with 751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64 not found: ID does not exist" containerID="751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64" Jul 15 12:07:24.930331 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:24.930277 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64"} err="failed to get container status \"751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64\": rpc error: code = NotFound desc = could not find container \"751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64\": container with ID starting with 751abb804048a7aef1102873358ca708b066bed3361cf997cdc23b56ce551f64 not found: ID does not exist" Jul 15 12:07:24.934395 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:24.934369 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" is forbidden: User \"system:node:ip-10-0-139-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-5.ec2.internal' and this object" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:25.879590 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:07:25.879550 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jq8b\" is forbidden: User \"system:node:ip-10-0-139-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-5.ec2.internal' and this object" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jq8b" Jul 15 12:07:25.880723 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:25.880702 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8afa908-7f79-44d1-9d16-1f2ab4afb1f9" path="/var/lib/kubelet/pods/f8afa908-7f79-44d1-9d16-1f2ab4afb1f9/volumes" Jul 15 12:07:25.926875 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:25.926839 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" event={"ID":"e133cf4e-5aaf-458e-8f45-b61610d59d5a","Type":"ContainerStarted","Data":"39efcf36c55e1de1feedda8056fe7b3dd4b5dbd6cbc2a1f0f4a9dfc35d9a26fe"} Jul 15 12:07:25.927093 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:25.926933 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:25.959719 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:25.959660 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" podStartSLOduration=1.95964318 podStartE2EDuration="1.95964318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:07:25.957165949 +0000 UTC m=+510.630600929" watchObservedRunningTime="2026-07-15 12:07:25.95964318 +0000 UTC m=+510.633078147" Jul 15 12:07:36.934137 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:36.934109 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-smr2l" Jul 15 12:07:53.122238 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.122158 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz"] Jul 15 12:07:53.124490 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.124471 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.127139 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.127116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r7lg6\"" Jul 15 12:07:53.139770 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.139134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz"] Jul 15 12:07:53.301182 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9bp\" (UniqueName: \"kubernetes.io/projected/ba505e15-a992-4e63-99af-6849115b9782-kube-api-access-jb9bp\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba505e15-a992-4e63-99af-6849115b9782-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba505e15-a992-4e63-99af-6849115b9782-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301519 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba505e15-a992-4e63-99af-6849115b9782-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301519 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.301519 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.301428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402429 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402429 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9bp\" (UniqueName: \"kubernetes.io/projected/ba505e15-a992-4e63-99af-6849115b9782-kube-api-access-jb9bp\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402672 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402672 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402672 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba505e15-a992-4e63-99af-6849115b9782-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402672 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba505e15-a992-4e63-99af-6849115b9782-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402672 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba505e15-a992-4e63-99af-6849115b9782-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402672 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402970 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.402970 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.402805 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.403107 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.403074 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.403376 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.403353 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.403478 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.403353 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba505e15-a992-4e63-99af-6849115b9782-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.403530 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.403473 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.404785 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.404761 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba505e15-a992-4e63-99af-6849115b9782-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.405009 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.404992 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba505e15-a992-4e63-99af-6849115b9782-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.411861 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.411812 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba505e15-a992-4e63-99af-6849115b9782-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.411969 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.411905 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9bp\" (UniqueName: \"kubernetes.io/projected/ba505e15-a992-4e63-99af-6849115b9782-kube-api-access-jb9bp\") pod \"maas-default-gateway-openshift-default-56654dcf7-wd2tz\" (UID: \"ba505e15-a992-4e63-99af-6849115b9782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.439649 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.439619 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:53.599160 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.599129 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz"] Jul 15 12:07:53.601564 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:07:53.601535 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba505e15_a992_4e63_99af_6849115b9782.slice/crio-a9532f67979776627ed9278e1c7b907ee9ca3ac672ff1af5999ea4145cf06d89 WatchSource:0}: Error finding container a9532f67979776627ed9278e1c7b907ee9ca3ac672ff1af5999ea4145cf06d89: Status 404 returned error can't find the container with id a9532f67979776627ed9278e1c7b907ee9ca3ac672ff1af5999ea4145cf06d89 Jul 15 12:07:53.606689 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.606649 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:07:53.606792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.606728 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:07:53.606792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:53.606767 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:07:54.042861 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:54.042821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" event={"ID":"ba505e15-a992-4e63-99af-6849115b9782","Type":"ContainerStarted","Data":"27dfdfa2c817e888b1b245e0aec36963050b1331ff027811a69850d7d295a659"} Jul 15 12:07:54.043071 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:54.042884 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" event={"ID":"ba505e15-a992-4e63-99af-6849115b9782","Type":"ContainerStarted","Data":"a9532f67979776627ed9278e1c7b907ee9ca3ac672ff1af5999ea4145cf06d89"} Jul 15 12:07:54.064744 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:54.064697 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" podStartSLOduration=1.06467958 podStartE2EDuration="1.06467958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:07:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:07:54.063517895 +0000 UTC m=+538.736952864" watchObservedRunningTime="2026-07-15 12:07:54.06467958 +0000 UTC m=+538.738114547" Jul 15 12:07:54.440160 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:54.440075 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:54.444933 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:54.444910 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:55.047919 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:55.047882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:07:55.049022 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:07:55.049000 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:08:08.011288 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.011203 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mxmz2"] Jul 15 12:08:08.014810 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.014792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:08.017305 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.017279 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-878tq\"" Jul 15 12:08:08.020964 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.020937 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mxmz2"] Jul 15 12:08:08.120029 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.119997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pksgj\" (UniqueName: \"kubernetes.io/projected/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1-kube-api-access-pksgj\") pod \"authorino-75d556bd77-mxmz2\" (UID: \"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1\") " pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:08.221105 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.221059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pksgj\" (UniqueName: \"kubernetes.io/projected/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1-kube-api-access-pksgj\") pod \"authorino-75d556bd77-mxmz2\" (UID: \"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1\") " pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:08.229334 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.229300 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pksgj\" (UniqueName: \"kubernetes.io/projected/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1-kube-api-access-pksgj\") pod \"authorino-75d556bd77-mxmz2\" (UID: \"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1\") " pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:08.324459 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.324421 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:08.459427 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:08.459404 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mxmz2"] Jul 15 12:08:08.462406 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:08:08.462361 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9fe1596_aa8c_4e0a_9f0f_f90e274d01a1.slice/crio-b73ac4e7570922ef84eedd034411011e0a78c7382b21495712fe10c833ad2a94 WatchSource:0}: Error finding container b73ac4e7570922ef84eedd034411011e0a78c7382b21495712fe10c833ad2a94: Status 404 returned error can't find the container with id b73ac4e7570922ef84eedd034411011e0a78c7382b21495712fe10c833ad2a94 Jul 15 12:08:09.107110 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:09.107074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mxmz2" event={"ID":"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1","Type":"ContainerStarted","Data":"b73ac4e7570922ef84eedd034411011e0a78c7382b21495712fe10c833ad2a94"} Jul 15 12:08:12.124523 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:12.124487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mxmz2" event={"ID":"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1","Type":"ContainerStarted","Data":"f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce"} Jul 15 12:08:12.143876 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:12.143827 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mxmz2" podStartSLOduration=1.911756161 podStartE2EDuration="5.143810504s" totalImagesPullingTime="3.232054343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:12.142431521 +0000 UTC m=+556.815866488" watchObservedRunningTime="2026-07-15 12:08:12.143810504 +0000 UTC m=+556.817245471" Jul 15 12:08:40.667134 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.667097 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-566cddd969-kp84v"] Jul 15 12:08:40.670525 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.670505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.672896 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.672874 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 12:08:40.679785 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.679763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-566cddd969-kp84v"] Jul 15 12:08:40.803319 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.803273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qzx\" (UniqueName: \"kubernetes.io/projected/772924c1-a662-44e9-8d5e-36aaf2e89186-kube-api-access-l4qzx\") pod \"authorino-566cddd969-kp84v\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.803506 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.803353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/772924c1-a662-44e9-8d5e-36aaf2e89186-tls-cert\") pod \"authorino-566cddd969-kp84v\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.903797 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.903757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qzx\" (UniqueName: \"kubernetes.io/projected/772924c1-a662-44e9-8d5e-36aaf2e89186-kube-api-access-l4qzx\") pod \"authorino-566cddd969-kp84v\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.904005 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.903815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/772924c1-a662-44e9-8d5e-36aaf2e89186-tls-cert\") pod \"authorino-566cddd969-kp84v\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.906189 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.906164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/772924c1-a662-44e9-8d5e-36aaf2e89186-tls-cert\") pod \"authorino-566cddd969-kp84v\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.912690 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.912670 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qzx\" (UniqueName: \"kubernetes.io/projected/772924c1-a662-44e9-8d5e-36aaf2e89186-kube-api-access-l4qzx\") pod \"authorino-566cddd969-kp84v\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:40.980247 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:40.980146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:08:41.110339 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:41.110259 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-566cddd969-kp84v"] Jul 15 12:08:41.112906 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:08:41.112875 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod772924c1_a662_44e9_8d5e_36aaf2e89186.slice/crio-c727bda6e1f61d92fbf2f8d68596219b23bcb02a96aa77c243f32fdfa2b4526d WatchSource:0}: Error finding container c727bda6e1f61d92fbf2f8d68596219b23bcb02a96aa77c243f32fdfa2b4526d: Status 404 returned error can't find the container with id c727bda6e1f61d92fbf2f8d68596219b23bcb02a96aa77c243f32fdfa2b4526d Jul 15 12:08:41.252840 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:41.252752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566cddd969-kp84v" event={"ID":"772924c1-a662-44e9-8d5e-36aaf2e89186","Type":"ContainerStarted","Data":"c727bda6e1f61d92fbf2f8d68596219b23bcb02a96aa77c243f32fdfa2b4526d"} Jul 15 12:08:42.258525 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.258489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566cddd969-kp84v" event={"ID":"772924c1-a662-44e9-8d5e-36aaf2e89186","Type":"ContainerStarted","Data":"0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273"} Jul 15 12:08:42.274380 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.274332 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-566cddd969-kp84v" podStartSLOduration=1.7273203910000001 podStartE2EDuration="2.274316513s" totalImagesPullingTime="546.996122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:42.273541234 +0000 UTC m=+586.946976201" watchObservedRunningTime="2026-07-15 12:08:42.274316513 +0000 UTC m=+586.947751501" Jul 15 12:08:42.301950 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.301918 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mxmz2"] Jul 15 12:08:42.302161 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.302110 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mxmz2" podUID="e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" containerName="authorino" containerID="cri-o://f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce" gracePeriod=30 Jul 15 12:08:42.568126 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.568097 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:42.718433 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.718407 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pksgj\" (UniqueName: \"kubernetes.io/projected/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1-kube-api-access-pksgj\") pod \"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1\" (UID: \"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1\") " Jul 15 12:08:42.720463 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.720433 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1-kube-api-access-pksgj" (OuterVolumeSpecName: "kube-api-access-pksgj") pod "e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" (UID: "e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1"). InnerVolumeSpecName "kube-api-access-pksgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:08:42.819245 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:42.819157 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pksgj\" (UniqueName: \"kubernetes.io/projected/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1-kube-api-access-pksgj\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:08:43.266341 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.266248 2559 generic.go:356] "Generic (PLEG): container finished" podID="e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" containerID="f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce" exitCode=0 Jul 15 12:08:43.266341 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.266291 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mxmz2" Jul 15 12:08:43.266341 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.266329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mxmz2" event={"ID":"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1","Type":"ContainerDied","Data":"f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce"} Jul 15 12:08:43.266887 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.266372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mxmz2" event={"ID":"e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1","Type":"ContainerDied","Data":"b73ac4e7570922ef84eedd034411011e0a78c7382b21495712fe10c833ad2a94"} Jul 15 12:08:43.266887 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.266399 2559 scope.go:117] "RemoveContainer" containerID="f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce" Jul 15 12:08:43.274932 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.274915 2559 scope.go:117] "RemoveContainer" containerID="f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce" Jul 15 12:08:43.275255 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:08:43.275235 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce\": container with ID starting with f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce not found: ID does not exist" containerID="f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce" Jul 15 12:08:43.275315 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.275263 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce"} err="failed to get container status \"f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce\": rpc error: code = NotFound desc = could not find container \"f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce\": container with ID starting with f7261d95557929e6bf41978d4e1302a9af7e0c3a3a5b88394f5903e5cfb465ce not found: ID does not exist" Jul 15 12:08:43.288935 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.288905 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mxmz2"] Jul 15 12:08:43.292808 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.292785 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mxmz2"] Jul 15 12:08:43.880795 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:43.880767 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" path="/var/lib/kubelet/pods/e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1/volumes" Jul 15 12:08:55.788427 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:55.788392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:08:55.788929 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:08:55.788496 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:09:24.364098 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.363996 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs"] Jul 15 12:09:24.365692 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.364332 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" containerName="authorino" Jul 15 12:09:24.365692 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.364343 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" containerName="authorino" Jul 15 12:09:24.365692 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.364394 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9fe1596-aa8c-4e0a-9f0f-f90e274d01a1" containerName="authorino" Jul 15 12:09:24.366351 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.366335 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.369342 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.369319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 12:09:24.369465 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.369450 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xph24\"" Jul 15 12:09:24.376428 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.376403 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs"] Jul 15 12:09:24.379651 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.379625 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-85h4l"] Jul 15 12:09:24.382354 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.382333 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.392971 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.392944 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-85h4l"] Jul 15 12:09:24.471471 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.471441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/943aad8a-8ba5-4154-905a-73708f993a7a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-vwdxs\" (UID: \"943aad8a-8ba5-4154-905a-73708f993a7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.471667 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.471510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mlkd\" (UniqueName: \"kubernetes.io/projected/aaea0d16-3d83-4142-bdfa-7cf1b6113cd5-kube-api-access-7mlkd\") pod \"payload-processing-f9b8d9b9b-85h4l\" (UID: \"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.471667 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.471585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhrgc\" (UniqueName: \"kubernetes.io/projected/943aad8a-8ba5-4154-905a-73708f993a7a-kube-api-access-nhrgc\") pod \"payload-pre-processing-74584bb9f8-vwdxs\" (UID: \"943aad8a-8ba5-4154-905a-73708f993a7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.471667 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.471620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaea0d16-3d83-4142-bdfa-7cf1b6113cd5-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-85h4l\" (UID: \"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.572944 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.572906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhrgc\" (UniqueName: \"kubernetes.io/projected/943aad8a-8ba5-4154-905a-73708f993a7a-kube-api-access-nhrgc\") pod \"payload-pre-processing-74584bb9f8-vwdxs\" (UID: \"943aad8a-8ba5-4154-905a-73708f993a7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.573133 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.573005 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaea0d16-3d83-4142-bdfa-7cf1b6113cd5-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-85h4l\" (UID: \"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.573133 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.573094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/943aad8a-8ba5-4154-905a-73708f993a7a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-vwdxs\" (UID: \"943aad8a-8ba5-4154-905a-73708f993a7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.573222 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.573161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mlkd\" (UniqueName: \"kubernetes.io/projected/aaea0d16-3d83-4142-bdfa-7cf1b6113cd5-kube-api-access-7mlkd\") pod \"payload-processing-f9b8d9b9b-85h4l\" (UID: \"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.573781 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.573763 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/943aad8a-8ba5-4154-905a-73708f993a7a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-vwdxs\" (UID: \"943aad8a-8ba5-4154-905a-73708f993a7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.574007 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.573990 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaea0d16-3d83-4142-bdfa-7cf1b6113cd5-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-85h4l\" (UID: \"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.582316 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.582291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhrgc\" (UniqueName: \"kubernetes.io/projected/943aad8a-8ba5-4154-905a-73708f993a7a-kube-api-access-nhrgc\") pod \"payload-pre-processing-74584bb9f8-vwdxs\" (UID: \"943aad8a-8ba5-4154-905a-73708f993a7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.582449 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.582292 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mlkd\" (UniqueName: \"kubernetes.io/projected/aaea0d16-3d83-4142-bdfa-7cf1b6113cd5-kube-api-access-7mlkd\") pod \"payload-processing-f9b8d9b9b-85h4l\" (UID: \"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.677498 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.677395 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:24.692733 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.692702 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:24.823368 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.823328 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs"] Jul 15 12:09:24.827166 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:09:24.827138 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943aad8a_8ba5_4154_905a_73708f993a7a.slice/crio-b551983693396c5c420fa55463d2e7799d48bc3853a26783c8ab5a14f33ba800 WatchSource:0}: Error finding container b551983693396c5c420fa55463d2e7799d48bc3853a26783c8ab5a14f33ba800: Status 404 returned error can't find the container with id b551983693396c5c420fa55463d2e7799d48bc3853a26783c8ab5a14f33ba800 Jul 15 12:09:24.853027 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:24.852996 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-85h4l"] Jul 15 12:09:24.855738 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:09:24.855711 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaea0d16_3d83_4142_bdfa_7cf1b6113cd5.slice/crio-cedfbf971a935e87cc3de1ccad7dd9dcc8370b6540e2b6a41500fda18985e4ad WatchSource:0}: Error finding container cedfbf971a935e87cc3de1ccad7dd9dcc8370b6540e2b6a41500fda18985e4ad: Status 404 returned error can't find the container with id cedfbf971a935e87cc3de1ccad7dd9dcc8370b6540e2b6a41500fda18985e4ad Jul 15 12:09:25.459373 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:25.459341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" event={"ID":"943aad8a-8ba5-4154-905a-73708f993a7a","Type":"ContainerStarted","Data":"b551983693396c5c420fa55463d2e7799d48bc3853a26783c8ab5a14f33ba800"} Jul 15 12:09:25.460473 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:25.460447 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" event={"ID":"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5","Type":"ContainerStarted","Data":"cedfbf971a935e87cc3de1ccad7dd9dcc8370b6540e2b6a41500fda18985e4ad"} Jul 15 12:09:27.471233 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:27.471136 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" event={"ID":"943aad8a-8ba5-4154-905a-73708f993a7a","Type":"ContainerStarted","Data":"f2764adde18816b4e2a642847da82f4810e74ede684a46768bdd7c2580974815"} Jul 15 12:09:27.471647 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:27.471269 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:09:27.472550 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:27.472527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" event={"ID":"aaea0d16-3d83-4142-bdfa-7cf1b6113cd5","Type":"ContainerStarted","Data":"a334b0bbb143c8d521c6c87ac77444feb1dc119696c03ab2f0e2daee80e99316"} Jul 15 12:09:27.472670 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:27.472580 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:27.492927 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:27.492861 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" podStartSLOduration=1.8520953439999999 podStartE2EDuration="3.492842046s" totalImagesPullingTime="1.640746702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:27.491382362 +0000 UTC m=+632.164817330" watchObservedRunningTime="2026-07-15 12:09:27.492842046 +0000 UTC m=+632.166276994" Jul 15 12:09:27.515624 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:27.515547 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" podStartSLOduration=1.15412289 podStartE2EDuration="3.515522952s" totalImagesPullingTime="2.361400062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:27.511173865 +0000 UTC m=+632.184608834" watchObservedRunningTime="2026-07-15 12:09:27.515522952 +0000 UTC m=+632.188957923" Jul 15 12:09:32.499278 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:32.499244 2559 generic.go:356] "Generic (PLEG): container finished" podID="ba505e15-a992-4e63-99af-6849115b9782" containerID="27dfdfa2c817e888b1b245e0aec36963050b1331ff027811a69850d7d295a659" exitCode=0 Jul 15 12:09:32.499747 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:32.499322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" event={"ID":"ba505e15-a992-4e63-99af-6849115b9782","Type":"ContainerDied","Data":"27dfdfa2c817e888b1b245e0aec36963050b1331ff027811a69850d7d295a659"} Jul 15 12:09:32.499747 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:32.499724 2559 scope.go:117] "RemoveContainer" containerID="27dfdfa2c817e888b1b245e0aec36963050b1331ff027811a69850d7d295a659" Jul 15 12:09:32.500703 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:32.500673 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:09:32.500771 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:32.500748 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:09:32.500812 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:32.500785 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:09:33.506586 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:33.506554 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" event={"ID":"ba505e15-a992-4e63-99af-6849115b9782","Type":"ContainerStarted","Data":"1152fc54a618633df5879c52cce4d8031d178a7ba2460a17aae033c591224f31"} Jul 15 12:09:34.440093 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:34.440028 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:09:34.440326 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:34.440305 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wd2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 15 12:09:34.440411 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:34.440361 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" podUID="ba505e15-a992-4e63-99af-6849115b9782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 15 12:09:35.440151 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:35.440108 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wd2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 15 12:09:35.440648 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:35.440162 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" podUID="ba505e15-a992-4e63-99af-6849115b9782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 15 12:09:36.440488 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:36.440445 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wd2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 15 12:09:36.440885 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:36.440520 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" podUID="ba505e15-a992-4e63-99af-6849115b9782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 15 12:09:37.440548 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:37.440513 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wd2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 15 12:09:37.441059 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:37.440580 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" podUID="ba505e15-a992-4e63-99af-6849115b9782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 15 12:09:38.441045 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:38.441008 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wd2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 15 12:09:38.441428 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:38.441107 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" podUID="ba505e15-a992-4e63-99af-6849115b9782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 15 12:09:38.479231 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:38.479180 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" podUID="943aad8a-8ba5-4154-905a-73708f993a7a" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.29:9004: connect: connection refused" Jul 15 12:09:38.479581 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:38.479560 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-85h4l" Jul 15 12:09:39.444401 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:39.444369 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:09:39.444773 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:39.444649 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:09:39.445299 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:39.445282 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wd2tz" Jul 15 12:09:48.478173 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:09:48.478141 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-vwdxs" Jul 15 12:10:19.960503 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.960459 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr"] Jul 15 12:10:19.962811 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.962794 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:19.966487 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.966460 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hz8rk\"" Jul 15 12:10:19.966661 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.966535 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 12:10:19.966661 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.966566 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 12:10:19.966834 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.966818 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 12:10:19.974900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:19.974875 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr"] Jul 15 12:10:20.080421 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.080376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b72869-e55e-42d4-ade2-fb15c07558cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.080421 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.080427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx72p\" (UniqueName: \"kubernetes.io/projected/c0b72869-e55e-42d4-ade2-fb15c07558cd-kube-api-access-zx72p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.080674 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.080457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.080674 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.080475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.080674 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.080582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.080674 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.080617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182046 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.181997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182237 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182237 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182237 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182237 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b72869-e55e-42d4-ade2-fb15c07558cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182237 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx72p\" (UniqueName: \"kubernetes.io/projected/c0b72869-e55e-42d4-ade2-fb15c07558cd-kube-api-access-zx72p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182500 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182421 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182500 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182468 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.182500 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.182489 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.184944 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.184909 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b72869-e55e-42d4-ade2-fb15c07558cd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.185110 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.185074 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b72869-e55e-42d4-ade2-fb15c07558cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.192690 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.192664 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx72p\" (UniqueName: \"kubernetes.io/projected/c0b72869-e55e-42d4-ade2-fb15c07558cd-kube-api-access-zx72p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksqvr\" (UID: \"c0b72869-e55e-42d4-ade2-fb15c07558cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.274164 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.274068 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:20.411824 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.411795 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr"] Jul 15 12:10:20.415544 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:10:20.415518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b72869_e55e_42d4_ade2_fb15c07558cd.slice/crio-5359a4c6177a62505e48e561641212dbdfffba07dce0312fd7bd858082fd2fe3 WatchSource:0}: Error finding container 5359a4c6177a62505e48e561641212dbdfffba07dce0312fd7bd858082fd2fe3: Status 404 returned error can't find the container with id 5359a4c6177a62505e48e561641212dbdfffba07dce0312fd7bd858082fd2fe3 Jul 15 12:10:20.417130 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.417110 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 12:10:20.720473 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:20.720435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" event={"ID":"c0b72869-e55e-42d4-ade2-fb15c07558cd","Type":"ContainerStarted","Data":"5359a4c6177a62505e48e561641212dbdfffba07dce0312fd7bd858082fd2fe3"} Jul 15 12:10:22.730113 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:22.730077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" event={"ID":"c0b72869-e55e-42d4-ade2-fb15c07558cd","Type":"ContainerStarted","Data":"1701b0d50603b028f24d19ad4bc68c4060b9f659deac5f20136ab2e8d20a3eeb"} Jul 15 12:10:22.760558 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:22.760509 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" podStartSLOduration=2.4131601639999998 podStartE2EDuration="3.760492873s" totalImagesPullingTime="1.347332709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:10:22.759281862 +0000 UTC m=+687.432716856" watchObservedRunningTime="2026-07-15 12:10:22.760492873 +0000 UTC m=+687.433927839" Jul 15 12:10:30.274626 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:30.274585 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:30.275131 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:30.274668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:30.290206 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:30.290179 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:30.787447 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:30.787418 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksqvr" Jul 15 12:10:51.649581 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.649502 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr"] Jul 15 12:10:51.652775 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.652755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.655351 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.655331 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 12:10:51.662585 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.662560 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr"] Jul 15 12:10:51.755660 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.755627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgc5z\" (UniqueName: \"kubernetes.io/projected/47e90905-a3d4-4236-a146-ef2cf1e28280-kube-api-access-bgc5z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.755874 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.755668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.755874 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.755757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.755874 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.755785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.756071 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.755873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e90905-a3d4-4236-a146-ef2cf1e28280-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.756071 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.755900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.856611 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.856575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e90905-a3d4-4236-a146-ef2cf1e28280-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.856792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.856623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.856792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.856647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgc5z\" (UniqueName: \"kubernetes.io/projected/47e90905-a3d4-4236-a146-ef2cf1e28280-kube-api-access-bgc5z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.856792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.856681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.856792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.856721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.856792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.856748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.857104 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.857061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.857162 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.857122 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.857162 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.857145 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.858917 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.858895 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47e90905-a3d4-4236-a146-ef2cf1e28280-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.859074 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.859053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e90905-a3d4-4236-a146-ef2cf1e28280-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.864869 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.864847 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgc5z\" (UniqueName: \"kubernetes.io/projected/47e90905-a3d4-4236-a146-ef2cf1e28280-kube-api-access-bgc5z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr\" (UID: \"47e90905-a3d4-4236-a146-ef2cf1e28280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:51.963748 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:51.963660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:10:52.098562 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:52.098541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr"] Jul 15 12:10:52.100967 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:10:52.100943 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e90905_a3d4_4236_a146_ef2cf1e28280.slice/crio-7bd00c8f5a3e8dbf5d2c01bd754a17fcf49c091e3914ca55fc1868706391bb75 WatchSource:0}: Error finding container 7bd00c8f5a3e8dbf5d2c01bd754a17fcf49c091e3914ca55fc1868706391bb75: Status 404 returned error can't find the container with id 7bd00c8f5a3e8dbf5d2c01bd754a17fcf49c091e3914ca55fc1868706391bb75 Jul 15 12:10:52.875537 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:52.875502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" event={"ID":"47e90905-a3d4-4236-a146-ef2cf1e28280","Type":"ContainerStarted","Data":"46624f2cbe6f74dffaef710bbced3021f4c39e09263cf5f5fcff4f553a2108d7"} Jul 15 12:10:52.875537 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:52.875544 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" event={"ID":"47e90905-a3d4-4236-a146-ef2cf1e28280","Type":"ContainerStarted","Data":"7bd00c8f5a3e8dbf5d2c01bd754a17fcf49c091e3914ca55fc1868706391bb75"} Jul 15 12:10:52.894021 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:52.893959 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" podStartSLOduration=1.6751911000000002 podStartE2EDuration="1.893939381s" totalImagesPullingTime="218.748281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:10:52.893580428 +0000 UTC m=+717.567015432" watchObservedRunningTime="2026-07-15 12:10:52.893939381 +0000 UTC m=+717.567374349" Jul 15 12:10:55.645982 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.645946 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x"] Jul 15 12:10:55.649342 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.649318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.652170 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.652149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 12:10:55.661225 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.661196 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x"] Jul 15 12:10:55.795018 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.794977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.795018 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.795015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.795292 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.795118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.795292 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.795135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.795292 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.795161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.795292 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.795236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8vf\" (UniqueName: \"kubernetes.io/projected/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-kube-api-access-5w8vf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896248 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896248 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896248 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896477 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896477 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896477 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8vf\" (UniqueName: \"kubernetes.io/projected/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-kube-api-access-5w8vf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896649 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896702 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896677 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.896754 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.896737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.898391 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.898371 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.899009 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.898990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 12:10:55.904887 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.904860 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8vf\" (UniqueName: \"kubernetes.io/projected/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-kube-api-access-5w8vf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.909500 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.909479 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5zh7x\" (UID: \"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:55.959890 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:55.959836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:10:56.098855 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:56.098832 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x"] Jul 15 12:10:56.100970 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:10:56.100942 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f39ffe6_2699_4b8a_9a35_85c3ffcd1ae0.slice/crio-828edeab57032420a96fa3571762d3c1f79fe077e549a3b9d49e436f48fd2f2a WatchSource:0}: Error finding container 828edeab57032420a96fa3571762d3c1f79fe077e549a3b9d49e436f48fd2f2a: Status 404 returned error can't find the container with id 828edeab57032420a96fa3571762d3c1f79fe077e549a3b9d49e436f48fd2f2a Jul 15 12:10:56.900935 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:56.900895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" event={"ID":"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0","Type":"ContainerStarted","Data":"e0f7b28704d2992a348759c9f51ad4fd64dd91d558531e86d26d617ba26126b1"} Jul 15 12:10:56.901410 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:56.900961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" event={"ID":"5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0","Type":"ContainerStarted","Data":"828edeab57032420a96fa3571762d3c1f79fe077e549a3b9d49e436f48fd2f2a"} Jul 15 12:10:56.923806 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:10:56.923758 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" podStartSLOduration=1.7187213959999998 podStartE2EDuration="1.923741655s" totalImagesPullingTime="205.020259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:10:56.921159478 +0000 UTC m=+721.594594443" watchObservedRunningTime="2026-07-15 12:10:56.923741655 +0000 UTC m=+721.597176659" Jul 15 12:11:01.963907 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:01.963866 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:11:01.964522 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:01.963955 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:11:01.976679 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:01.976642 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:11:02.939364 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:02.939330 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr" Jul 15 12:11:05.960678 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:05.960650 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:11:05.961122 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:05.960974 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:11:05.973817 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:05.973786 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:11:06.958665 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:06.958634 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5zh7x" Jul 15 12:11:07.447907 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.447870 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s"] Jul 15 12:11:07.451362 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.451344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.453870 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.453846 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 15 12:11:07.462406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.462387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s"] Jul 15 12:11:07.600477 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.600452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.600585 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.600499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tp7g\" (UniqueName: \"kubernetes.io/projected/bfe8f023-067a-4449-8079-16d60c9e7e87-kube-api-access-7tp7g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.600585 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.600544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.600658 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.600589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.600658 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.600652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.600721 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.600679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe8f023-067a-4449-8079-16d60c9e7e87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701357 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701357 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tp7g\" (UniqueName: \"kubernetes.io/projected/bfe8f023-067a-4449-8079-16d60c9e7e87-kube-api-access-7tp7g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe8f023-067a-4449-8079-16d60c9e7e87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701891 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701866 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.701945 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.702102 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.701977 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.703759 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.703737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfe8f023-067a-4449-8079-16d60c9e7e87-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.703917 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.703900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe8f023-067a-4449-8079-16d60c9e7e87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.709259 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.709236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tp7g\" (UniqueName: \"kubernetes.io/projected/bfe8f023-067a-4449-8079-16d60c9e7e87-kube-api-access-7tp7g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s\" (UID: \"bfe8f023-067a-4449-8079-16d60c9e7e87\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.761199 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.761163 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:07.896263 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.896235 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s"] Jul 15 12:11:07.898423 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:11:07.898382 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfe8f023_067a_4449_8079_16d60c9e7e87.slice/crio-8bd68cd9ef3af3ac334f2ed0d865d1f57fe2dddb9a15253d603229d1c3e589d7 WatchSource:0}: Error finding container 8bd68cd9ef3af3ac334f2ed0d865d1f57fe2dddb9a15253d603229d1c3e589d7: Status 404 returned error can't find the container with id 8bd68cd9ef3af3ac334f2ed0d865d1f57fe2dddb9a15253d603229d1c3e589d7 Jul 15 12:11:07.953780 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:07.953690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" event={"ID":"bfe8f023-067a-4449-8079-16d60c9e7e87","Type":"ContainerStarted","Data":"8bd68cd9ef3af3ac334f2ed0d865d1f57fe2dddb9a15253d603229d1c3e589d7"} Jul 15 12:11:08.959674 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:08.959628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" event={"ID":"bfe8f023-067a-4449-8079-16d60c9e7e87","Type":"ContainerStarted","Data":"88a2c9352a7228e5ab60e8b14acae1b8bf6cc0d2383ceca7555bdb5d9dd6bbcb"} Jul 15 12:11:08.977974 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:08.977912 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" podStartSLOduration=1.785180583 podStartE2EDuration="1.977891392s" totalImagesPullingTime="192.710809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:08.977747403 +0000 UTC m=+733.651182385" watchObservedRunningTime="2026-07-15 12:11:08.977891392 +0000 UTC m=+733.651326361" Jul 15 12:11:17.761440 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:17.761401 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:17.761440 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:17.761447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:17.774358 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:17.774331 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:11:18.019353 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:11:18.019268 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s" Jul 15 12:12:04.566791 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.566751 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-566cddd969-kp84v"] Jul 15 12:12:04.567400 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.566957 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-566cddd969-kp84v" podUID="772924c1-a662-44e9-8d5e-36aaf2e89186" containerName="authorino" containerID="cri-o://0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273" gracePeriod=30 Jul 15 12:12:04.821394 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.821332 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:12:04.906735 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.906705 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4qzx\" (UniqueName: \"kubernetes.io/projected/772924c1-a662-44e9-8d5e-36aaf2e89186-kube-api-access-l4qzx\") pod \"772924c1-a662-44e9-8d5e-36aaf2e89186\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " Jul 15 12:12:04.906908 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.906742 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/772924c1-a662-44e9-8d5e-36aaf2e89186-tls-cert\") pod \"772924c1-a662-44e9-8d5e-36aaf2e89186\" (UID: \"772924c1-a662-44e9-8d5e-36aaf2e89186\") " Jul 15 12:12:04.908921 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.908890 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/772924c1-a662-44e9-8d5e-36aaf2e89186-kube-api-access-l4qzx" (OuterVolumeSpecName: "kube-api-access-l4qzx") pod "772924c1-a662-44e9-8d5e-36aaf2e89186" (UID: "772924c1-a662-44e9-8d5e-36aaf2e89186"). InnerVolumeSpecName "kube-api-access-l4qzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:12:04.917131 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:04.917107 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/772924c1-a662-44e9-8d5e-36aaf2e89186-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "772924c1-a662-44e9-8d5e-36aaf2e89186" (UID: "772924c1-a662-44e9-8d5e-36aaf2e89186"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:12:05.007720 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.007680 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4qzx\" (UniqueName: \"kubernetes.io/projected/772924c1-a662-44e9-8d5e-36aaf2e89186-kube-api-access-l4qzx\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:12:05.007720 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.007717 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/772924c1-a662-44e9-8d5e-36aaf2e89186-tls-cert\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:12:05.228736 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.228651 2559 generic.go:356] "Generic (PLEG): container finished" podID="772924c1-a662-44e9-8d5e-36aaf2e89186" containerID="0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273" exitCode=0 Jul 15 12:12:05.228736 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.228701 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566cddd969-kp84v" Jul 15 12:12:05.228920 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.228732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566cddd969-kp84v" event={"ID":"772924c1-a662-44e9-8d5e-36aaf2e89186","Type":"ContainerDied","Data":"0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273"} Jul 15 12:12:05.228920 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.228782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566cddd969-kp84v" event={"ID":"772924c1-a662-44e9-8d5e-36aaf2e89186","Type":"ContainerDied","Data":"c727bda6e1f61d92fbf2f8d68596219b23bcb02a96aa77c243f32fdfa2b4526d"} Jul 15 12:12:05.228920 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.228809 2559 scope.go:117] "RemoveContainer" containerID="0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273" Jul 15 12:12:05.237722 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.237703 2559 scope.go:117] "RemoveContainer" containerID="0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273" Jul 15 12:12:05.237984 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:12:05.237966 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273\": container with ID starting with 0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273 not found: ID does not exist" containerID="0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273" Jul 15 12:12:05.238066 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.237995 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273"} err="failed to get container status \"0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273\": rpc error: code = NotFound desc = could not find container \"0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273\": container with ID starting with 0d5ec02d8c21bc4bd30f1ae0ee40965c9561ba68c35e678a883d719022aac273 not found: ID does not exist" Jul 15 12:12:05.248923 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.248897 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-566cddd969-kp84v"] Jul 15 12:12:05.254451 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.254429 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-566cddd969-kp84v"] Jul 15 12:12:05.881139 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:12:05.881053 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="772924c1-a662-44e9-8d5e-36aaf2e89186" path="/var/lib/kubelet/pods/772924c1-a662-44e9-8d5e-36aaf2e89186/volumes" Jul 15 12:13:55.815304 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:13:55.815228 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:13:55.815819 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:13:55.815431 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:18:55.846899 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:18:55.846863 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:18:55.848877 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:18:55.848855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:23:55.872493 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:23:55.872462 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:23:55.876106 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:23:55.876082 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:25:08.831109 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.831076 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2"] Jul 15 12:25:08.832641 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.832613 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772924c1-a662-44e9-8d5e-36aaf2e89186" containerName="authorino" Jul 15 12:25:08.832641 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.832640 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="772924c1-a662-44e9-8d5e-36aaf2e89186" containerName="authorino" Jul 15 12:25:08.832789 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.832755 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="772924c1-a662-44e9-8d5e-36aaf2e89186" containerName="authorino" Jul 15 12:25:08.835947 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.835929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.838456 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.838439 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-548eb552-openshift-default-dockercfg-4kvn6\"" Jul 15 12:25:08.852602 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.852576 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2"] Jul 15 12:25:08.870600 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e1fe66-9b81-49be-8613-4ea778cc8d79-istiod-ca-cert\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870779 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-socket\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870779 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-data\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870779 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-credential-socket\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870779 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-envoy\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870955 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-certs\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870955 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24fdx\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-kube-api-access-24fdx\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.870955 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-token\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.871085 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.870957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-podinfo\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972113 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e1fe66-9b81-49be-8613-4ea778cc8d79-istiod-ca-cert\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972113 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-socket\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-data\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-credential-socket\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-envoy\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-certs\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24fdx\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-kube-api-access-24fdx\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-token\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-podinfo\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972747 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972633 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-certs\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972747 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972669 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-credential-socket\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972747 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-data\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972753 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-socket\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.972900 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.972865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e1fe66-9b81-49be-8613-4ea778cc8d79-istiod-ca-cert\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.974576 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.974553 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-envoy\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.974820 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.974801 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-podinfo\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.981411 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.981386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-token\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:08.981550 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:08.981469 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24fdx\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-kube-api-access-24fdx\") pod \"e2e-ait-548eb552-openshift-default-55f48cf687-v62z2\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:09.147230 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.147135 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:09.290620 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.290593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2"] Jul 15 12:25:09.293144 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:25:09.293103 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e1fe66_9b81_49be_8613_4ea778cc8d79.slice/crio-43c38eda0f5f16639754d903c5eee69cfb1b391778ba71096d01ec6529f6b138 WatchSource:0}: Error finding container 43c38eda0f5f16639754d903c5eee69cfb1b391778ba71096d01ec6529f6b138: Status 404 returned error can't find the container with id 43c38eda0f5f16639754d903c5eee69cfb1b391778ba71096d01ec6529f6b138 Jul 15 12:25:09.295466 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.295432 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:25:09.295530 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.295504 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:25:09.295567 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.295531 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:25:09.835238 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.835200 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" event={"ID":"85e1fe66-9b81-49be-8613-4ea778cc8d79","Type":"ContainerStarted","Data":"66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6"} Jul 15 12:25:09.835671 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.835259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" event={"ID":"85e1fe66-9b81-49be-8613-4ea778cc8d79","Type":"ContainerStarted","Data":"43c38eda0f5f16639754d903c5eee69cfb1b391778ba71096d01ec6529f6b138"} Jul 15 12:25:09.855723 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:09.855660 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podStartSLOduration=1.855644225 podStartE2EDuration="1.855644225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:25:09.854489272 +0000 UTC m=+1574.527924263" watchObservedRunningTime="2026-07-15 12:25:09.855644225 +0000 UTC m=+1574.529079191" Jul 15 12:25:10.147470 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:10.147390 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:10.152570 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:10.152390 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:10.839989 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:10.839958 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:10.840960 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:10.840940 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:20.889774 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:20.889681 2559 generic.go:356] "Generic (PLEG): container finished" podID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerID="66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6" exitCode=0 Jul 15 12:25:20.889774 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:20.889722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" event={"ID":"85e1fe66-9b81-49be-8613-4ea778cc8d79","Type":"ContainerDied","Data":"66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6"} Jul 15 12:25:20.890221 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:20.890128 2559 scope.go:117] "RemoveContainer" containerID="66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6" Jul 15 12:25:20.891216 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:20.891187 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:25:20.891282 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:20.891253 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:25:20.891317 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:20.891287 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 12:25:21.900545 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:21.900489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" event={"ID":"85e1fe66-9b81-49be-8613-4ea778cc8d79","Type":"ContainerStarted","Data":"4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d"} Jul 15 12:25:22.147658 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:22.147622 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:22.148743 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:22.148716 2559 patch_prober.go:28] interesting pod/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 15 12:25:22.148874 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:22.148776 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 15 12:25:23.147792 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:23.147758 2559 patch_prober.go:28] interesting pod/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 15 12:25:23.148302 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:23.147835 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 15 12:25:24.148241 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:24.148202 2559 patch_prober.go:28] interesting pod/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 15 12:25:24.148647 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:24.148275 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 15 12:25:25.148404 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:25.148343 2559 patch_prober.go:28] interesting pod/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 15 12:25:25.148807 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:25.148433 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 15 12:25:25.840860 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:25.840806 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:26.151715 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:26.151637 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:25:26.152666 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:25:26.152646 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:26:40.387520 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:40.387490 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2"] Jul 15 12:26:40.387985 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:40.387652 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" containerID="cri-o://4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d" gracePeriod=30 Jul 15 12:26:41.154807 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:41.154769 2559 patch_prober.go:28] interesting pod/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 12:26:41.154963 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:41.154822 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 12:26:45.637528 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.637500 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:26:45.698288 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698254 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-socket\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698429 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698314 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e1fe66-9b81-49be-8613-4ea778cc8d79-istiod-ca-cert\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698429 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-certs\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698536 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698488 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-data\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698536 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698503 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:26:45.698640 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698548 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-envoy\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698640 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698607 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-credential-socket\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698736 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698642 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-podinfo\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698736 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698636 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:26:45.698837 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698742 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24fdx\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-kube-api-access-24fdx\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.698837 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698768 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e1fe66-9b81-49be-8613-4ea778cc8d79-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 12:26:45.698943 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.698883 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:26:45.699054 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.699018 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-token\") pod \"85e1fe66-9b81-49be-8613-4ea778cc8d79\" (UID: \"85e1fe66-9b81-49be-8613-4ea778cc8d79\") " Jul 15 12:26:45.699578 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.699437 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-data" (OuterVolumeSpecName: "istio-data") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:26:45.699881 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.699859 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-socket\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.700026 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.699997 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e1fe66-9b81-49be-8613-4ea778cc8d79-istiod-ca-cert\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.700026 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.700020 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-workload-certs\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.700215 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.700059 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-data\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.700215 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.700074 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-credential-socket\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.701251 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.701177 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-kube-api-access-24fdx" (OuterVolumeSpecName: "kube-api-access-24fdx") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "kube-api-access-24fdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:26:45.701406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.701257 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 12:26:45.701406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.701276 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-token" (OuterVolumeSpecName: "istio-token") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:26:45.701406 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.701336 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85e1fe66-9b81-49be-8613-4ea778cc8d79" (UID: "85e1fe66-9b81-49be-8613-4ea778cc8d79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:26:45.800985 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.800952 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-envoy\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.800985 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.800979 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-podinfo\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.800985 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.800988 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24fdx\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-kube-api-access-24fdx\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:45.801247 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:45.800999 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e1fe66-9b81-49be-8613-4ea778cc8d79-istio-token\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:26:46.310193 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.310159 2559 generic.go:356] "Generic (PLEG): container finished" podID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerID="4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d" exitCode=0 Jul 15 12:26:46.310364 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.310209 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" Jul 15 12:26:46.310364 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.310244 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" event={"ID":"85e1fe66-9b81-49be-8613-4ea778cc8d79","Type":"ContainerDied","Data":"4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d"} Jul 15 12:26:46.310364 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.310299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2" event={"ID":"85e1fe66-9b81-49be-8613-4ea778cc8d79","Type":"ContainerDied","Data":"43c38eda0f5f16639754d903c5eee69cfb1b391778ba71096d01ec6529f6b138"} Jul 15 12:26:46.310364 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.310322 2559 scope.go:117] "RemoveContainer" containerID="4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d" Jul 15 12:26:46.319289 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.319271 2559 scope.go:117] "RemoveContainer" containerID="66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6" Jul 15 12:26:46.327223 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.327197 2559 scope.go:117] "RemoveContainer" containerID="4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d" Jul 15 12:26:46.327484 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:26:46.327465 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d\": container with ID starting with 4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d not found: ID does not exist" containerID="4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d" Jul 15 12:26:46.327541 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.327496 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d"} err="failed to get container status \"4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d\": rpc error: code = NotFound desc = could not find container \"4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d\": container with ID starting with 4c75591983b9da2b4f8912377d081fa5dd700c0782361ec3f8d0479915a5d85d not found: ID does not exist" Jul 15 12:26:46.327541 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.327523 2559 scope.go:117] "RemoveContainer" containerID="66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6" Jul 15 12:26:46.327745 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:26:46.327728 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6\": container with ID starting with 66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6 not found: ID does not exist" containerID="66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6" Jul 15 12:26:46.327790 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.327749 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6"} err="failed to get container status \"66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6\": rpc error: code = NotFound desc = could not find container \"66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6\": container with ID starting with 66365a39cd155e454fe675ccce722004b9a49802f75f98cda1dbd0c5326f73d6 not found: ID does not exist" Jul 15 12:26:46.328174 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.328155 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2"] Jul 15 12:26:46.331603 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:46.331582 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-548eb552-openshift-default-55f48cf687-v62z2"] Jul 15 12:26:47.881480 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:26:47.881450 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" path="/var/lib/kubelet/pods/85e1fe66-9b81-49be-8613-4ea778cc8d79/volumes" Jul 15 12:28:55.901125 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:28:55.901092 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:28:55.908563 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:28:55.908539 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:33:55.934432 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:33:55.934398 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:33:55.941134 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:33:55.941104 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:37:10.152860 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.152822 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4"] Jul 15 12:37:10.153383 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.153182 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" Jul 15 12:37:10.153383 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.153193 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" Jul 15 12:37:10.153383 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.153263 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" Jul 15 12:37:10.156192 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.156173 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.158921 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.158896 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6dba6e\"/\"openshift-service-ca.crt\"" Jul 15 12:37:10.159029 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.159016 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6dba6e\"/\"kube-root-ca.crt\"" Jul 15 12:37:10.159999 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.159984 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6dba6e\"/\"default-dockercfg-mwkcn\"" Jul 15 12:37:10.160085 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.160067 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6dba6e\"/\"test-model-6dba6e-kserve-self-signed-certs\"" Jul 15 12:37:10.165303 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.165278 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4"] Jul 15 12:37:10.261274 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.261232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-dshm\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.261274 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.261278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-home\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.261548 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.261306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3e299b-306e-46b6-9a2b-760af80c104c-tls-certs\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.261548 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.261387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9c4\" (UniqueName: \"kubernetes.io/projected/2c3e299b-306e-46b6-9a2b-760af80c104c-kube-api-access-rl9c4\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.261548 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.261492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-model-cache\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.261678 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.261563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-tmp-dir\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.362563 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-tmp-dir\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.362786 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-dshm\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.362786 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-home\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.362786 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3e299b-306e-46b6-9a2b-760af80c104c-tls-certs\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.362957 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9c4\" (UniqueName: \"kubernetes.io/projected/2c3e299b-306e-46b6-9a2b-760af80c104c-kube-api-access-rl9c4\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.362957 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-model-cache\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.363104 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.362968 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-tmp-dir\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.363154 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.363109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-home\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.363283 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.363264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-model-cache\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.365029 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.365005 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-dshm\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.365272 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.365254 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3e299b-306e-46b6-9a2b-760af80c104c-tls-certs\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.373050 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.373000 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9c4\" (UniqueName: \"kubernetes.io/projected/2c3e299b-306e-46b6-9a2b-760af80c104c-kube-api-access-rl9c4\") pod \"test-model-6dba6e-kserve-74cf9b6865-dc8w4\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.467248 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.467144 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:10.604886 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:10.604858 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4"] Jul 15 12:37:10.607119 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:37:10.607089 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c3e299b_306e_46b6_9a2b_760af80c104c.slice/crio-98292950dba158a3d4aad7bb48d4011f6cc09d5ef7c522c3a10e23fb4e96a164 WatchSource:0}: Error finding container 98292950dba158a3d4aad7bb48d4011f6cc09d5ef7c522c3a10e23fb4e96a164: Status 404 returned error can't find the container with id 98292950dba158a3d4aad7bb48d4011f6cc09d5ef7c522c3a10e23fb4e96a164 Jul 15 12:37:11.186104 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:11.186070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" event={"ID":"2c3e299b-306e-46b6-9a2b-760af80c104c","Type":"ContainerStarted","Data":"f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d"} Jul 15 12:37:11.186480 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:11.186121 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" event={"ID":"2c3e299b-306e-46b6-9a2b-760af80c104c","Type":"ContainerStarted","Data":"98292950dba158a3d4aad7bb48d4011f6cc09d5ef7c522c3a10e23fb4e96a164"} Jul 15 12:37:11.204821 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:11.204770 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" podStartSLOduration=1.204745354 podStartE2EDuration="1.204745354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:37:11.202280688 +0000 UTC m=+2295.875715653" watchObservedRunningTime="2026-07-15 12:37:11.204745354 +0000 UTC m=+2295.878180321" Jul 15 12:37:20.468245 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:20.468196 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:20.468245 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:20.468257 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:20.480921 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:20.480888 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:21.243125 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:21.243096 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:31.771309 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:31.771275 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4"] Jul 15 12:37:46.792283 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:46.792242 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" podUID="2c3e299b-306e-46b6-9a2b-760af80c104c" containerName="main" containerID="cri-o://f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d" gracePeriod=45 Jul 15 12:37:47.047408 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.047344 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:47.192018 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.191927 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3e299b-306e-46b6-9a2b-760af80c104c-tls-certs\") pod \"2c3e299b-306e-46b6-9a2b-760af80c104c\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " Jul 15 12:37:47.192018 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.191988 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-model-cache\") pod \"2c3e299b-306e-46b6-9a2b-760af80c104c\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " Jul 15 12:37:47.192225 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192023 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl9c4\" (UniqueName: \"kubernetes.io/projected/2c3e299b-306e-46b6-9a2b-760af80c104c-kube-api-access-rl9c4\") pod \"2c3e299b-306e-46b6-9a2b-760af80c104c\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " Jul 15 12:37:47.192225 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192114 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-dshm\") pod \"2c3e299b-306e-46b6-9a2b-760af80c104c\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " Jul 15 12:37:47.192225 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192156 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-home\") pod \"2c3e299b-306e-46b6-9a2b-760af80c104c\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " Jul 15 12:37:47.192225 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192200 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-tmp-dir\") pod \"2c3e299b-306e-46b6-9a2b-760af80c104c\" (UID: \"2c3e299b-306e-46b6-9a2b-760af80c104c\") " Jul 15 12:37:47.192428 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192294 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c3e299b-306e-46b6-9a2b-760af80c104c" (UID: "2c3e299b-306e-46b6-9a2b-760af80c104c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:37:47.192511 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192487 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c3e299b-306e-46b6-9a2b-760af80c104c" (UID: "2c3e299b-306e-46b6-9a2b-760af80c104c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:37:47.192579 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192516 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-model-cache\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:37:47.192579 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.192510 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-home" (OuterVolumeSpecName: "home") pod "2c3e299b-306e-46b6-9a2b-760af80c104c" (UID: "2c3e299b-306e-46b6-9a2b-760af80c104c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:37:47.194348 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.194315 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-dshm" (OuterVolumeSpecName: "dshm") pod "2c3e299b-306e-46b6-9a2b-760af80c104c" (UID: "2c3e299b-306e-46b6-9a2b-760af80c104c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:37:47.194469 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.194425 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3e299b-306e-46b6-9a2b-760af80c104c-kube-api-access-rl9c4" (OuterVolumeSpecName: "kube-api-access-rl9c4") pod "2c3e299b-306e-46b6-9a2b-760af80c104c" (UID: "2c3e299b-306e-46b6-9a2b-760af80c104c"). InnerVolumeSpecName "kube-api-access-rl9c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:37:47.194469 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.194423 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3e299b-306e-46b6-9a2b-760af80c104c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c3e299b-306e-46b6-9a2b-760af80c104c" (UID: "2c3e299b-306e-46b6-9a2b-760af80c104c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:37:47.293714 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.293680 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl9c4\" (UniqueName: \"kubernetes.io/projected/2c3e299b-306e-46b6-9a2b-760af80c104c-kube-api-access-rl9c4\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:37:47.293714 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.293710 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-dshm\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:37:47.293714 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.293722 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-home\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:37:47.293950 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.293757 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3e299b-306e-46b6-9a2b-760af80c104c-tmp-dir\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:37:47.293950 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.293766 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3e299b-306e-46b6-9a2b-760af80c104c-tls-certs\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:37:47.353092 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.352988 2559 generic.go:356] "Generic (PLEG): container finished" podID="2c3e299b-306e-46b6-9a2b-760af80c104c" containerID="f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d" exitCode=0 Jul 15 12:37:47.353092 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.353027 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" Jul 15 12:37:47.353092 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.353073 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" event={"ID":"2c3e299b-306e-46b6-9a2b-760af80c104c","Type":"ContainerDied","Data":"f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d"} Jul 15 12:37:47.353342 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.353120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4" event={"ID":"2c3e299b-306e-46b6-9a2b-760af80c104c","Type":"ContainerDied","Data":"98292950dba158a3d4aad7bb48d4011f6cc09d5ef7c522c3a10e23fb4e96a164"} Jul 15 12:37:47.353342 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.353137 2559 scope.go:117] "RemoveContainer" containerID="f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d" Jul 15 12:37:47.362296 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.362282 2559 scope.go:117] "RemoveContainer" containerID="f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d" Jul 15 12:37:47.362525 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:37:47.362505 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d\": container with ID starting with f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d not found: ID does not exist" containerID="f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d" Jul 15 12:37:47.362563 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.362539 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d"} err="failed to get container status \"f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d\": rpc error: code = NotFound desc = could not find container \"f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d\": container with ID starting with f9399a9c640bcb1e0164209e5b05f51e4d4d3000ffbd4b5e9e70adf7bc0c6c0d not found: ID does not exist" Jul 15 12:37:47.373783 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.373759 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4"] Jul 15 12:37:47.377472 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.377452 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6dba6e/test-model-6dba6e-kserve-74cf9b6865-dc8w4"] Jul 15 12:37:47.881376 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:37:47.881343 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3e299b-306e-46b6-9a2b-760af80c104c" path="/var/lib/kubelet/pods/2c3e299b-306e-46b6-9a2b-760af80c104c/volumes" Jul 15 12:38:55.961240 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:38:55.961209 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:38:55.968652 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:38:55.968631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:40:22.743085 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743048 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr"] Jul 15 12:40:22.745325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743438 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3e299b-306e-46b6-9a2b-760af80c104c" containerName="main" Jul 15 12:40:22.745325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743454 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3e299b-306e-46b6-9a2b-760af80c104c" containerName="main" Jul 15 12:40:22.745325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743471 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" Jul 15 12:40:22.745325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743478 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" Jul 15 12:40:22.745325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743542 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e1fe66-9b81-49be-8613-4ea778cc8d79" containerName="istio-proxy" Jul 15 12:40:22.745325 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.743551 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3e299b-306e-46b6-9a2b-760af80c104c" containerName="main" Jul 15 12:40:22.746390 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.746376 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.748925 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.748895 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a9c7da\"/\"kube-root-ca.crt\"" Jul 15 12:40:22.748925 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.748895 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a9c7da\"/\"openshift-service-ca.crt\"" Jul 15 12:40:22.749904 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.749883 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a9c7da\"/\"default-dockercfg-l5mp8\"" Jul 15 12:40:22.749904 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.749893 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a9c7da\"/\"auth-test-model-a9c7da-kserve-self-signed-certs\"" Jul 15 12:40:22.756741 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.756719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr"] Jul 15 12:40:22.889125 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.889091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-model-cache\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.889315 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.889141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-tmp-dir\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.889315 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.889239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7840b60c-325f-425c-a95d-62baf8e38b66-tls-certs\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.889315 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.889291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-home\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.889425 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.889336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7p4\" (UniqueName: \"kubernetes.io/projected/7840b60c-325f-425c-a95d-62baf8e38b66-kube-api-access-zj7p4\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.889425 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.889356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-dshm\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990127 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-home\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990127 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7p4\" (UniqueName: \"kubernetes.io/projected/7840b60c-325f-425c-a95d-62baf8e38b66-kube-api-access-zj7p4\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990359 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-dshm\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990359 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-model-cache\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990359 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-tmp-dir\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990359 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7840b60c-325f-425c-a95d-62baf8e38b66-tls-certs\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990603 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-home\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990667 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990640 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-model-cache\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.990720 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.990697 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-tmp-dir\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.992409 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.992388 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-dshm\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.992680 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.992662 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7840b60c-325f-425c-a95d-62baf8e38b66-tls-certs\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:22.998000 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:22.997940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7p4\" (UniqueName: \"kubernetes.io/projected/7840b60c-325f-425c-a95d-62baf8e38b66-kube-api-access-zj7p4\") pod \"auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:23.056742 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:23.056694 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:23.198277 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:23.198247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr"] Jul 15 12:40:23.200195 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:40:23.200167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7840b60c_325f_425c_a95d_62baf8e38b66.slice/crio-78f03d9c5dfb28932537d676415a8a5d69427f708aaa9136b40da837ffde6ca2 WatchSource:0}: Error finding container 78f03d9c5dfb28932537d676415a8a5d69427f708aaa9136b40da837ffde6ca2: Status 404 returned error can't find the container with id 78f03d9c5dfb28932537d676415a8a5d69427f708aaa9136b40da837ffde6ca2 Jul 15 12:40:24.075019 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:24.074986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" event={"ID":"7840b60c-325f-425c-a95d-62baf8e38b66","Type":"ContainerStarted","Data":"bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82"} Jul 15 12:40:24.075019 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:24.075044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" event={"ID":"7840b60c-325f-425c-a95d-62baf8e38b66","Type":"ContainerStarted","Data":"78f03d9c5dfb28932537d676415a8a5d69427f708aaa9136b40da837ffde6ca2"} Jul 15 12:40:24.092347 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:24.092293 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" podStartSLOduration=2.092275861 podStartE2EDuration="2.092275861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:40:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:40:24.09150217 +0000 UTC m=+2488.764937204" watchObservedRunningTime="2026-07-15 12:40:24.092275861 +0000 UTC m=+2488.765710828" Jul 15 12:40:33.057899 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:33.057851 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:33.058377 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:33.057921 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:33.070117 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:33.070087 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:40:33.142685 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:40:33.142650 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:42:55.200293 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:42:55.200260 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr"] Jul 15 12:43:10.803349 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:10.803299 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" podUID="7840b60c-325f-425c-a95d-62baf8e38b66" containerName="main" containerID="cri-o://bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82" gracePeriod=45 Jul 15 12:43:11.062705 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.062642 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:43:11.121101 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121063 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-tmp-dir\") pod \"7840b60c-325f-425c-a95d-62baf8e38b66\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " Jul 15 12:43:11.121272 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121120 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-dshm\") pod \"7840b60c-325f-425c-a95d-62baf8e38b66\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " Jul 15 12:43:11.121272 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121165 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj7p4\" (UniqueName: \"kubernetes.io/projected/7840b60c-325f-425c-a95d-62baf8e38b66-kube-api-access-zj7p4\") pod \"7840b60c-325f-425c-a95d-62baf8e38b66\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " Jul 15 12:43:11.121272 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121217 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-home\") pod \"7840b60c-325f-425c-a95d-62baf8e38b66\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " Jul 15 12:43:11.121449 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121279 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-model-cache\") pod \"7840b60c-325f-425c-a95d-62baf8e38b66\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " Jul 15 12:43:11.121449 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121306 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7840b60c-325f-425c-a95d-62baf8e38b66-tls-certs\") pod \"7840b60c-325f-425c-a95d-62baf8e38b66\" (UID: \"7840b60c-325f-425c-a95d-62baf8e38b66\") " Jul 15 12:43:11.121449 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121388 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7840b60c-325f-425c-a95d-62baf8e38b66" (UID: "7840b60c-325f-425c-a95d-62baf8e38b66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:43:11.121594 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121543 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-home" (OuterVolumeSpecName: "home") pod "7840b60c-325f-425c-a95d-62baf8e38b66" (UID: "7840b60c-325f-425c-a95d-62baf8e38b66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:43:11.121594 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121549 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-model-cache" (OuterVolumeSpecName: "model-cache") pod "7840b60c-325f-425c-a95d-62baf8e38b66" (UID: "7840b60c-325f-425c-a95d-62baf8e38b66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:43:11.121673 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121658 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-home\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:43:11.121717 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121677 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-model-cache\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:43:11.121717 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.121692 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-tmp-dir\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:43:11.123475 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.123447 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840b60c-325f-425c-a95d-62baf8e38b66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7840b60c-325f-425c-a95d-62baf8e38b66" (UID: "7840b60c-325f-425c-a95d-62baf8e38b66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:43:11.123661 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.123645 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-dshm" (OuterVolumeSpecName: "dshm") pod "7840b60c-325f-425c-a95d-62baf8e38b66" (UID: "7840b60c-325f-425c-a95d-62baf8e38b66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:43:11.123732 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.123674 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7840b60c-325f-425c-a95d-62baf8e38b66-kube-api-access-zj7p4" (OuterVolumeSpecName: "kube-api-access-zj7p4") pod "7840b60c-325f-425c-a95d-62baf8e38b66" (UID: "7840b60c-325f-425c-a95d-62baf8e38b66"). InnerVolumeSpecName "kube-api-access-zj7p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:43:11.223202 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.223164 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj7p4\" (UniqueName: \"kubernetes.io/projected/7840b60c-325f-425c-a95d-62baf8e38b66-kube-api-access-zj7p4\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:43:11.223202 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.223202 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7840b60c-325f-425c-a95d-62baf8e38b66-tls-certs\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:43:11.223414 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.223214 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7840b60c-325f-425c-a95d-62baf8e38b66-dshm\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:43:11.857361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.857331 2559 generic.go:356] "Generic (PLEG): container finished" podID="7840b60c-325f-425c-a95d-62baf8e38b66" containerID="bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82" exitCode=0 Jul 15 12:43:11.857774 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.857368 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" Jul 15 12:43:11.857774 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.857409 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" event={"ID":"7840b60c-325f-425c-a95d-62baf8e38b66","Type":"ContainerDied","Data":"bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82"} Jul 15 12:43:11.857774 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.857453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr" event={"ID":"7840b60c-325f-425c-a95d-62baf8e38b66","Type":"ContainerDied","Data":"78f03d9c5dfb28932537d676415a8a5d69427f708aaa9136b40da837ffde6ca2"} Jul 15 12:43:11.857774 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.857471 2559 scope.go:117] "RemoveContainer" containerID="bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82" Jul 15 12:43:11.867010 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.866992 2559 scope.go:117] "RemoveContainer" containerID="bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82" Jul 15 12:43:11.867356 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:43:11.867333 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82\": container with ID starting with bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82 not found: ID does not exist" containerID="bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82" Jul 15 12:43:11.867400 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.867365 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82"} err="failed to get container status \"bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82\": rpc error: code = NotFound desc = could not find container \"bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82\": container with ID starting with bf68e3937d2c3f9f884bfc1acb2aa7686dfa73caf256b4383611d98447509e82 not found: ID does not exist" Jul 15 12:43:11.884832 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.884803 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr"] Jul 15 12:43:11.885627 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:11.885603 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a9c7da/auth-test-model-a9c7da-kserve-6745dcbc8c-z8pxr"] Jul 15 12:43:13.881266 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:13.881232 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7840b60c-325f-425c-a95d-62baf8e38b66" path="/var/lib/kubelet/pods/7840b60c-325f-425c-a95d-62baf8e38b66/volumes" Jul 15 12:43:21.745431 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.745388 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh"] Jul 15 12:43:21.745892 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.745793 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7840b60c-325f-425c-a95d-62baf8e38b66" containerName="main" Jul 15 12:43:21.745892 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.745805 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7840b60c-325f-425c-a95d-62baf8e38b66" containerName="main" Jul 15 12:43:21.745892 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.745864 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7840b60c-325f-425c-a95d-62baf8e38b66" containerName="main" Jul 15 12:43:21.750322 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.750297 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:21.754189 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.754136 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"openshift-service-ca.crt\"" Jul 15 12:43:21.754189 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.754147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"default-dockercfg-24brn\"" Jul 15 12:43:21.754189 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.754148 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"sub-test-model-b2e819-kserve-self-signed-certs\"" Jul 15 12:43:21.754502 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.754177 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"kube-root-ca.crt\"" Jul 15 12:43:21.757917 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.757744 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh"] Jul 15 12:43:21.926525 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.926478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpmg\" (UniqueName: \"kubernetes.io/projected/5003808f-ae79-4128-bc72-1d279e26465f-kube-api-access-hdpmg\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:21.926525 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.926531 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-tmp-dir\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:21.926759 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.926645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-home\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:21.926759 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.926728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5003808f-ae79-4128-bc72-1d279e26465f-tls-certs\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:21.926826 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.926758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-model-cache\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:21.926826 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:21.926802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-dshm\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.027820 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.027730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-dshm\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.027820 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.027775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpmg\" (UniqueName: \"kubernetes.io/projected/5003808f-ae79-4128-bc72-1d279e26465f-kube-api-access-hdpmg\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.027820 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.027793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-tmp-dir\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.028106 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.027826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-home\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.028106 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.027868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5003808f-ae79-4128-bc72-1d279e26465f-tls-certs\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.028106 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.027896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-model-cache\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.028351 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.028319 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-tmp-dir\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.028351 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.028340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-model-cache\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.028511 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.028373 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-home\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.030012 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.029991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-dshm\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.030328 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.030310 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5003808f-ae79-4128-bc72-1d279e26465f-tls-certs\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.035489 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.035464 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpmg\" (UniqueName: \"kubernetes.io/projected/5003808f-ae79-4128-bc72-1d279e26465f-kube-api-access-hdpmg\") pod \"sub-test-model-b2e819-kserve-5fb98844b5-7wwqh\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.060530 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.060493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:22.194889 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.194860 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh"] Jul 15 12:43:22.196609 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:43:22.196570 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5003808f_ae79_4128_bc72_1d279e26465f.slice/crio-dc99942607b1befbf603996c2b9a89872906e9db651a03f7d5a59ba55c1fe11e WatchSource:0}: Error finding container dc99942607b1befbf603996c2b9a89872906e9db651a03f7d5a59ba55c1fe11e: Status 404 returned error can't find the container with id dc99942607b1befbf603996c2b9a89872906e9db651a03f7d5a59ba55c1fe11e Jul 15 12:43:22.910655 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.910619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" event={"ID":"5003808f-ae79-4128-bc72-1d279e26465f","Type":"ContainerStarted","Data":"409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253"} Jul 15 12:43:22.910655 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.910659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" event={"ID":"5003808f-ae79-4128-bc72-1d279e26465f","Type":"ContainerStarted","Data":"dc99942607b1befbf603996c2b9a89872906e9db651a03f7d5a59ba55c1fe11e"} Jul 15 12:43:22.929442 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:22.929380 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" podStartSLOduration=1.929358901 podStartE2EDuration="1.929358901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:43:22.927388622 +0000 UTC m=+2667.600823601" watchObservedRunningTime="2026-07-15 12:43:22.929358901 +0000 UTC m=+2667.602793871" Jul 15 12:43:32.061173 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:32.061127 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:32.061621 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:32.061187 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:32.073881 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:32.073851 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:32.970434 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:32.970403 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:43:55.993166 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:55.993087 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:43:55.999967 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:55.999942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvb46_ab6cd076-4bb6-4544-af0f-23f06e8b89d5/ovn-acl-logging/0.log" Jul 15 12:43:57.676078 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:43:57.676030 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh"] Jul 15 12:44:12.696898 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:12.696826 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" podUID="5003808f-ae79-4128-bc72-1d279e26465f" containerName="main" containerID="cri-o://409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253" gracePeriod=45 Jul 15 12:44:12.950005 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:12.949945 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:44:13.087222 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087185 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdpmg\" (UniqueName: \"kubernetes.io/projected/5003808f-ae79-4128-bc72-1d279e26465f-kube-api-access-hdpmg\") pod \"5003808f-ae79-4128-bc72-1d279e26465f\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " Jul 15 12:44:13.087420 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087266 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-dshm\") pod \"5003808f-ae79-4128-bc72-1d279e26465f\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " Jul 15 12:44:13.087420 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087315 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-model-cache\") pod \"5003808f-ae79-4128-bc72-1d279e26465f\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " Jul 15 12:44:13.087420 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087349 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-tmp-dir\") pod \"5003808f-ae79-4128-bc72-1d279e26465f\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " Jul 15 12:44:13.087420 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087374 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-home\") pod \"5003808f-ae79-4128-bc72-1d279e26465f\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " Jul 15 12:44:13.087420 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087411 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5003808f-ae79-4128-bc72-1d279e26465f-tls-certs\") pod \"5003808f-ae79-4128-bc72-1d279e26465f\" (UID: \"5003808f-ae79-4128-bc72-1d279e26465f\") " Jul 15 12:44:13.087669 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087642 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-model-cache" (OuterVolumeSpecName: "model-cache") pod "5003808f-ae79-4128-bc72-1d279e26465f" (UID: "5003808f-ae79-4128-bc72-1d279e26465f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:44:13.087722 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087666 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5003808f-ae79-4128-bc72-1d279e26465f" (UID: "5003808f-ae79-4128-bc72-1d279e26465f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:44:13.087775 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087744 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-model-cache\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:44:13.087775 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087763 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-tmp-dir\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:44:13.087944 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.087918 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-home" (OuterVolumeSpecName: "home") pod "5003808f-ae79-4128-bc72-1d279e26465f" (UID: "5003808f-ae79-4128-bc72-1d279e26465f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:44:13.089566 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.089531 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5003808f-ae79-4128-bc72-1d279e26465f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5003808f-ae79-4128-bc72-1d279e26465f" (UID: "5003808f-ae79-4128-bc72-1d279e26465f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:44:13.089679 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.089572 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-dshm" (OuterVolumeSpecName: "dshm") pod "5003808f-ae79-4128-bc72-1d279e26465f" (UID: "5003808f-ae79-4128-bc72-1d279e26465f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:44:13.089679 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.089583 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5003808f-ae79-4128-bc72-1d279e26465f-kube-api-access-hdpmg" (OuterVolumeSpecName: "kube-api-access-hdpmg") pod "5003808f-ae79-4128-bc72-1d279e26465f" (UID: "5003808f-ae79-4128-bc72-1d279e26465f"). InnerVolumeSpecName "kube-api-access-hdpmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:44:13.144627 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.144585 2559 generic.go:356] "Generic (PLEG): container finished" podID="5003808f-ae79-4128-bc72-1d279e26465f" containerID="409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253" exitCode=0 Jul 15 12:44:13.144807 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.144633 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" Jul 15 12:44:13.144807 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.144638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" event={"ID":"5003808f-ae79-4128-bc72-1d279e26465f","Type":"ContainerDied","Data":"409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253"} Jul 15 12:44:13.144807 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.144678 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh" event={"ID":"5003808f-ae79-4128-bc72-1d279e26465f","Type":"ContainerDied","Data":"dc99942607b1befbf603996c2b9a89872906e9db651a03f7d5a59ba55c1fe11e"} Jul 15 12:44:13.144807 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.144700 2559 scope.go:117] "RemoveContainer" containerID="409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253" Jul 15 12:44:13.153756 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.153737 2559 scope.go:117] "RemoveContainer" containerID="409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253" Jul 15 12:44:13.154013 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:44:13.153996 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253\": container with ID starting with 409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253 not found: ID does not exist" containerID="409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253" Jul 15 12:44:13.154098 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.154021 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253"} err="failed to get container status \"409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253\": rpc error: code = NotFound desc = could not find container \"409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253\": container with ID starting with 409d9a3c373262ec794f2fad5a55cf9d8b4c9063261bc311a7dde2b0ddec1253 not found: ID does not exist" Jul 15 12:44:13.165199 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.165174 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh"] Jul 15 12:44:13.168993 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.168971 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/sub-test-model-b2e819-kserve-5fb98844b5-7wwqh"] Jul 15 12:44:13.189028 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.188999 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdpmg\" (UniqueName: \"kubernetes.io/projected/5003808f-ae79-4128-bc72-1d279e26465f-kube-api-access-hdpmg\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:44:13.189028 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.189025 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-dshm\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:44:13.189203 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.189058 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5003808f-ae79-4128-bc72-1d279e26465f-home\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:44:13.189203 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.189067 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5003808f-ae79-4128-bc72-1d279e26465f-tls-certs\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:44:13.881637 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:44:13.881601 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5003808f-ae79-4128-bc72-1d279e26465f" path="/var/lib/kubelet/pods/5003808f-ae79-4128-bc72-1d279e26465f/volumes" Jul 15 12:45:00.246729 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.246688 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls"] Jul 15 12:45:00.247265 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.247248 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5003808f-ae79-4128-bc72-1d279e26465f" containerName="main" Jul 15 12:45:00.247314 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.247268 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5003808f-ae79-4128-bc72-1d279e26465f" containerName="main" Jul 15 12:45:00.247383 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.247370 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5003808f-ae79-4128-bc72-1d279e26465f" containerName="main" Jul 15 12:45:00.251626 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.251606 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.255581 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.255559 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"rate-test-model-b2e819-kserve-self-signed-certs\"" Jul 15 12:45:00.256530 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.256509 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"openshift-service-ca.crt\"" Jul 15 12:45:00.256657 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.256572 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"default-dockercfg-24brn\"" Jul 15 12:45:00.256657 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.256649 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b2e819\"/\"kube-root-ca.crt\"" Jul 15 12:45:00.269464 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.269432 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls"] Jul 15 12:45:00.414261 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.414223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-home\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.414491 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.414301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-dshm\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.414491 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.414333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-model-cache\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.414491 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.414365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjqqq\" (UniqueName: \"kubernetes.io/projected/b94cd3c6-90cc-49a0-b7b5-0f006af532af-kube-api-access-xjqqq\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.414491 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.414419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tls-certs\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.414491 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.414471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tmp-dir\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.515682 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.515573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-dshm\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.515682 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.515626 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-model-cache\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.515937 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.515752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqqq\" (UniqueName: \"kubernetes.io/projected/b94cd3c6-90cc-49a0-b7b5-0f006af532af-kube-api-access-xjqqq\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.515937 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.515839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tls-certs\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.515937 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.515904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tmp-dir\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.516140 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.515952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-home\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.516140 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.516078 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-model-cache\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.516288 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.516258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-home\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.516404 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.516312 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tmp-dir\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.518048 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.518016 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-dshm\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.518311 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.518291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tls-certs\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.525604 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.525534 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqqq\" (UniqueName: \"kubernetes.io/projected/b94cd3c6-90cc-49a0-b7b5-0f006af532af-kube-api-access-xjqqq\") pod \"rate-test-model-b2e819-kserve-6f9b7fc6c-gltls\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.562524 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.562486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:00.698646 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:00.698620 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls"] Jul 15 12:45:00.701300 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:45:00.701274 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb94cd3c6_90cc_49a0_b7b5_0f006af532af.slice/crio-d4836ceff2084a9c2f7717473da8dba01e3f436805da338fd47e6ab0971244ce WatchSource:0}: Error finding container d4836ceff2084a9c2f7717473da8dba01e3f436805da338fd47e6ab0971244ce: Status 404 returned error can't find the container with id d4836ceff2084a9c2f7717473da8dba01e3f436805da338fd47e6ab0971244ce Jul 15 12:45:01.372518 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:01.372477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" event={"ID":"b94cd3c6-90cc-49a0-b7b5-0f006af532af","Type":"ContainerStarted","Data":"4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122"} Jul 15 12:45:01.373012 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:01.372526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" event={"ID":"b94cd3c6-90cc-49a0-b7b5-0f006af532af","Type":"ContainerStarted","Data":"d4836ceff2084a9c2f7717473da8dba01e3f436805da338fd47e6ab0971244ce"} Jul 15 12:45:01.393174 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:01.393110 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" podStartSLOduration=1.393089739 podStartE2EDuration="1.393089739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:45:01.392239679 +0000 UTC m=+2766.065674647" watchObservedRunningTime="2026-07-15 12:45:01.393089739 +0000 UTC m=+2766.066524707" Jul 15 12:45:10.563652 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:10.563605 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:10.564189 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:10.563671 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:10.576188 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:10.576163 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:11.429800 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:11.429765 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:45:47.940227 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:45:47.940189 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls"] Jul 15 12:46:02.960735 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:02.960656 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" podUID="b94cd3c6-90cc-49a0-b7b5-0f006af532af" containerName="main" containerID="cri-o://4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122" gracePeriod=45 Jul 15 12:46:03.205345 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.205311 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:46:03.287418 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287385 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-home\") pod \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " Jul 15 12:46:03.287591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287452 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjqqq\" (UniqueName: \"kubernetes.io/projected/b94cd3c6-90cc-49a0-b7b5-0f006af532af-kube-api-access-xjqqq\") pod \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " Jul 15 12:46:03.287591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287475 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-dshm\") pod \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " Jul 15 12:46:03.287591 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287548 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-model-cache\") pod \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " Jul 15 12:46:03.287765 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287591 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tls-certs\") pod \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " Jul 15 12:46:03.287765 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287620 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tmp-dir\") pod \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\" (UID: \"b94cd3c6-90cc-49a0-b7b5-0f006af532af\") " Jul 15 12:46:03.287765 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287669 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-home" (OuterVolumeSpecName: "home") pod "b94cd3c6-90cc-49a0-b7b5-0f006af532af" (UID: "b94cd3c6-90cc-49a0-b7b5-0f006af532af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:46:03.287914 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287875 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b94cd3c6-90cc-49a0-b7b5-0f006af532af" (UID: "b94cd3c6-90cc-49a0-b7b5-0f006af532af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:46:03.287914 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287883 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-home\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:03.288010 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.287887 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-model-cache" (OuterVolumeSpecName: "model-cache") pod "b94cd3c6-90cc-49a0-b7b5-0f006af532af" (UID: "b94cd3c6-90cc-49a0-b7b5-0f006af532af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:46:03.289768 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.289726 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b94cd3c6-90cc-49a0-b7b5-0f006af532af" (UID: "b94cd3c6-90cc-49a0-b7b5-0f006af532af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:46:03.289768 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.289750 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-dshm" (OuterVolumeSpecName: "dshm") pod "b94cd3c6-90cc-49a0-b7b5-0f006af532af" (UID: "b94cd3c6-90cc-49a0-b7b5-0f006af532af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:46:03.289942 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.289744 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b94cd3c6-90cc-49a0-b7b5-0f006af532af-kube-api-access-xjqqq" (OuterVolumeSpecName: "kube-api-access-xjqqq") pod "b94cd3c6-90cc-49a0-b7b5-0f006af532af" (UID: "b94cd3c6-90cc-49a0-b7b5-0f006af532af"). InnerVolumeSpecName "kube-api-access-xjqqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:46:03.388956 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.388923 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-model-cache\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:03.388956 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.388952 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tls-certs\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:03.388956 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.388960 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-tmp-dir\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:03.389213 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.388971 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjqqq\" (UniqueName: \"kubernetes.io/projected/b94cd3c6-90cc-49a0-b7b5-0f006af532af-kube-api-access-xjqqq\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:03.389213 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.388985 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b94cd3c6-90cc-49a0-b7b5-0f006af532af-dshm\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:03.664471 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.664375 2559 generic.go:356] "Generic (PLEG): container finished" podID="b94cd3c6-90cc-49a0-b7b5-0f006af532af" containerID="4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122" exitCode=0 Jul 15 12:46:03.664471 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.664436 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" Jul 15 12:46:03.664710 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.664461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" event={"ID":"b94cd3c6-90cc-49a0-b7b5-0f006af532af","Type":"ContainerDied","Data":"4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122"} Jul 15 12:46:03.664710 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.664507 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls" event={"ID":"b94cd3c6-90cc-49a0-b7b5-0f006af532af","Type":"ContainerDied","Data":"d4836ceff2084a9c2f7717473da8dba01e3f436805da338fd47e6ab0971244ce"} Jul 15 12:46:03.664710 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.664525 2559 scope.go:117] "RemoveContainer" containerID="4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122" Jul 15 12:46:03.673437 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.673417 2559 scope.go:117] "RemoveContainer" containerID="4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122" Jul 15 12:46:03.673729 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:46:03.673709 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122\": container with ID starting with 4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122 not found: ID does not exist" containerID="4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122" Jul 15 12:46:03.673775 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.673738 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122"} err="failed to get container status \"4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122\": rpc error: code = NotFound desc = could not find container \"4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122\": container with ID starting with 4d46fd42c10fb1be0efcee29457f0b3a8f3d0811daaf7fca95ea76f889ce6122 not found: ID does not exist" Jul 15 12:46:03.687654 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.687623 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls"] Jul 15 12:46:03.690782 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.690755 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b2e819/rate-test-model-b2e819-kserve-6f9b7fc6c-gltls"] Jul 15 12:46:03.839074 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.839046 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7615-140094017729856"] Jul 15 12:46:03.839434 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.839422 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94cd3c6-90cc-49a0-b7b5-0f006af532af" containerName="main" Jul 15 12:46:03.839494 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.839436 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94cd3c6-90cc-49a0-b7b5-0f006af532af" containerName="main" Jul 15 12:46:03.839494 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.839491 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94cd3c6-90cc-49a0-b7b5-0f006af532af" containerName="main" Jul 15 12:46:03.843582 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.843561 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:03.845891 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.845871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7xt2g\"" Jul 15 12:46:03.849027 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.849005 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7615-140094017729856"] Jul 15 12:46:03.881829 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.881797 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b94cd3c6-90cc-49a0-b7b5-0f006af532af" path="/var/lib/kubelet/pods/b94cd3c6-90cc-49a0-b7b5-0f006af532af/volumes" Jul 15 12:46:03.893266 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.893234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbskr\" (UniqueName: \"kubernetes.io/projected/8ef416c3-6550-45da-b319-e3943dd6bb2d-kube-api-access-vbskr\") pod \"test-curl-7615-140094017729856\" (UID: \"8ef416c3-6550-45da-b319-e3943dd6bb2d\") " pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:03.994732 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:03.994610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbskr\" (UniqueName: \"kubernetes.io/projected/8ef416c3-6550-45da-b319-e3943dd6bb2d-kube-api-access-vbskr\") pod \"test-curl-7615-140094017729856\" (UID: \"8ef416c3-6550-45da-b319-e3943dd6bb2d\") " pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:04.002343 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:04.002317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbskr\" (UniqueName: \"kubernetes.io/projected/8ef416c3-6550-45da-b319-e3943dd6bb2d-kube-api-access-vbskr\") pod \"test-curl-7615-140094017729856\" (UID: \"8ef416c3-6550-45da-b319-e3943dd6bb2d\") " pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:04.154260 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:04.154220 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:04.293928 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:04.293900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7615-140094017729856"] Jul 15 12:46:04.296801 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:46:04.296774 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ef416c3_6550_45da_b319_e3943dd6bb2d.slice/crio-2bec8baaa4488633cd48143e739148a2326aaf2d1960cdad809a75b31858c1ff WatchSource:0}: Error finding container 2bec8baaa4488633cd48143e739148a2326aaf2d1960cdad809a75b31858c1ff: Status 404 returned error can't find the container with id 2bec8baaa4488633cd48143e739148a2326aaf2d1960cdad809a75b31858c1ff Jul 15 12:46:04.298095 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:04.298077 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 12:46:04.674101 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:04.674001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7615-140094017729856" event={"ID":"8ef416c3-6550-45da-b319-e3943dd6bb2d","Type":"ContainerStarted","Data":"2bec8baaa4488633cd48143e739148a2326aaf2d1960cdad809a75b31858c1ff"} Jul 15 12:46:05.681809 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:05.681781 2559 generic.go:356] "Generic (PLEG): container finished" podID="8ef416c3-6550-45da-b319-e3943dd6bb2d" containerID="6c752fcabff901e2af571c49cb0ea6386a7620db0ffb49b7ea183234fbb549f2" exitCode=0 Jul 15 12:46:05.682232 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:05.681861 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7615-140094017729856" event={"ID":"8ef416c3-6550-45da-b319-e3943dd6bb2d","Type":"ContainerDied","Data":"6c752fcabff901e2af571c49cb0ea6386a7620db0ffb49b7ea183234fbb549f2"} Jul 15 12:46:06.823626 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:06.823600 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:06.859835 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:06.859782 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7615-140094017729856_8ef416c3-6550-45da-b319-e3943dd6bb2d/test-curl-7615-140094017729856/0.log" Jul 15 12:46:06.883733 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:06.883693 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7615-140094017729856"] Jul 15 12:46:06.887059 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:06.887019 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7615-140094017729856"] Jul 15 12:46:06.918419 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:06.918386 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbskr\" (UniqueName: \"kubernetes.io/projected/8ef416c3-6550-45da-b319-e3943dd6bb2d-kube-api-access-vbskr\") pod \"8ef416c3-6550-45da-b319-e3943dd6bb2d\" (UID: \"8ef416c3-6550-45da-b319-e3943dd6bb2d\") " Jul 15 12:46:06.920594 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:06.920562 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef416c3-6550-45da-b319-e3943dd6bb2d-kube-api-access-vbskr" (OuterVolumeSpecName: "kube-api-access-vbskr") pod "8ef416c3-6550-45da-b319-e3943dd6bb2d" (UID: "8ef416c3-6550-45da-b319-e3943dd6bb2d"). InnerVolumeSpecName "kube-api-access-vbskr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:46:07.019264 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:07.019178 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbskr\" (UniqueName: \"kubernetes.io/projected/8ef416c3-6550-45da-b319-e3943dd6bb2d-kube-api-access-vbskr\") on node \"ip-10-0-139-5.ec2.internal\" DevicePath \"\"" Jul 15 12:46:07.693636 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:07.693608 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bec8baaa4488633cd48143e739148a2326aaf2d1960cdad809a75b31858c1ff" Jul 15 12:46:07.693636 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:07.693619 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:07.703763 ip-10-0-139-5 kubenswrapper[2559]: E0715 12:46:07.703733 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7615-140094017729856\" is forbidden: User \"system:node:ip-10-0-139-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-5.ec2.internal' and this object" podUID="8ef416c3-6550-45da-b319-e3943dd6bb2d" pod="opendatahub/test-curl-7615-140094017729856" Jul 15 12:46:07.881575 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:46:07.881545 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef416c3-6550-45da-b319-e3943dd6bb2d" path="/var/lib/kubelet/pods/8ef416c3-6550-45da-b319-e3943dd6bb2d/volumes" Jul 15 12:47:05.488830 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:05.488737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hn88s_fac403d0-9702-4904-9b62-21141fa14dd2/manager/0.log" Jul 15 12:47:06.088410 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:06.088385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694c4fcbc8-kkgm4_fc1bbc0a-9b1d-4c87-a211-42bc46c64495/copy-manifests/0.log" Jul 15 12:47:06.107843 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:06.107800 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694c4fcbc8-kkgm4_fc1bbc0a-9b1d-4c87-a211-42bc46c64495/manager/0.log" Jul 15 12:47:09.936183 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:09.936147 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgq8r_5a1e7ac8-449d-44bb-b18e-763d8ce32c48/manager/0.log" Jul 15 12:47:10.162479 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:10.162445 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8p4xz_d9c3ef83-740d-4889-8c2f-ce83bfc55fed/registry-server/0.log" Jul 15 12:47:10.546905 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:10.546864 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-smr2l_e133cf4e-5aaf-458e-8f45-b61610d59d5a/manager/0.log" Jul 15 12:47:10.909549 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:10.909467 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mrhcq_96672c7f-4628-4911-873f-ed2869d411cd/istio-proxy/0.log" Jul 15 12:47:11.413538 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:11.413509 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/1.log" Jul 15 12:47:11.536561 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:11.536529 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-vwdxs_943aad8a-8ba5-4154-905a-73708f993a7a/payload-pre-processing/0.log" Jul 15 12:47:11.660139 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:11.660109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-85h4l_aaea0d16-3d83-4142-bdfa-7cf1b6113cd5/payload-processing/0.log" Jul 15 12:47:12.238642 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:12.238609 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ksqvr_c0b72869-e55e-42d4-ade2-fb15c07558cd/main/0.log" Jul 15 12:47:12.473670 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:12.473641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpgsmr_47e90905-a3d4-4236-a146-ef2cf1e28280/main/0.log" Jul 15 12:47:12.592976 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:12.592949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5zh7x_5f39ffe6-2699-4b8a-9a35-85c3ffcd1ae0/main/0.log" Jul 15 12:47:12.710690 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:12.710662 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5s87s_bfe8f023-067a-4449-8079-16d60c9e7e87/main/0.log" Jul 15 12:47:21.195858 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:21.195822 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8ww5q_c54d391c-9d7c-478f-80cb-7c86953b3bc9/global-pull-secret-syncer/0.log" Jul 15 12:47:21.357905 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:21.357871 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t98pg_c41e8f72-5305-46d4-a545-964ec34d6f82/konnectivity-agent/0.log" Jul 15 12:47:21.465060 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:21.464954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-5.ec2.internal_e6ebb36ca37781fc37fae13a9dd7afd9/haproxy/0.log" Jul 15 12:47:27.084492 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:27.084465 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgq8r_5a1e7ac8-449d-44bb-b18e-763d8ce32c48/manager/0.log" Jul 15 12:47:27.166392 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:27.166357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8p4xz_d9c3ef83-740d-4889-8c2f-ce83bfc55fed/registry-server/0.log" Jul 15 12:47:27.434872 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:27.434779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-smr2l_e133cf4e-5aaf-458e-8f45-b61610d59d5a/manager/0.log" Jul 15 12:47:29.283583 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:29.283544 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-jtg9c_dca5e471-88a5-400a-bbd7-33206d77b0ac/cluster-monitoring-operator/0.log" Jul 15 12:47:29.589394 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:29.589308 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pd6mg_50730f27-3c82-4ac6-84b0-b02a3405bb50/node-exporter/0.log" Jul 15 12:47:29.610202 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:29.610166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pd6mg_50730f27-3c82-4ac6-84b0-b02a3405bb50/kube-rbac-proxy/0.log" Jul 15 12:47:29.629112 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:29.629081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pd6mg_50730f27-3c82-4ac6-84b0-b02a3405bb50/init-textfile/0.log" Jul 15 12:47:30.865693 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.865661 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm"] Jul 15 12:47:30.866106 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.866079 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef416c3-6550-45da-b319-e3943dd6bb2d" containerName="test-curl-7615-140094017729856" Jul 15 12:47:30.866106 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.866092 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef416c3-6550-45da-b319-e3943dd6bb2d" containerName="test-curl-7615-140094017729856" Jul 15 12:47:30.866208 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.866155 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef416c3-6550-45da-b319-e3943dd6bb2d" containerName="test-curl-7615-140094017729856" Jul 15 12:47:30.869423 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.869403 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:30.871858 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.871840 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d79rw\"/\"default-dockercfg-l7gjh\"" Jul 15 12:47:30.871971 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.871908 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79rw\"/\"kube-root-ca.crt\"" Jul 15 12:47:30.872844 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.872828 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79rw\"/\"openshift-service-ca.crt\"" Jul 15 12:47:30.878714 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.878691 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm"] Jul 15 12:47:30.974617 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.974577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-lib-modules\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:30.974796 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.974745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlb7t\" (UniqueName: \"kubernetes.io/projected/d967ca24-7b55-483d-be37-77b91d698bb8-kube-api-access-jlb7t\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:30.974796 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.974781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-podres\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:30.974878 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.974862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-sys\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:30.974930 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:30.974898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-proc\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076115 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlb7t\" (UniqueName: \"kubernetes.io/projected/d967ca24-7b55-483d-be37-77b91d698bb8-kube-api-access-jlb7t\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076115 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-podres\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-sys\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-proc\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076193 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-lib-modules\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076265 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-sys\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076284 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-proc\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-podres\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.076367 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.076356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d967ca24-7b55-483d-be37-77b91d698bb8-lib-modules\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.084255 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.084227 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlb7t\" (UniqueName: \"kubernetes.io/projected/d967ca24-7b55-483d-be37-77b91d698bb8-kube-api-access-jlb7t\") pod \"perf-node-gather-daemonset-8ngjm\" (UID: \"d967ca24-7b55-483d-be37-77b91d698bb8\") " pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.181287 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.181196 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:31.320918 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:31.320890 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm"] Jul 15 12:47:31.323218 ip-10-0-139-5 kubenswrapper[2559]: W0715 12:47:31.323187 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd967ca24_7b55_483d_be37_77b91d698bb8.slice/crio-2226c8e28cd4dc9f94de39d10252599ffc797da12bda9811f787d5bf16139ace WatchSource:0}: Error finding container 2226c8e28cd4dc9f94de39d10252599ffc797da12bda9811f787d5bf16139ace: Status 404 returned error can't find the container with id 2226c8e28cd4dc9f94de39d10252599ffc797da12bda9811f787d5bf16139ace Jul 15 12:47:32.085148 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:32.085111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" event={"ID":"d967ca24-7b55-483d-be37-77b91d698bb8","Type":"ContainerStarted","Data":"a83ae1cefd45ef069ac01f8eb029e56719bc52eae35107169f7e1c067b136106"} Jul 15 12:47:32.085559 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:32.085166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" event={"ID":"d967ca24-7b55-483d-be37-77b91d698bb8","Type":"ContainerStarted","Data":"2226c8e28cd4dc9f94de39d10252599ffc797da12bda9811f787d5bf16139ace"} Jul 15 12:47:32.085559 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:32.085256 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:32.103361 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:32.103306 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" podStartSLOduration=2.10328897 podStartE2EDuration="2.10328897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:47:32.10125969 +0000 UTC m=+2916.774694658" watchObservedRunningTime="2026-07-15 12:47:32.10328897 +0000 UTC m=+2916.776723978" Jul 15 12:47:34.347563 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:34.347532 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mz2s5_36f480ce-7808-4f4c-9f44-066b97a5e083/dns/0.log" Jul 15 12:47:34.366415 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:34.366383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mz2s5_36f480ce-7808-4f4c-9f44-066b97a5e083/kube-rbac-proxy/0.log" Jul 15 12:47:34.433722 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:34.433694 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z62h2_613fec8e-7c9c-4503-88a9-5280c9eedb91/dns-node-resolver/0.log" Jul 15 12:47:34.981752 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:34.981724 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-647b7685c4-l7n2p_adf4a0d9-e06c-4b04-b6a0-ef2ea98ac73f/registry/0.log" Jul 15 12:47:35.006556 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:35.006525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v7g7_086725e8-d715-4862-8203-b5908c21de18/node-ca/0.log" Jul 15 12:47:36.018638 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:36.018605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mrhcq_96672c7f-4628-4911-873f-ed2869d411cd/istio-proxy/0.log" Jul 15 12:47:36.285767 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:36.285742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/0.log" Jul 15 12:47:36.343221 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:36.343189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/1.log" Jul 15 12:47:36.380030 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:36.380003 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-vwdxs_943aad8a-8ba5-4154-905a-73708f993a7a/payload-pre-processing/0.log" Jul 15 12:47:36.414394 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:36.414361 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-85h4l_aaea0d16-3d83-4142-bdfa-7cf1b6113cd5/payload-processing/0.log" Jul 15 12:47:37.294393 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:37.294360 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-md752_5a3f9511-123a-47a7-8227-36c91e824fbc/serve-healthcheck-canary/0.log" Jul 15 12:47:37.777150 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:37.777064 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-tshx5_1cc9f363-78b5-4d62-bcef-69abe703aa31/insights-operator/0.log" Jul 15 12:47:37.778820 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:37.778796 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-tshx5_1cc9f363-78b5-4d62-bcef-69abe703aa31/insights-operator/1.log" Jul 15 12:47:37.948434 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:37.948406 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tfghd_d6d895c7-2502-4d0c-befa-ab46124f3ab6/kube-rbac-proxy/0.log" Jul 15 12:47:37.967624 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:37.967598 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tfghd_d6d895c7-2502-4d0c-befa-ab46124f3ab6/exporter/0.log" Jul 15 12:47:37.988155 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:37.988127 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tfghd_d6d895c7-2502-4d0c-befa-ab46124f3ab6/extractor/0.log" Jul 15 12:47:38.100929 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:38.100905 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d79rw/perf-node-gather-daemonset-8ngjm" Jul 15 12:47:40.490463 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:40.490433 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hn88s_fac403d0-9702-4904-9b62-21141fa14dd2/manager/0.log" Jul 15 12:47:40.964272 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:40.964239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694c4fcbc8-kkgm4_fc1bbc0a-9b1d-4c87-a211-42bc46c64495/manager/0.log" Jul 15 12:47:40.979640 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:40.979615 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694c4fcbc8-kkgm4_fc1bbc0a-9b1d-4c87-a211-42bc46c64495/copy-manifests/0.log" Jul 15 12:47:41.796777 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:41.796735 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mrhcq_96672c7f-4628-4911-873f-ed2869d411cd/istio-proxy/0.log" Jul 15 12:47:42.036233 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:42.036203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/0.log" Jul 15 12:47:42.097121 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:42.097090 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/1.log" Jul 15 12:47:42.123976 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:42.123941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-vwdxs_943aad8a-8ba5-4154-905a-73708f993a7a/payload-pre-processing/0.log" Jul 15 12:47:42.148897 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:42.148865 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-85h4l_aaea0d16-3d83-4142-bdfa-7cf1b6113cd5/payload-processing/0.log" Jul 15 12:47:42.262096 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:42.262066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dc89645fd-krczj_4ad4cbc7-8143-4a26-9724-28665f9b7f0f/manager/0.log" Jul 15 12:47:43.318414 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:43.318382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mrhcq_96672c7f-4628-4911-873f-ed2869d411cd/istio-proxy/0.log" Jul 15 12:47:43.567054 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:43.567002 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/0.log" Jul 15 12:47:43.624701 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:43.624617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wd2tz_ba505e15-a992-4e63-99af-6849115b9782/istio-proxy/1.log" Jul 15 12:47:43.651244 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:43.651211 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-vwdxs_943aad8a-8ba5-4154-905a-73708f993a7a/payload-pre-processing/0.log" Jul 15 12:47:43.678549 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:43.678503 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-85h4l_aaea0d16-3d83-4142-bdfa-7cf1b6113cd5/payload-processing/0.log" Jul 15 12:47:47.409761 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:47.409729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkbpp_e9356eb7-6782-44bc-a77f-49c4a962b2fd/migrator/0.log" Jul 15 12:47:47.427981 ip-10-0-139-5 kubenswrapper[2559]: I0715 12:47:47.427948 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkbpp_e9356eb7-6782-44bc-a77f-49c4a962b2fd/graceful-termination/0.log"