Jul 17 14:47:30.514944 ip-10-0-139-74 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 14:47:30.514955 ip-10-0-139-74 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 14:47:30.514961 ip-10-0-139-74 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 14:47:30.515175 ip-10-0-139-74 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 14:47:40.563857 ip-10-0-139-74 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 17 14:47:40.563873 ip-10-0-139-74 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d1fe0f5f30a64b3c8b46e7f2e8be0747 -- Jul 17 14:49:12.466031 ip-10-0-139-74 systemd[1]: Starting Kubernetes Kubelet... Jul 17 14:49:12.903954 ip-10-0-139-74 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 14:49:12.903954 ip-10-0-139-74 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 14:49:12.903954 ip-10-0-139-74 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 14:49:12.903954 ip-10-0-139-74 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 14:49:12.903954 ip-10-0-139-74 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 14:49:12.906413 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.906299 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 14:49:12.909777 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909761 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 14:49:12.909777 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909777 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909780 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909784 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909788 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909791 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909793 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909796 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909798 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909801 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909803 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909806 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909808 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909811 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909813 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909816 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909818 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909821 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909823 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909826 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909829 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 14:49:12.909838 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909831 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909834 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909836 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909839 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909841 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909844 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909849 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909852 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909855 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909859 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909861 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909864 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909867 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909869 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909872 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909875 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909877 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909879 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909882 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 14:49:12.910309 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909884 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909887 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909890 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909892 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909894 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909897 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909899 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909902 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909904 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909907 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909911 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909914 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909916 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909919 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909921 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909924 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909928 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909930 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909933 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 14:49:12.910780 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909936 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909939 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909941 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909943 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909946 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909948 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909950 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909953 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909956 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909958 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909961 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909963 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909966 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909969 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909971 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909974 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909976 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909979 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909981 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909983 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 14:49:12.911274 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909986 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909988 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909991 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909993 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909996 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.909999 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910003 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910006 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910011 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910014 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910017 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910019 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910022 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910025 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910027 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910029 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910032 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910034 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910037 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 14:49:12.911763 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.910039 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911959 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911966 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911969 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911973 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911976 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911979 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911981 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911984 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911987 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911989 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911992 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911995 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.911997 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912000 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912002 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912004 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912007 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912009 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912012 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 14:49:12.912214 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912014 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912018 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912022 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912025 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912028 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912030 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912033 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912036 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912038 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912041 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912044 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912046 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912048 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912051 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912054 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912056 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912059 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912061 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912064 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912067 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 14:49:12.912690 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912070 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912072 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912075 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912077 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912080 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912082 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912084 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912088 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912090 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912092 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912095 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912097 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912100 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912102 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912105 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912107 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912109 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912113 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912117 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 14:49:12.913208 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912121 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912124 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912127 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912130 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912132 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912135 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912137 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912140 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912143 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912145 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912148 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912150 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912152 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912159 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912161 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912164 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912167 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912169 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912172 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912175 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 14:49:12.913666 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912177 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912181 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912183 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912185 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912189 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912191 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912194 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912196 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912199 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912201 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912203 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912206 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912210 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912213 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912217 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912220 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912223 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912226 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912229 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912232 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 14:49:12.914171 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912234 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912589 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912596 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912599 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912602 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912605 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912608 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912611 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912614 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912616 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912620 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912625 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912627 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912630 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912633 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912635 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912639 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912641 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912644 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 14:49:12.914660 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912648 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912651 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912654 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912656 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912659 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912662 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912665 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912668 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912670 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912673 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912675 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912678 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912680 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912683 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912685 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912688 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912691 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912694 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912696 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912714 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 14:49:12.915130 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912717 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912720 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912723 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912726 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912729 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912731 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912734 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912736 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912739 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912742 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912744 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912747 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912749 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912752 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912754 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912757 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912759 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912764 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912767 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912769 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 14:49:12.915607 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912772 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912774 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912777 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912779 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912782 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912784 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912787 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912789 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912791 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912794 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912797 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912799 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912802 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912805 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912807 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912810 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912812 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912814 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912817 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 14:49:12.916123 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912820 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912822 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912825 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912827 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912829 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912832 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912834 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912837 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912839 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912842 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912846 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912849 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912851 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912854 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912856 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912859 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912861 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912863 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912866 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912868 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 14:49:12.916572 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912870 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.912873 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.912961 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.912979 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.912988 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.912994 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913002 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913007 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913016 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913021 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913024 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913027 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913031 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913034 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913037 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913041 2574 flags.go:64] FLAG: --cgroup-root="" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913043 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913046 2574 flags.go:64] FLAG: --client-ca-file="" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913049 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913052 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913057 2574 flags.go:64] FLAG: --cluster-domain="" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913059 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913064 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913067 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 14:49:12.917155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913071 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913075 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913078 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913081 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913084 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913087 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913090 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913092 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913095 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913098 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913102 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913105 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913107 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913110 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913113 2574 flags.go:64] FLAG: --enable-server="true" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913117 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913121 2574 flags.go:64] FLAG: --event-burst="100" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913124 2574 flags.go:64] FLAG: --event-qps="50" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913127 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913130 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913132 2574 flags.go:64] FLAG: --eviction-hard="" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913136 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913139 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913142 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913145 2574 flags.go:64] FLAG: --eviction-soft="" Jul 17 14:49:12.917762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913147 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913150 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913153 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913157 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913159 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913163 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913166 2574 flags.go:64] FLAG: --feature-gates="" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913170 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913173 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913175 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913179 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913182 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913184 2574 flags.go:64] FLAG: --help="false" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913187 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-139-74.ec2.internal" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913190 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913193 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913196 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913200 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913203 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913205 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913208 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913211 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913214 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 14:49:12.918382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913217 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913220 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913223 2574 flags.go:64] FLAG: --kube-reserved="" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913226 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913228 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913231 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913233 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913236 2574 flags.go:64] FLAG: --lock-file="" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913238 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913241 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913244 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913249 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913252 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913255 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913259 2574 flags.go:64] FLAG: --logging-format="text" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913262 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913265 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913267 2574 flags.go:64] FLAG: --manifest-url="" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913270 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913274 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913277 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913281 2574 flags.go:64] FLAG: --max-pods="110" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913283 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913286 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913289 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 14:49:12.919020 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913291 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913294 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913297 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913299 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913307 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913309 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913312 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913315 2574 flags.go:64] FLAG: --pod-cidr="" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913318 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913324 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913327 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913330 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913332 2574 flags.go:64] FLAG: --port="10250" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913335 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913338 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d89b09cd96245058" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913341 2574 flags.go:64] FLAG: --qos-reserved="" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913343 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913346 2574 flags.go:64] FLAG: --register-node="true" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913348 2574 flags.go:64] FLAG: --register-with-taints="" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913352 2574 flags.go:64] FLAG: --registry-burst="10" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913354 2574 flags.go:64] FLAG: --registry-qps="5" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913359 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913361 2574 flags.go:64] FLAG: --reserved-memory="" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913365 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913368 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 14:49:12.919659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913370 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913373 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913375 2574 flags.go:64] FLAG: --runonce="false" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913378 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913381 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913384 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913387 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913389 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913392 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913395 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913398 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913400 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913403 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913406 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913409 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913412 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913416 2574 flags.go:64] FLAG: --system-cgroups="" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913418 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913423 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913426 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913428 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913433 2574 flags.go:64] FLAG: --tls-min-version="" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913435 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913438 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913440 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 14:49:12.920311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913443 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913446 2574 flags.go:64] FLAG: --v="2" Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913450 2574 flags.go:64] FLAG: --version="false" Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913455 2574 flags.go:64] FLAG: --vmodule="" Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913458 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.913461 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913578 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913582 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913585 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913587 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913590 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913592 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913595 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913597 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913599 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913602 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913604 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913606 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913609 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913611 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913614 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 14:49:12.920939 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913616 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913618 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913621 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913624 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913627 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913629 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913632 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913634 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913636 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913638 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913641 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913643 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913645 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913648 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913652 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913654 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913656 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913660 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913664 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 14:49:12.921454 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913667 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913670 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913672 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913675 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913678 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913680 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913683 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913685 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913687 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913690 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913692 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913694 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913697 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913713 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913717 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913719 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913722 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913724 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913728 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913731 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 14:49:12.921931 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913734 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913736 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913739 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913741 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913744 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913747 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913749 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913752 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913755 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913759 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913762 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913765 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913768 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913771 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913773 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913776 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913778 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913781 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913783 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 14:49:12.922410 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913786 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913788 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913790 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913793 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913795 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913798 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913801 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913805 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913808 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913811 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913813 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913817 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913820 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913822 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913825 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913827 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913830 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913832 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913835 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913837 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 14:49:12.922956 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913840 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913842 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913845 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913847 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913850 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.913853 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.914455 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.921953 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.921972 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.921992 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.921998 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922070 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922076 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922079 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 14:49:12.923440 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922083 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922087 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922090 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922093 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922097 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922102 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922108 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922113 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922117 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922122 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922125 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922128 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922130 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922133 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922136 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922138 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922141 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922143 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922147 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922149 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 14:49:12.923808 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922152 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922155 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922157 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922160 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922162 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922165 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922176 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922179 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922182 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922187 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922191 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922197 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922202 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922206 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922208 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922211 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922213 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922216 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922218 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922221 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 14:49:12.924311 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922223 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922226 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922228 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922230 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922233 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922235 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922237 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922240 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922242 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922245 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922248 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922250 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922253 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922256 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922258 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922261 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922263 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922267 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922271 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 14:49:12.924811 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922287 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922291 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922294 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922296 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922298 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922301 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922303 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922305 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922308 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922310 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922313 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922316 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922319 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922321 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922323 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922326 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922328 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922331 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922333 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 14:49:12.925288 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922336 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922339 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922341 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922344 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922346 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922349 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922354 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922359 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922364 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922368 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922371 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922374 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922377 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922380 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922389 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922392 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922394 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 14:49:12.925789 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922397 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.922402 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922584 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922590 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922594 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922597 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922603 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922607 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922612 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922616 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922619 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922622 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922625 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922627 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922630 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 14:49:12.926196 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922632 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922636 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922639 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922641 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922644 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922646 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922649 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922651 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922654 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922657 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922661 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922664 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922668 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922671 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922674 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922685 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922690 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922694 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922698 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 14:49:12.926563 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922715 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922717 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922720 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922723 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922725 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922727 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922730 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922732 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922735 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922737 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922739 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922742 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922745 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922747 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922750 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922752 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922755 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922759 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922763 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 14:49:12.927098 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922767 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922771 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922776 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922780 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922785 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922787 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922790 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922793 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922795 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922798 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922807 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922810 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922812 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922814 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922817 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922819 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922822 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922824 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922826 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922829 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 14:49:12.927587 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922831 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922833 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922836 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922838 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922840 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922843 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922845 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922849 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922853 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922857 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922861 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922865 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922868 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922871 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922873 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922876 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922878 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922881 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922883 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922886 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 14:49:12.928077 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922888 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922890 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922893 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922901 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922904 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922906 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922909 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:12.922913 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.922918 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.923091 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.925174 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.926554 2574 server.go:1019] "Starting client certificate rotation" Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.926662 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 14:49:12.928551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.926732 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 14:49:12.931448 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.931418 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 14:49:12.932730 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.932695 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 14:49:12.943458 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.943437 2574 log.go:25] "Validated CRI v1 runtime API" Jul 17 14:49:12.945689 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.945665 2574 log.go:25] "Validated CRI v1 image API" Jul 17 14:49:12.946637 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.946620 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 14:49:12.949779 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.949760 2574 fs.go:135] Filesystem UUIDs: map[4980441f-e073-4616-b990-24a5bb7e80ab:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b2af5e05-ab76-4305-8e1b-772fd45da87d:/dev/nvme0n1p3] Jul 17 14:49:12.949859 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.949779 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 14:49:12.955223 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.955111 2574 manager.go:216] Machine: {Timestamp:2026-07-17 14:49:12.953635775 +0000 UTC m=+0.357018236 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091403 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec272ec857ec5ddcd1a9287c0c7a33fc SystemUUID:ec272ec8-57ec-5ddc-d1a9-287c0c7a33fc BootID:d1fe0f5f-30a6-4b3c-8b46-e7f2e8be0747 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:83:0a:de:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:83:0a:de:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:04:16:f8:1f:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 14:49:12.955223 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.955221 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 14:49:12.955332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.955319 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 14:49:12.958280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.958252 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 14:49:12.958431 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.958286 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 14:49:12.959867 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.959857 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 14:49:12.959901 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.959869 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 14:49:12.959901 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.959877 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 14:49:12.960991 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.960981 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 14:49:12.962355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.962343 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 14:49:12.964425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.964394 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 14:49:12.966153 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966140 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 17 14:49:12.966304 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966294 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 14:49:12.966342 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966327 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 17 14:49:12.966373 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966342 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 14:49:12.966373 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966367 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 14:49:12.966431 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966382 2574 kubelet.go:398] "Adding apiserver pod source" Jul 17 14:49:12.966431 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966399 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 14:49:12.966866 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966855 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 14:49:12.966905 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.966874 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 14:49:12.972227 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.972202 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 14:49:12.973580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.973566 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 14:49:12.973622 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.973597 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 14:49:12.974301 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974290 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 14:49:12.974349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974307 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 14:49:12.974349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974313 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 14:49:12.974349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974319 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 14:49:12.974349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974327 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 14:49:12.974349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974332 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 14:49:12.974349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974350 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 14:49:12.974616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974356 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 14:49:12.974616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974363 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 14:49:12.974616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974368 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 14:49:12.974616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974376 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 14:49:12.974616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.974384 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 14:49:12.975184 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.975171 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 14:49:12.975184 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.975181 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 14:49:12.977145 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.977127 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 14:49:12.977824 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:12.977805 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 14:49:12.977862 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:12.977809 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 14:49:12.978412 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.978400 2574 server.go:1268] "Started kubelet" Jul 17 14:49:12.978621 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.978501 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 14:49:12.978727 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.978568 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 14:49:12.978787 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.978754 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 14:49:12.979267 ip-10-0-139-74 systemd[1]: Started Kubernetes Kubelet. Jul 17 14:49:12.979969 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.979859 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 17 14:49:12.979969 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.979926 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 14:49:12.984886 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:12.983855 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-74.ec2.internal.18c31b2bf517c061 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-74.ec2.internal,UID:ip-10-0-139-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-74.ec2.internal,},FirstTimestamp:2026-07-17 14:49:12.978366561 +0000 UTC m=+0.381749022,LastTimestamp:2026-07-17 14:49:12.978366561 +0000 UTC m=+0.381749022,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-74.ec2.internal,}" Jul 17 14:49:12.986206 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:12.986174 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 14:49:12.986999 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.986982 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 14:49:12.987106 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.987064 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 14:49:12.987106 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:12.987076 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:12.987593 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.987572 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 14:49:12.987671 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.987584 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 14:49:12.987671 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.987629 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 14:49:12.987797 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.987693 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 17 14:49:12.987797 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.987718 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 17 14:49:12.988374 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988355 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 14:49:12.988374 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988375 2574 factory.go:55] Registering systemd factory Jul 17 14:49:12.988475 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988385 2574 factory.go:223] Registration of the systemd container factory successfully Jul 17 14:49:12.988615 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988602 2574 factory.go:153] Registering CRI-O factory Jul 17 14:49:12.988670 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988617 2574 factory.go:223] Registration of the crio container factory successfully Jul 17 14:49:12.988670 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988636 2574 factory.go:103] Registering Raw factory Jul 17 14:49:12.988670 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.988649 2574 manager.go:1196] Started watching for new ooms in manager Jul 17 14:49:12.989400 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:12.989277 2574 manager.go:349] Starting recovery of all containers Jul 17 14:49:13.000578 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.000544 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 14:49:13.001148 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.001124 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 14:49:13.002910 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.002895 2574 manager.go:354] Recovery completed Jul 17 14:49:13.007159 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.007146 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.008959 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.008942 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.009014 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.008985 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.009014 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.008997 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.009455 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.009437 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 14:49:13.009455 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.009453 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 14:49:13.009558 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.009473 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 17 14:49:13.009558 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.009474 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.011594 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.011577 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.011673 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.011604 2574 policy_none.go:49] "None policy: Start" Jul 17 14:49:13.011673 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.011609 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.011673 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.011619 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 14:49:13.011673 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.011624 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.011673 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.011629 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 14:49:13.013593 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.013582 2574 policy_none.go:47] "Start" Jul 17 14:49:13.026586 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.026516 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-74.ec2.internal.18c31b2bf6ea8cb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-74.ec2.internal,UID:ip-10-0-139-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-74.ec2.internal,},FirstTimestamp:2026-07-17 14:49:13.008958647 +0000 UTC m=+0.412341111,LastTimestamp:2026-07-17 14:49:13.008958647 +0000 UTC m=+0.412341111,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-74.ec2.internal,}" Jul 17 14:49:13.035243 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.035222 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g7ggg" Jul 17 14:49:13.036171 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.036108 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-74.ec2.internal.18c31b2bf6eb0a15 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-74.ec2.internal,UID:ip-10-0-139-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-74.ec2.internal,},FirstTimestamp:2026-07-17 14:49:13.008990741 +0000 UTC m=+0.412373201,LastTimestamp:2026-07-17 14:49:13.008990741 +0000 UTC m=+0.412373201,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-74.ec2.internal,}" Jul 17 14:49:13.045438 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.045310 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g7ggg" Jul 17 14:49:13.047379 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.047315 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-74.ec2.internal.18c31b2bf6eb3231 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-74.ec2.internal,UID:ip-10-0-139-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-74.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-74.ec2.internal,},FirstTimestamp:2026-07-17 14:49:13.009001009 +0000 UTC m=+0.412383473,LastTimestamp:2026-07-17 14:49:13.009001009 +0000 UTC m=+0.412383473,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-74.ec2.internal,}" Jul 17 14:49:13.054314 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054300 2574 manager.go:337] "Starting Device Plugin manager" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.054327 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054336 2574 server.go:87] "Starting device plugin registration server" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054573 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054584 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054806 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054908 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.054918 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.055420 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 14:49:13.077891 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.055490 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.105664 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.105624 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 14:49:13.107042 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.107016 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 14:49:13.107146 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.107056 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 14:49:13.107146 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.107081 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 14:49:13.107146 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.107119 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 14:49:13.110072 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.110053 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 14:49:13.155553 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.155477 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.156432 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.156413 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.156528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.156448 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.156528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.156464 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.156528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.156488 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.166901 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.166883 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.166969 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.166909 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-74.ec2.internal\": node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.183129 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.183107 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.207544 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.207516 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal"] Jul 17 14:49:13.207635 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.207581 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.208521 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.208495 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.208614 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.208531 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.208614 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.208544 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.210804 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.210791 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.210926 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.210913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.210967 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.210942 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.211812 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.211797 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.211812 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.211804 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.211934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.211818 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.211934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.211823 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.211934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.211827 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.211934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.211832 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.213892 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.213878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.213942 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.213906 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:13.214594 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.214580 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:13.214665 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.214607 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:13.214665 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.214618 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:13.230242 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.230222 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-74.ec2.internal\" not found" node="ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.234778 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.234761 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-74.ec2.internal\" not found" node="ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.283346 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.283313 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.289429 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.289401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00d96d78880ade0ba958cafce4d1d6a2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-74.ec2.internal\" (UID: \"00d96d78880ade0ba958cafce4d1d6a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.289522 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.289433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/faef41a99e20c7786e2ef3c0f1740e1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal\" (UID: \"faef41a99e20c7786e2ef3c0f1740e1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.289522 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.289452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faef41a99e20c7786e2ef3c0f1740e1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal\" (UID: \"faef41a99e20c7786e2ef3c0f1740e1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.384285 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.384234 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.389600 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.389583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faef41a99e20c7786e2ef3c0f1740e1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal\" (UID: \"faef41a99e20c7786e2ef3c0f1740e1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.389684 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.389654 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faef41a99e20c7786e2ef3c0f1740e1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal\" (UID: \"faef41a99e20c7786e2ef3c0f1740e1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.389684 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.389672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00d96d78880ade0ba958cafce4d1d6a2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-74.ec2.internal\" (UID: \"00d96d78880ade0ba958cafce4d1d6a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.389772 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.389718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/faef41a99e20c7786e2ef3c0f1740e1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal\" (UID: \"faef41a99e20c7786e2ef3c0f1740e1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.389772 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.389765 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/faef41a99e20c7786e2ef3c0f1740e1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal\" (UID: \"faef41a99e20c7786e2ef3c0f1740e1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.389828 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.389765 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00d96d78880ade0ba958cafce4d1d6a2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-74.ec2.internal\" (UID: \"00d96d78880ade0ba958cafce4d1d6a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.485152 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.485080 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.532573 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.532541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.538507 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.538489 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" Jul 17 14:49:13.585673 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.585640 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.686215 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.686169 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.786765 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.786683 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.887253 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.887202 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:13.925585 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.925542 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 14:49:13.925999 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:13.925729 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 14:49:13.987541 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:13.987503 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:14.053372 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.053269 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 14:44:14 +0000 UTC" deadline="2028-01-03 10:38:39.140850545 +0000 UTC" Jul 17 14:49:14.053372 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.053322 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12835h49m25.087532182s" Jul 17 14:49:14.064600 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.064568 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 14:49:14.066284 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.066262 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientMemory" Jul 17 14:49:14.066409 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.066302 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 14:49:14.066409 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.066318 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeHasSufficientPID" Jul 17 14:49:14.077538 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:14.077505 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d96d78880ade0ba958cafce4d1d6a2.slice/crio-05724e3dfe605eeffc1ae308ae2624257b4bf46c4dfb677b806c3f4d6131c39d WatchSource:0}: Error finding container 05724e3dfe605eeffc1ae308ae2624257b4bf46c4dfb677b806c3f4d6131c39d: Status 404 returned error can't find the container with id 05724e3dfe605eeffc1ae308ae2624257b4bf46c4dfb677b806c3f4d6131c39d Jul 17 14:49:14.078049 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:14.078024 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaef41a99e20c7786e2ef3c0f1740e1b.slice/crio-2762ad42a9f1e4b12f4ab1f02f41751525b774f5f037d4d1b14a1ff6665ea1b0 WatchSource:0}: Error finding container 2762ad42a9f1e4b12f4ab1f02f41751525b774f5f037d4d1b14a1ff6665ea1b0: Status 404 returned error can't find the container with id 2762ad42a9f1e4b12f4ab1f02f41751525b774f5f037d4d1b14a1ff6665ea1b0 Jul 17 14:49:14.083827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.083809 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:49:14.088545 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:14.088526 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:14.110581 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.110536 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" event={"ID":"00d96d78880ade0ba958cafce4d1d6a2","Type":"ContainerStarted","Data":"05724e3dfe605eeffc1ae308ae2624257b4bf46c4dfb677b806c3f4d6131c39d"} Jul 17 14:49:14.111568 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.111545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" event={"ID":"faef41a99e20c7786e2ef3c0f1740e1b","Type":"ContainerStarted","Data":"2762ad42a9f1e4b12f4ab1f02f41751525b774f5f037d4d1b14a1ff6665ea1b0"} Jul 17 14:49:14.164008 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.163983 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 14:49:14.188765 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:14.188735 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-74.ec2.internal\" not found" Jul 17 14:49:14.243137 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.243113 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 14:49:14.259354 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.259328 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 14:49:14.287809 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.287779 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" Jul 17 14:49:14.312339 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.312254 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 14:49:14.313513 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.313495 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" Jul 17 14:49:14.327901 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:14.327870 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 14:49:16.018735 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.018708 2574 apiserver.go:52] "Watching apiserver" Jul 17 14:49:16.024219 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.024179 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 14:49:16.026625 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.026597 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-42vbh","kube-system/konnectivity-agent-ppklf","kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph","openshift-cluster-node-tuning-operator/tuned-l9dkl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal"] Jul 17 14:49:16.029967 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.029945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.030060 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:16.030011 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:16.032493 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.032473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.034618 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.034598 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.035164 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.035147 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-85k9l\"" Jul 17 14:49:16.035331 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.035146 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 14:49:16.035565 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.035548 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 14:49:16.036713 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.036695 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 14:49:16.036961 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.036944 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 14:49:16.037484 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.037239 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vhzfk\"" Jul 17 14:49:16.037484 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.037253 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 14:49:16.037615 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.037559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.039277 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.039173 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 14:49:16.039409 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.039393 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 14:49:16.039923 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.039907 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 14:49:16.039988 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.039968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58knt\"" Jul 17 14:49:16.039988 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.039981 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 14:49:16.049767 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysconfig\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.049859 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-var-lib-kubelet\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.049859 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-host\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.049859 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjq8x\" (UniqueName: \"kubernetes.io/projected/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-kube-api-access-vjq8x\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.049993 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.049993 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-sys-fs\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.049993 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8csm8\" (UniqueName: \"kubernetes.io/projected/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-kube-api-access-8csm8\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.049993 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysctl-d\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.049993 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.049985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d743f1f-28ac-4c14-8e5d-949d98b5d67d-konnectivity-ca\") pod \"konnectivity-agent-ppklf\" (UID: \"5d743f1f-28ac-4c14-8e5d-949d98b5d67d\") " pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-registration-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-systemd\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-run\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-kubernetes\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-sys\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.050222 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-device-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-modprobe-d\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d743f1f-28ac-4c14-8e5d-949d98b5d67d-agent-certs\") pod \"konnectivity-agent-ppklf\" (UID: \"5d743f1f-28ac-4c14-8e5d-949d98b5d67d\") " pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysctl-conf\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-lib-modules\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050373 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b66703c1-056c-48af-b986-c4dd73996a89-dbus\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-socket-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-tuned\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-tmp\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.050514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.050484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b66703c1-056c-48af-b986-c4dd73996a89-kubelet-config\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.056041 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.056019 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 14:49:16.079552 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.079504 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5q8s2" Jul 17 14:49:16.151154 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-device-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-modprobe-d\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d743f1f-28ac-4c14-8e5d-949d98b5d67d-agent-certs\") pod \"konnectivity-agent-ppklf\" (UID: \"5d743f1f-28ac-4c14-8e5d-949d98b5d67d\") " pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysctl-conf\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-lib-modules\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151321 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b66703c1-056c-48af-b986-c4dd73996a89-dbus\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-socket-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-tuned\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-tmp\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b66703c1-056c-48af-b986-c4dd73996a89-kubelet-config\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysconfig\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-var-lib-kubelet\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-host\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjq8x\" (UniqueName: \"kubernetes.io/projected/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-kube-api-access-vjq8x\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-sys-fs\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8csm8\" (UniqueName: \"kubernetes.io/projected/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-kube-api-access-8csm8\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysctl-d\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.151645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d743f1f-28ac-4c14-8e5d-949d98b5d67d-konnectivity-ca\") pod \"konnectivity-agent-ppklf\" (UID: \"5d743f1f-28ac-4c14-8e5d-949d98b5d67d\") " pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-registration-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-systemd\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-run\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-kubernetes\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151763 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-sys\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151852 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-sys\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151918 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.151963 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-device-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.152058 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.152253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.152138 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-modprobe-d\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.152759 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.152529 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 14:49:16.152888 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.152865 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-host\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.153033 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153008 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysctl-conf\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.153123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153107 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-lib-modules\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.153370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153349 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b66703c1-056c-48af-b986-c4dd73996a89-dbus\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.153480 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153460 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-socket-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.153645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153627 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b66703c1-056c-48af-b986-c4dd73996a89-kubelet-config\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.153732 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153701 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysconfig\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.153864 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153734 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-sysctl-d\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.153864 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153776 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-var-lib-kubelet\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.153864 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153810 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-sys-fs\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.153864 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:16.153829 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:16.154067 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:16.153930 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:16.653885823 +0000 UTC m=+3.005779444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:16.154067 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.153981 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-kubernetes\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.154067 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.154055 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-systemd\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.154253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.154101 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-run\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.154253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.154148 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-registration-dir\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.154768 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.154568 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d743f1f-28ac-4c14-8e5d-949d98b5d67d-konnectivity-ca\") pod \"konnectivity-agent-ppklf\" (UID: \"5d743f1f-28ac-4c14-8e5d-949d98b5d67d\") " pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.157001 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.156778 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d743f1f-28ac-4c14-8e5d-949d98b5d67d-agent-certs\") pod \"konnectivity-agent-ppklf\" (UID: \"5d743f1f-28ac-4c14-8e5d-949d98b5d67d\") " pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.157001 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.156937 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-tmp\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.157001 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.156919 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-etc-tuned\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.164542 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.164515 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8csm8\" (UniqueName: \"kubernetes.io/projected/1280d2b3-aeaa-4fe6-912b-79b82b5dc343-kube-api-access-8csm8\") pod \"aws-ebs-csi-driver-node-8qqph\" (UID: \"1280d2b3-aeaa-4fe6-912b-79b82b5dc343\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.164631 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.164607 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjq8x\" (UniqueName: \"kubernetes.io/projected/d06ecf01-02be-4bf4-932e-ac4b6162ea1d-kube-api-access-vjq8x\") pod \"tuned-l9dkl\" (UID: \"d06ecf01-02be-4bf4-932e-ac4b6162ea1d\") " pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.330010 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.329926 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 14:49:16.346186 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.346152 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:16.357314 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.357289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" Jul 17 14:49:16.365018 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.364996 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" Jul 17 14:49:16.655072 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:16.654984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:16.655243 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:16.655117 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:16.655243 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:16.655178 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:17.655161218 +0000 UTC m=+4.007054830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:17.116424 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:17.116399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06ecf01_02be_4bf4_932e_ac4b6162ea1d.slice/crio-b617432b62389d9a9fa1aac2446955cf654daee2dae27bc2a56f95f8121b973d WatchSource:0}: Error finding container b617432b62389d9a9fa1aac2446955cf654daee2dae27bc2a56f95f8121b973d: Status 404 returned error can't find the container with id b617432b62389d9a9fa1aac2446955cf654daee2dae27bc2a56f95f8121b973d Jul 17 14:49:17.117170 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:17.117145 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d743f1f_28ac_4c14_8e5d_949d98b5d67d.slice/crio-38c87c58d5347438611ae1640b985ae86d9578d7eb20445d7cca4da0b58b144c WatchSource:0}: Error finding container 38c87c58d5347438611ae1640b985ae86d9578d7eb20445d7cca4da0b58b144c: Status 404 returned error can't find the container with id 38c87c58d5347438611ae1640b985ae86d9578d7eb20445d7cca4da0b58b144c Jul 17 14:49:17.124998 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:17.124965 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1280d2b3_aeaa_4fe6_912b_79b82b5dc343.slice/crio-490395df200252e36a88039907f3673f9f08602eac37d055acaebfef4c425f8a WatchSource:0}: Error finding container 490395df200252e36a88039907f3673f9f08602eac37d055acaebfef4c425f8a: Status 404 returned error can't find the container with id 490395df200252e36a88039907f3673f9f08602eac37d055acaebfef4c425f8a Jul 17 14:49:17.158989 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:17.158963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:17.159120 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:17.159093 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:17.168066 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:17.168039 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" event={"ID":"1280d2b3-aeaa-4fe6-912b-79b82b5dc343","Type":"ContainerStarted","Data":"490395df200252e36a88039907f3673f9f08602eac37d055acaebfef4c425f8a"} Jul 17 14:49:17.169883 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:17.169852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ppklf" event={"ID":"5d743f1f-28ac-4c14-8e5d-949d98b5d67d","Type":"ContainerStarted","Data":"38c87c58d5347438611ae1640b985ae86d9578d7eb20445d7cca4da0b58b144c"} Jul 17 14:49:17.172169 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:17.172142 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" event={"ID":"d06ecf01-02be-4bf4-932e-ac4b6162ea1d","Type":"ContainerStarted","Data":"b617432b62389d9a9fa1aac2446955cf654daee2dae27bc2a56f95f8121b973d"} Jul 17 14:49:17.662303 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:17.659931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:17.662745 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:17.662712 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:17.662869 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:17.662797 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:19.662777157 +0000 UTC m=+6.014670774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:18.176268 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:18.176230 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" event={"ID":"00d96d78880ade0ba958cafce4d1d6a2","Type":"ContainerStarted","Data":"45b3d4e209e6aad49ea5319c397fc9b8c3cab4fa1187aeb75806e311a5f265a6"} Jul 17 14:49:18.178405 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:18.178375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" event={"ID":"faef41a99e20c7786e2ef3c0f1740e1b","Type":"ContainerStarted","Data":"8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9"} Jul 17 14:49:18.190300 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:18.190237 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-74.ec2.internal" podStartSLOduration=3.190219917 podStartE2EDuration="3.190219917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:18.190146418 +0000 UTC m=+4.542040051" watchObservedRunningTime="2026-07-17 14:49:18.190219917 +0000 UTC m=+4.542113550" Jul 17 14:49:19.159134 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:19.159098 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:19.159338 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:19.159245 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:19.676180 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:19.676142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:19.676625 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:19.676329 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:19.676625 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:19.676412 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:23.676390343 +0000 UTC m=+10.028283958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:20.183880 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:20.183839 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" event={"ID":"1280d2b3-aeaa-4fe6-912b-79b82b5dc343","Type":"ContainerStarted","Data":"9e4a2f54651b5d9ee63ed8b2bcbad42574bfe9e2ebb8305043e86c958b8e56c2"} Jul 17 14:49:20.185622 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:20.185589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ppklf" event={"ID":"5d743f1f-28ac-4c14-8e5d-949d98b5d67d","Type":"ContainerStarted","Data":"352e2c10416fef1a9cafe818dec266f4a0e7bf1a4d8b58335e136873d9368bb7"} Jul 17 14:49:20.202011 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:20.201963 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ppklf" podStartSLOduration=3.797229391 podStartE2EDuration="6.201947712s" totalImagesPullingTime="2.404718321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:20.201910386 +0000 UTC m=+6.553804019" watchObservedRunningTime="2026-07-17 14:49:20.201947712 +0000 UTC m=+6.553841344" Jul 17 14:49:21.158977 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:21.158942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:21.159417 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:21.159112 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:21.288532 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:21.288494 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:21.289149 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:21.289122 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:22.435700 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:22.435673 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 14:49:22.735125 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:22.735094 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:22.735729 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:22.735710 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ppklf" Jul 17 14:49:23.110429 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.110326 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T14:49:22.435691501Z","UUID":"3ddc9726-33f6-4e21-ab1b-bc0dd704f2c1","Handler":null,"Name":"","Endpoint":""} Jul 17 14:49:23.111853 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.111831 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 14:49:23.111943 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.111870 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 14:49:23.159022 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.158986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:23.159228 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:23.159121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:23.192975 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.192935 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" event={"ID":"1280d2b3-aeaa-4fe6-912b-79b82b5dc343","Type":"ContainerStarted","Data":"49404a0d6495f87bd68c0337f20cc9be314166d7b0d889ccba19d7b882763d13"} Jul 17 14:49:23.194581 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.194550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" event={"ID":"d06ecf01-02be-4bf4-932e-ac4b6162ea1d","Type":"ContainerStarted","Data":"316054637d18ce856e1a10402c20ca585bc43893866e7b59df71675c27c48634"} Jul 17 14:49:23.212204 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.212142 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l9dkl" podStartSLOduration=3.965857632 podStartE2EDuration="9.212128592s" totalImagesPullingTime="5.24627096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:23.21194084 +0000 UTC m=+9.563834473" watchObservedRunningTime="2026-07-17 14:49:23.212128592 +0000 UTC m=+9.564022223" Jul 17 14:49:23.701093 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:23.701065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:23.701505 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:23.701164 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:23.701505 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:23.701228 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:31.701215474 +0000 UTC m=+18.053109084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:24.198260 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:24.198228 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" event={"ID":"1280d2b3-aeaa-4fe6-912b-79b82b5dc343","Type":"ContainerStarted","Data":"eb6507f4541268925dab6dfb375dc80245f5d4e1f77d22b9040f73d1a973eaa4"} Jul 17 14:49:24.216359 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:24.216317 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qqph" podStartSLOduration=4.258972266 podStartE2EDuration="10.216301794s" totalImagesPullingTime="5.957329528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:24.216229862 +0000 UTC m=+10.568123494" watchObservedRunningTime="2026-07-17 14:49:24.216301794 +0000 UTC m=+10.568195423" Jul 17 14:49:25.159293 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:25.159245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:25.159681 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:25.159362 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:27.159480 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:27.159441 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:27.159873 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:27.159549 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:29.159510 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:29.159477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:29.159894 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:29.159569 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:29.208658 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:29.208631 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal_faef41a99e20c7786e2ef3c0f1740e1b/setup/0.log" Jul 17 14:49:29.208784 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:29.208671 2574 generic.go:356] "Generic (PLEG): container finished" podID="faef41a99e20c7786e2ef3c0f1740e1b" containerID="8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9" exitCode=1 Jul 17 14:49:29.208784 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:29.208705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" event={"ID":"faef41a99e20c7786e2ef3c0f1740e1b","Type":"ContainerDied","Data":"8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9"} Jul 17 14:49:30.212010 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:30.211985 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal_faef41a99e20c7786e2ef3c0f1740e1b/setup/0.log" Jul 17 14:49:30.212420 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:30.212037 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" event={"ID":"faef41a99e20c7786e2ef3c0f1740e1b","Type":"ContainerStarted","Data":"b538e22a1aa1dd11e0c3e847860fba33e5f04fa43ad6ff4ef0749d6b174754f0"} Jul 17 14:49:31.159134 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:31.159091 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:31.159321 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:31.159213 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:31.739113 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:31.739075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:31.739501 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:31.739179 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:31.739501 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:31.739243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:47.739230457 +0000 UTC m=+34.091124067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:33.159763 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:33.159714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:33.160150 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:33.159827 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:35.159498 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:35.159463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:35.159872 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:35.159557 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:37.159082 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:37.159045 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:37.159678 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:37.159171 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:38.056233 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:38.056182 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5q8s2" Jul 17 14:49:39.059373 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.059325 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 14:44:38 +0000 UTC" deadline="2028-03-29 22:11:51.49790389 +0000 UTC" Jul 17 14:49:39.059373 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.059362 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14911h22m12.438545717s" Jul 17 14:49:39.159429 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.159395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:39.159595 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:39.159499 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:39.228311 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.228287 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal_faef41a99e20c7786e2ef3c0f1740e1b/setup/0.log" Jul 17 14:49:39.228434 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.228321 2574 generic.go:356] "Generic (PLEG): container finished" podID="faef41a99e20c7786e2ef3c0f1740e1b" containerID="b538e22a1aa1dd11e0c3e847860fba33e5f04fa43ad6ff4ef0749d6b174754f0" exitCode=0 Jul 17 14:49:39.228434 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.228354 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" event={"ID":"faef41a99e20c7786e2ef3c0f1740e1b","Type":"ContainerDied","Data":"b538e22a1aa1dd11e0c3e847860fba33e5f04fa43ad6ff4ef0749d6b174754f0"} Jul 17 14:49:39.228434 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.228392 2574 scope.go:117] "RemoveContainer" containerID="8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9" Jul 17 14:49:39.228750 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.228726 2574 scope.go:117] "RemoveContainer" containerID="8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9" Jul 17 14:49:39.239015 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:39.238986 2574 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal_openshift-machine-config-operator_faef41a99e20c7786e2ef3c0f1740e1b_0 in pod sandbox 2762ad42a9f1e4b12f4ab1f02f41751525b774f5f037d4d1b14a1ff6665ea1b0 from index: no such id: '8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9'" containerID="8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9" Jul 17 14:49:39.239107 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:39.239027 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9"} err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal_openshift-machine-config-operator_faef41a99e20c7786e2ef3c0f1740e1b_0 in pod sandbox 2762ad42a9f1e4b12f4ab1f02f41751525b774f5f037d4d1b14a1ff6665ea1b0 from index: no such id: '8a44c5f7c430d4d2a14f74cb203bfc54727b876de9196887506dc02b43e993c9'" Jul 17 14:49:40.060349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:40.060146 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 14:44:38 +0000 UTC" deadline="2028-01-25 22:01:44.70929477 +0000 UTC" Jul 17 14:49:40.060349 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:40.060338 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13375h12m4.648961056s" Jul 17 14:49:40.231124 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:40.231091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" event={"ID":"faef41a99e20c7786e2ef3c0f1740e1b","Type":"ContainerStarted","Data":"8419fbb67c53568bdbb74e9fc09346f154cd60d7e0fd0889bb50dbcb34f70237"} Jul 17 14:49:40.246401 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:40.246361 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-74.ec2.internal" podStartSLOduration=25.246346932 podStartE2EDuration="25.246346932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:40.246159958 +0000 UTC m=+26.598053589" watchObservedRunningTime="2026-07-17 14:49:40.246346932 +0000 UTC m=+26.598240568" Jul 17 14:49:41.159257 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:41.159226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:41.159645 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:41.159328 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:43.159661 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.159626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:43.160038 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:43.159733 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:43.558123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.558102 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-6jnrx"] Jul 17 14:49:43.560793 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.560778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.567048 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.567025 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 14:49:43.567823 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.567799 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 14:49:43.567823 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.567818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 14:49:43.571735 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.571721 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-clq4r\"" Jul 17 14:49:43.597485 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.597459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw2gc\" (UniqueName: \"kubernetes.io/projected/7ece9582-f509-4f33-ad29-b52b0f78fdd1-kube-api-access-pw2gc\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.597571 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.597503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ece9582-f509-4f33-ad29-b52b0f78fdd1-host\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.597571 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.597522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ece9582-f509-4f33-ad29-b52b0f78fdd1-serviceca\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.698289 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.698248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw2gc\" (UniqueName: \"kubernetes.io/projected/7ece9582-f509-4f33-ad29-b52b0f78fdd1-kube-api-access-pw2gc\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.698441 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.698306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ece9582-f509-4f33-ad29-b52b0f78fdd1-host\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.698441 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.698330 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ece9582-f509-4f33-ad29-b52b0f78fdd1-serviceca\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.698561 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.698431 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ece9582-f509-4f33-ad29-b52b0f78fdd1-host\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.698767 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.698747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ece9582-f509-4f33-ad29-b52b0f78fdd1-serviceca\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.718239 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.718208 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw2gc\" (UniqueName: \"kubernetes.io/projected/7ece9582-f509-4f33-ad29-b52b0f78fdd1-kube-api-access-pw2gc\") pod \"node-ca-6jnrx\" (UID: \"7ece9582-f509-4f33-ad29-b52b0f78fdd1\") " pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.868618 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:43.868536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6jnrx" Jul 17 14:49:43.878254 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:49:43.878217 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ece9582_f509_4f33_ad29_b52b0f78fdd1.slice/crio-630d59ddab878987aafaca47c01791504128aca0b03cb0b4cfe4d2e9729ae4bb WatchSource:0}: Error finding container 630d59ddab878987aafaca47c01791504128aca0b03cb0b4cfe4d2e9729ae4bb: Status 404 returned error can't find the container with id 630d59ddab878987aafaca47c01791504128aca0b03cb0b4cfe4d2e9729ae4bb Jul 17 14:49:44.239638 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:44.239554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6jnrx" event={"ID":"7ece9582-f509-4f33-ad29-b52b0f78fdd1","Type":"ContainerStarted","Data":"630d59ddab878987aafaca47c01791504128aca0b03cb0b4cfe4d2e9729ae4bb"} Jul 17 14:49:45.158953 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:45.158919 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:45.159253 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:45.159033 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:46.244334 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:46.244254 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6jnrx" event={"ID":"7ece9582-f509-4f33-ad29-b52b0f78fdd1","Type":"ContainerStarted","Data":"c127dd965033ee4a40dfc7c33f1132f35672d11fdc5456593337e618ed76891a"} Jul 17 14:49:47.158931 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:47.158901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:47.159186 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:47.159005 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:47.822322 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:47.822284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:47.822708 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:47.822390 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:47.822708 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:47.822443 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:19.822428127 +0000 UTC m=+66.174321737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:49:49.159525 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:49.159496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:49.159901 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:49.159586 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:51.159679 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:51.159643 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:51.160052 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:51.159744 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:53.158844 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:53.158808 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:53.159234 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:53.158916 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:55.159129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:55.159092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:55.159539 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:55.159207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:57.158892 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:57.158852 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:57.159400 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:57.158951 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:49:59.159083 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:49:59.159032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:49:59.159560 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:49:59.159158 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:01.158711 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:01.158673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:01.159111 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:01.158776 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:03.158725 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:03.158690 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:03.159106 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:03.158793 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:05.159157 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:05.159125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:05.159549 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:05.159236 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:07.159746 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:07.159701 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:07.160225 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:07.159812 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:09.159045 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:09.159009 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:09.159451 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:09.159107 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:11.159701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:11.159642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:11.160146 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:11.159785 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:13.159272 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:13.159234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:13.159662 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:13.159339 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:15.159458 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:15.159414 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:15.159855 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:15.159523 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:17.159421 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:17.159387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:17.159813 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:17.159480 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:19.159036 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.158998 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:19.159532 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:19.159103 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:19.857260 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.857177 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6jnrx" podStartSLOduration=34.950936522 podStartE2EDuration="36.857162778s" totalImagesPullingTime="1.906226256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:46.273994739 +0000 UTC m=+32.625888371" watchObservedRunningTime="2026-07-17 14:50:19.857162778 +0000 UTC m=+66.209056410" Jul 17 14:50:19.857485 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.857472 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-jt5k4"] Jul 17 14:50:19.860177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.860162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.863418 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.863398 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 14:50:19.864289 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.864266 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 14:50:19.864389 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.864266 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 14:50:19.864459 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.864417 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 14:50:19.864459 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.864445 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95ht5\"" Jul 17 14:50:19.899320 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.899293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:19.899436 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:19.899383 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:50:19.899436 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:19.899429 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:23.899414384 +0000 UTC m=+130.251307995 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:50:19.999756 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999732 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-system-cni-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999756 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-k8s-cni-cncf-io\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-cni-bin\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-etc-kubernetes\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbnv\" (UniqueName: \"kubernetes.io/projected/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-kube-api-access-7hbnv\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-socket-dir-parent\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-netns\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-hostroot\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:19.999928 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-cni-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-kubelet\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-conf-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:19.999979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-cnibin\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.000013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-multus-certs\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.000029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-cni-multus\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.000050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-daemon-config\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.000065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-os-release\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.000177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.000078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-cni-binary-copy\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.075368 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.075340 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-244qn"] Jul 17 14:50:20.078019 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.078004 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.083873 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.083850 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwxk5\"" Jul 17 14:50:20.083979 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.083964 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 14:50:20.084117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.084102 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 14:50:20.100890 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-multus-certs\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101000 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-cni-multus\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101000 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-daemon-config\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101000 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-os-release\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101000 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-cni-binary-copy\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101000 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-system-cni-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101000 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100967 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-multus-certs\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100991 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-cni-multus\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.100993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-k8s-cni-cncf-io\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101041 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-os-release\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101045 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-k8s-cni-cncf-io\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-cni-bin\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-etc-kubernetes\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbnv\" (UniqueName: \"kubernetes.io/projected/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-kube-api-access-7hbnv\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101140 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-system-cni-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101178 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-cni-bin\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101188 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-etc-kubernetes\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-socket-dir-parent\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-netns\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-hostroot\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101332 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-cni-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101344 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-run-netns\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101368 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-cni-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-kubelet\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-conf-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-hostroot\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-cnibin\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101451 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-host-var-lib-kubelet\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101452 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-socket-dir-parent\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101487 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-conf-dir\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-cnibin\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101603 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-multus-daemon-config\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.101796 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.101629 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-cni-binary-copy\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.116001 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.115881 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbnv\" (UniqueName: \"kubernetes.io/projected/ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26-kube-api-access-7hbnv\") pod \"multus-jt5k4\" (UID: \"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26\") " pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.168603 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.168571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jt5k4" Jul 17 14:50:20.202499 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-cnibin\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202601 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-os-release\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202601 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-cni-binary-copy\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202601 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-system-cni-dir\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202601 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86vf\" (UniqueName: \"kubernetes.io/projected/f810e60c-dab4-4451-98cc-3d665712f638-kube-api-access-c86vf\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-tuning-conf-dir\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.202743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.202715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303575 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-os-release\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303575 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-cni-binary-copy\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-system-cni-dir\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86vf\" (UniqueName: \"kubernetes.io/projected/f810e60c-dab4-4451-98cc-3d665712f638-kube-api-access-c86vf\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303672 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-system-cni-dir\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303672 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-os-release\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-tuning-conf-dir\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.303788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-cnibin\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.304116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303842 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-cnibin\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.304116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.303956 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f810e60c-dab4-4451-98cc-3d665712f638-tuning-conf-dir\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.304253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.304233 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-cni-binary-copy\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.304375 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.304355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.304434 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.304355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f810e60c-dab4-4451-98cc-3d665712f638-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.305822 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.305793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt5k4" event={"ID":"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26","Type":"ContainerStarted","Data":"5602c2a6501ebd3ba4096fd2a24b3c5e5143debea9f9541e724546668b40e220"} Jul 17 14:50:20.315367 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.315344 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86vf\" (UniqueName: \"kubernetes.io/projected/f810e60c-dab4-4451-98cc-3d665712f638-kube-api-access-c86vf\") pod \"multus-additional-cni-plugins-244qn\" (UID: \"f810e60c-dab4-4451-98cc-3d665712f638\") " pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.385550 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.385436 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-244qn" Jul 17 14:50:20.396657 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:50:20.396632 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf810e60c_dab4_4451_98cc_3d665712f638.slice/crio-dbd42b32063c2645b3d48b3f3190663f72cf5fc9ea3366e29da339cb9bbbb181 WatchSource:0}: Error finding container dbd42b32063c2645b3d48b3f3190663f72cf5fc9ea3366e29da339cb9bbbb181: Status 404 returned error can't find the container with id dbd42b32063c2645b3d48b3f3190663f72cf5fc9ea3366e29da339cb9bbbb181 Jul 17 14:50:20.864519 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.864489 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9kdnc"] Jul 17 14:50:20.867264 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:20.867239 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:20.867428 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:20.867328 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:21.008992 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.008962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:21.008992 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.009000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dzkf\" (UniqueName: \"kubernetes.io/projected/186f59e1-2bef-4115-80f2-2f2f83a0f50d-kube-api-access-7dzkf\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:21.109262 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.109214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:21.109514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.109273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dzkf\" (UniqueName: \"kubernetes.io/projected/186f59e1-2bef-4115-80f2-2f2f83a0f50d-kube-api-access-7dzkf\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:21.109514 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:21.109403 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:21.109514 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:21.109456 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:50:21.609443043 +0000 UTC m=+67.961336652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:21.121413 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.121330 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dzkf\" (UniqueName: \"kubernetes.io/projected/186f59e1-2bef-4115-80f2-2f2f83a0f50d-kube-api-access-7dzkf\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:21.159386 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.159347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:21.159548 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:21.159477 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:21.309006 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.308963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerStarted","Data":"dbd42b32063c2645b3d48b3f3190663f72cf5fc9ea3366e29da339cb9bbbb181"} Jul 17 14:50:21.612798 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:21.612768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:21.612999 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:21.612956 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:21.613065 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:21.613033 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:50:22.613010622 +0000 UTC m=+68.964904249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:22.159509 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:22.159475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:22.159707 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:22.159630 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:22.621638 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:22.621601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:22.622069 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:22.621787 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:22.622069 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:22.621867 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:50:24.621846967 +0000 UTC m=+70.973740592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:23.159015 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:23.158984 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:23.159257 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:23.159106 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:23.315538 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:23.315502 2574 generic.go:356] "Generic (PLEG): container finished" podID="f810e60c-dab4-4451-98cc-3d665712f638" containerID="0e82b71e0366eaba8b0a443d8359b4d2aacfb51435ee6d5eadee5eaebd280fcb" exitCode=0 Jul 17 14:50:23.315713 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:23.315559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerDied","Data":"0e82b71e0366eaba8b0a443d8359b4d2aacfb51435ee6d5eadee5eaebd280fcb"} Jul 17 14:50:24.160898 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:24.160056 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:24.160898 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:24.160177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:24.635712 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:24.635661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:24.635897 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:24.635845 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:24.635945 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:24.635913 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:50:28.635892442 +0000 UTC m=+74.987786056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:25.159618 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:25.159583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:25.159805 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:25.159713 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:26.159121 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:26.159073 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:26.159533 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:26.159240 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:27.159390 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:27.159352 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:27.159782 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:27.159468 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:28.159256 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:28.159219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:28.159451 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:28.159372 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:28.662382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:28.662345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:28.662573 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:28.662482 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:28.662573 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:28.662549 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:50:36.662530638 +0000 UTC m=+83.014424251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:29.159572 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:29.159543 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:29.160051 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:29.159671 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:30.159581 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.159541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:30.160013 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:30.159826 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:30.690616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.690581 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kr5x8"] Jul 17 14:50:30.695184 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.695161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.699482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.699455 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 14:50:30.699607 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.699484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6r5mr\"" Jul 17 14:50:30.699843 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.699826 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 14:50:30.699930 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.699912 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 14:50:30.700054 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.700041 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 14:50:30.700206 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.700179 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 14:50:30.700294 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.699826 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 14:50:30.775639 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-kubelet\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.775832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-var-lib-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.775832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-script-lib\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.775832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-bin\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.775832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.775832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-etc-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.775832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-netd\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6ff2a3c-00e4-4b86-846a-824e37213441-ovn-node-metrics-cert\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-systemd-units\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-slash\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-ovn-kubernetes\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.775988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776003 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-log-socket\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-node-log\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-config\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-netns\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776530 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74cwl\" (UniqueName: \"kubernetes.io/projected/b6ff2a3c-00e4-4b86-846a-824e37213441-kube-api-access-74cwl\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776530 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-systemd\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776530 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-env-overrides\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.776530 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.776245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-ovn\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877251 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-node-log\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-config\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877267 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-node-log\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-netns\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74cwl\" (UniqueName: \"kubernetes.io/projected/b6ff2a3c-00e4-4b86-846a-824e37213441-kube-api-access-74cwl\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-systemd\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-env-overrides\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-ovn\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-kubelet\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-var-lib-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-script-lib\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-bin\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-etc-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-netd\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6ff2a3c-00e4-4b86-846a-824e37213441-ovn-node-metrics-cert\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-systemd-units\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-slash\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-ovn-kubernetes\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.877788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-log-socket\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877838 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-log-socket\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877871 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-config\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877889 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-netns\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877924 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-bin\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.877969 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-etc-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878006 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-netd\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878282 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-systemd\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878449 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-slash\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878494 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-systemd-units\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-ovn-kubernetes\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-kubelet\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878552 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-ovn\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878600 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-var-lib-openvswitch\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.878701 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.878642 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-env-overrides\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.879048 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.879030 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-script-lib\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.880902 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.880880 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6ff2a3c-00e4-4b86-846a-824e37213441-ovn-node-metrics-cert\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:30.891977 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:30.891941 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74cwl\" (UniqueName: \"kubernetes.io/projected/b6ff2a3c-00e4-4b86-846a-824e37213441-kube-api-access-74cwl\") pod \"ovnkube-node-kr5x8\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:31.004762 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:31.004685 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:31.159346 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:31.159308 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:31.159543 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:31.159423 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:31.478745 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:50:31.478717 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ff2a3c_00e4_4b86_846a_824e37213441.slice/crio-d8b14849c79a2d5021626815d5453fe0569c87ee160562b699abaee92d172a41 WatchSource:0}: Error finding container d8b14849c79a2d5021626815d5453fe0569c87ee160562b699abaee92d172a41: Status 404 returned error can't find the container with id d8b14849c79a2d5021626815d5453fe0569c87ee160562b699abaee92d172a41 Jul 17 14:50:32.159595 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:32.159562 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:32.159765 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:32.159703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:32.336998 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:32.336959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"d8b14849c79a2d5021626815d5453fe0569c87ee160562b699abaee92d172a41"} Jul 17 14:50:32.338994 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:32.338957 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt5k4" event={"ID":"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26","Type":"ContainerStarted","Data":"28cb663cb2daa8357b44a1e5af00092800678ced1fd1b133793d999848df23f6"} Jul 17 14:50:32.341456 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:32.341430 2574 generic.go:356] "Generic (PLEG): container finished" podID="f810e60c-dab4-4451-98cc-3d665712f638" containerID="2ad0a3821e826030ae7b1e5e15c97573b180f33f339fef7e03490af096beecba" exitCode=0 Jul 17 14:50:32.341578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:32.341465 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerDied","Data":"2ad0a3821e826030ae7b1e5e15c97573b180f33f339fef7e03490af096beecba"} Jul 17 14:50:32.394547 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:32.394489 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jt5k4" podStartSLOduration=2.056505482 podStartE2EDuration="13.394467001s" totalImagesPullingTime="11.337961519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:32.36154015 +0000 UTC m=+78.713433782" watchObservedRunningTime="2026-07-17 14:50:32.394467001 +0000 UTC m=+78.746360634" Jul 17 14:50:33.158788 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:33.158747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:33.159257 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:33.158890 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:33.668385 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:33.668286 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-gkbxj"] Jul 17 14:50:33.671729 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:33.671293 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:33.671729 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:33.671380 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:33.797851 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:33.797815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:33.898742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:33.898692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:33.907982 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:33.907949 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:50:33.907982 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:33.907986 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:50:33.908152 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:33.908001 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:33.908152 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:33.908090 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:50:34.408069238 +0000 UTC m=+80.759962863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:34.160640 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:34.160602 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:34.161090 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:34.160718 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:34.347319 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:34.347277 2574 generic.go:356] "Generic (PLEG): container finished" podID="f810e60c-dab4-4451-98cc-3d665712f638" containerID="9d2d6e88b8b70773bbe51b1a560060ffdc5039d1d3f2b8324c6fa281e9d8359a" exitCode=0 Jul 17 14:50:34.347473 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:34.347343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerDied","Data":"9d2d6e88b8b70773bbe51b1a560060ffdc5039d1d3f2b8324c6fa281e9d8359a"} Jul 17 14:50:34.502012 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:34.501904 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:34.502157 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:34.502051 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:50:34.502157 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:34.502073 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:50:34.502157 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:34.502086 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:34.502157 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:34.502135 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:50:35.50212153 +0000 UTC m=+81.854015140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:35.159238 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:35.159177 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:35.159238 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:35.159232 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:35.159472 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:35.159330 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:35.159472 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:35.159408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:35.351499 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:35.351468 2574 generic.go:356] "Generic (PLEG): container finished" podID="f810e60c-dab4-4451-98cc-3d665712f638" containerID="f681884a28d21ac42d5fe586e66f5d60b1281c72ff32d5eaa29da82ba5b6be88" exitCode=0 Jul 17 14:50:35.351881 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:35.351510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerDied","Data":"f681884a28d21ac42d5fe586e66f5d60b1281c72ff32d5eaa29da82ba5b6be88"} Jul 17 14:50:35.508513 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:35.508440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:35.508700 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:35.508594 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:50:35.508700 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:35.508616 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:50:35.508700 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:35.508629 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:35.508700 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:35.508686 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:50:37.508666925 +0000 UTC m=+83.860560541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:36.159431 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:36.159393 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:36.159598 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:36.159511 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:36.719370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:36.719324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:36.719842 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:36.719471 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:36.719842 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:36.719542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:50:52.71952349 +0000 UTC m=+99.071417121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:37.083787 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.083758 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-ktxp4"] Jul 17 14:50:37.111358 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.111327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.115353 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.115329 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 14:50:37.115566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.115540 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fsd6h\"" Jul 17 14:50:37.116758 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.116737 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 14:50:37.117396 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.117373 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 14:50:37.159857 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.159711 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:37.160047 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.159872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:37.160047 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:37.159987 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:37.160282 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:37.160246 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:37.222763 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.222716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-iptables-alerter-script\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.222923 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.222816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-host-slash\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.222923 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.222847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c6bn\" (UniqueName: \"kubernetes.io/projected/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-kube-api-access-6c6bn\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.323890 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.323851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-iptables-alerter-script\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.324050 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.323942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-host-slash\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.324050 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.323983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c6bn\" (UniqueName: \"kubernetes.io/projected/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-kube-api-access-6c6bn\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.324175 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.324066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-host-slash\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.324620 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.324546 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-iptables-alerter-script\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.337443 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.337369 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c6bn\" (UniqueName: \"kubernetes.io/projected/b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a-kube-api-access-6c6bn\") pod \"iptables-alerter-ktxp4\" (UID: \"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a\") " pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.424076 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.424027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktxp4" Jul 17 14:50:37.455390 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:50:37.455357 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45ee4cd_3bda_4b73_81d8_9e6d0bb51b0a.slice/crio-a711f32f01b443ae89f0670ebccd543f844b92c0be06d61e7e8f31b4337eebd1 WatchSource:0}: Error finding container a711f32f01b443ae89f0670ebccd543f844b92c0be06d61e7e8f31b4337eebd1: Status 404 returned error can't find the container with id a711f32f01b443ae89f0670ebccd543f844b92c0be06d61e7e8f31b4337eebd1 Jul 17 14:50:37.526748 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:37.526709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:37.526931 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:37.526915 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:50:37.526977 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:37.526936 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:50:37.526977 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:37.526946 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:37.527036 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:37.526995 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:50:41.52698143 +0000 UTC m=+87.878875054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:38.160750 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:38.160721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:38.161239 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:38.160858 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:38.360111 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:38.360063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktxp4" event={"ID":"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a","Type":"ContainerStarted","Data":"a711f32f01b443ae89f0670ebccd543f844b92c0be06d61e7e8f31b4337eebd1"} Jul 17 14:50:39.159016 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:39.158983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:39.159016 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:39.159005 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:39.159244 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:39.159107 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:39.159297 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:39.159239 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:40.159474 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:40.159435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:40.159936 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:40.159590 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:41.159059 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:41.159009 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:41.159345 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:41.159127 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:41.159345 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:41.159208 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:41.159345 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:41.159296 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:41.558260 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:41.558228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:41.558656 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:41.558360 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:50:41.558656 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:41.558386 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:50:41.558656 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:41.558399 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:41.558656 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:41.558459 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:50:49.558444144 +0000 UTC m=+95.910337758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:42.159433 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:42.159392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:42.159607 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:42.159546 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:43.159778 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:43.159734 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:43.159778 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:43.159768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:43.160233 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:43.159855 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:43.160233 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:43.159986 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:44.160116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:44.160083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:44.160562 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:44.160227 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:45.159656 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:45.159624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:45.159820 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:45.159629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:45.159820 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:45.159732 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:45.159820 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:45.159805 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:46.159430 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.159260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:46.160158 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:46.159543 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:46.379185 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379114 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/0.log" Jul 17 14:50:46.379488 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379470 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="7b462c2b03a424c7fca1a05aa954cdf4fbae77be4db4900ec7e954edb050aa43" exitCode=1 Jul 17 14:50:46.379575 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1"} Jul 17 14:50:46.379685 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010"} Jul 17 14:50:46.379685 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379661 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f"} Jul 17 14:50:46.379782 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630"} Jul 17 14:50:46.379782 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"7b462c2b03a424c7fca1a05aa954cdf4fbae77be4db4900ec7e954edb050aa43"} Jul 17 14:50:46.379782 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.379757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1"} Jul 17 14:50:46.382028 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.382005 2574 generic.go:356] "Generic (PLEG): container finished" podID="f810e60c-dab4-4451-98cc-3d665712f638" containerID="7f9387e74988ae74ca0c074acba3df389d3dbea71da758dbfab361531977b8e5" exitCode=0 Jul 17 14:50:46.382119 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:46.382049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerDied","Data":"7f9387e74988ae74ca0c074acba3df389d3dbea71da758dbfab361531977b8e5"} Jul 17 14:50:47.159574 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:47.159396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:47.159972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:47.159396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:47.159972 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:47.159653 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:47.159972 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:47.159717 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:47.387144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:47.387109 2574 generic.go:356] "Generic (PLEG): container finished" podID="f810e60c-dab4-4451-98cc-3d665712f638" containerID="89c81176e047207e0361203f1839d7bdb74f56267016ca1bfe92c289ff8d15cb" exitCode=0 Jul 17 14:50:47.387323 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:47.387205 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerDied","Data":"89c81176e047207e0361203f1839d7bdb74f56267016ca1bfe92c289ff8d15cb"} Jul 17 14:50:47.388655 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:47.388632 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktxp4" event={"ID":"b45ee4cd-3bda-4b73-81d8-9e6d0bb51b0a","Type":"ContainerStarted","Data":"1cff3b8ff22a2794112e59100dcbc84f50a095e058cf52a80792bed55a553dc4"} Jul 17 14:50:48.159721 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:48.159689 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:48.160228 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:48.159819 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:48.393829 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:48.393792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-244qn" event={"ID":"f810e60c-dab4-4451-98cc-3d665712f638","Type":"ContainerStarted","Data":"60e6e57e29f668a5a4d642496a1e1c632ed1a159e165d281ae4a2ca4920531e1"} Jul 17 14:50:48.414449 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:48.414356 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ktxp4" podStartSLOduration=3.288353425 podStartE2EDuration="11.414342143s" totalImagesPullingTime="8.125988718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:47.427296166 +0000 UTC m=+93.779189805" watchObservedRunningTime="2026-07-17 14:50:48.414342143 +0000 UTC m=+94.766235769" Jul 17 14:50:48.414562 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:48.414505 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-244qn" podStartSLOduration=5.844151549 podStartE2EDuration="28.414501345s" totalImagesPullingTime="22.570349796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:48.414314685 +0000 UTC m=+94.766208316" watchObservedRunningTime="2026-07-17 14:50:48.414501345 +0000 UTC m=+94.766394976" Jul 17 14:50:49.159787 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:49.159749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:49.160220 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:49.159750 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:49.160220 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:49.159844 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:49.160220 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:49.159947 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:49.398141 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:49.398113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/0.log" Jul 17 14:50:49.398483 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:49.398455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061"} Jul 17 14:50:49.614952 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:49.614915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:49.615116 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:49.615062 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:50:49.615116 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:49.615079 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:50:49.615116 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:49.615087 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:49.615257 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:49.615133 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:51:05.615121555 +0000 UTC m=+111.967015166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:50:50.159587 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:50.159556 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:50.159767 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:50.159669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:51.158952 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.158778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:51.159419 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.158831 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:51.159419 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:51.159028 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:51.159419 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:51.159109 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:51.407809 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.407785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/0.log" Jul 17 14:50:51.408134 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.408113 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536"} Jul 17 14:50:51.408356 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.408337 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:51.408558 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.408537 2574 scope.go:117] "RemoveContainer" containerID="7b462c2b03a424c7fca1a05aa954cdf4fbae77be4db4900ec7e954edb050aa43" Jul 17 14:50:51.426903 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:51.426873 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:52.158835 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.158800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:52.159021 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:52.158911 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:52.413355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.413276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/0.log" Jul 17 14:50:52.413585 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.413560 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerStarted","Data":"a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2"} Jul 17 14:50:52.413899 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.413880 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:52.413964 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.413954 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:52.429049 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.429023 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:50:52.442672 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.442613 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podStartSLOduration=8.287940289 podStartE2EDuration="22.442593805s" totalImagesPullingTime="14.154653516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:52.441220236 +0000 UTC m=+98.793113869" watchObservedRunningTime="2026-07-17 14:50:52.442593805 +0000 UTC m=+98.794487439" Jul 17 14:50:52.736405 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:52.736297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:52.736588 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:52.736418 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:52.736588 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:52.736478 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:51:24.736460259 +0000 UTC m=+131.088353871 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:50:53.159786 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:53.159749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:53.160242 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:53.159748 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:53.160242 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:53.159863 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:53.160242 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:53.159961 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:54.160520 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:54.160484 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:54.160990 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:54.160571 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:55.158734 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.158705 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:55.158930 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.158706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:55.158930 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:55.158807 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:55.158930 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:55.158895 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:55.515053 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.514976 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kr5x8"] Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515262 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-controller" containerID="cri-o://e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1" gracePeriod=30 Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515299 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" containerID="cri-o://a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2" gracePeriod=30 Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515322 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="northd" containerID="cri-o://934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010" gracePeriod=30 Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515356 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" containerID="cri-o://cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" gracePeriod=30 Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515291 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" containerID="cri-o://0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" gracePeriod=30 Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515392 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-node" containerID="cri-o://8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630" gracePeriod=30 Jul 17 14:50:55.515616 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.515569 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f" gracePeriod=30 Jul 17 14:50:55.533372 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.533324 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovnkube-controller" probeResult="failure" output="" Jul 17 14:50:55.551774 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:55.551729 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovnkube-controller" containerID="cri-o://0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" gracePeriod=30 Jul 17 14:50:56.159129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.159093 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:56.159349 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:56.159245 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:56.422465 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.422392 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/1.log" Jul 17 14:50:56.423957 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.423938 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:50:56.424344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.424331 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-node/0.log" Jul 17 14:50:56.424684 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.424671 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/0.log" Jul 17 14:50:56.425062 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425050 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-controller/0.log" Jul 17 14:50:56.425123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425082 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2" exitCode=143 Jul 17 14:50:56.425123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425097 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" exitCode=0 Jul 17 14:50:56.425123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425105 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" exitCode=0 Jul 17 14:50:56.425123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425110 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010" exitCode=0 Jul 17 14:50:56.425123 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425116 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f" exitCode=143 Jul 17 14:50:56.425317 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425125 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630" exitCode=143 Jul 17 14:50:56.425317 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425133 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1" exitCode=143 Jul 17 14:50:56.425317 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2"} Jul 17 14:50:56.425317 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061"} Jul 17 14:50:56.425317 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1"} Jul 17 14:50:56.425317 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010"} Jul 17 14:50:56.425548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f"} Jul 17 14:50:56.425548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425325 2574 scope.go:117] "RemoveContainer" containerID="7b462c2b03a424c7fca1a05aa954cdf4fbae77be4db4900ec7e954edb050aa43" Jul 17 14:50:56.425548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425350 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630"} Jul 17 14:50:56.425548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:56.425383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1"} Jul 17 14:50:57.159325 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:57.159289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:57.159936 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:57.159289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:57.159936 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:57.159419 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:50:57.159936 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:57.159488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:57.429055 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:57.428977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/1.log" Jul 17 14:50:57.430644 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:57.430627 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:50:57.431036 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:57.431021 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-node/0.log" Jul 17 14:50:57.431436 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:57.431424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-controller/0.log" Jul 17 14:50:58.158987 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:58.158957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:50:58.159142 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:58.159068 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:50:59.159401 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:59.159363 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:50:59.159401 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:50:59.159395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:50:59.159923 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:59.159470 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:50:59.159923 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:50:59.159533 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:00.159341 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:00.159302 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:00.159511 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:00.159437 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:01.159023 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:01.158993 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:01.159207 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:01.158993 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:01.159207 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:01.159086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:01.159207 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:01.159166 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:01.409642 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:01.409549 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:01.410041 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:01.409885 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:01.410149 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:01.410126 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:01.410212 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:01.410160 2574 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" probeResult="unknown" Jul 17 14:51:02.159228 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:02.159180 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:02.159384 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:02.159326 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:02.415173 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:02.415083 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:02.415610 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:02.415391 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:02.415659 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:02.415636 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:02.415696 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:02.415668 2574 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" probeResult="unknown" Jul 17 14:51:03.159704 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:03.159667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:03.159704 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:03.159692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:03.159917 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:03.159790 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:03.159917 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:03.159903 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:04.160877 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:04.160842 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:04.161271 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:04.160977 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:05.159353 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:05.159322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:05.159353 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:05.159357 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:05.159548 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:05.159431 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:05.159548 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:05.159493 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:05.626731 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:05.626692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:05.627155 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:05.626882 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:51:05.627155 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:05.626906 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:51:05.627155 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:05.626917 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:51:05.627155 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:05.626975 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:51:37.626955173 +0000 UTC m=+143.978848784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:51:06.159320 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:06.159285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:06.159518 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:06.159422 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:07.159493 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:07.159459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:07.159912 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:07.159460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:07.159912 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:07.159560 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:07.159912 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:07.159670 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:08.159759 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:08.159730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:08.160279 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:08.159835 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:09.159142 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:09.159107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:09.159325 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:09.159112 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:09.159325 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:09.159234 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:09.159325 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:09.159290 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:10.159010 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:10.158975 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:10.159425 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:10.159086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:11.159645 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:11.159609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:11.160099 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:11.159609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:11.160099 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:11.159758 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:11.160099 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:11.159784 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:11.409291 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:11.409246 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:11.409531 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:11.409503 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:11.409765 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:11.409715 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:11.409765 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:11.409747 2574 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" probeResult="unknown" Jul 17 14:51:12.158997 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:12.158960 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:12.159165 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:12.159108 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:12.414465 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:12.414378 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:12.414972 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:12.414622 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:12.414972 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:12.414880 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:12.414972 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:12.414904 2574 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" probeResult="unknown" Jul 17 14:51:13.158773 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:13.158736 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:13.158941 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:13.158840 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:13.158941 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:13.158867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:13.158941 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:13.158913 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:14.136291 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:14.136264 2574 kubelet_node_status.go:448] "Node not becoming ready in time after startup" Jul 17 14:51:14.161003 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:14.160974 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:14.161129 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:14.161102 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:15.159678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:15.159641 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:15.160085 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:15.159645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:15.160085 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:15.159751 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:15.160085 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:15.159831 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:16.161548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:16.161516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:16.161903 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:16.161622 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:17.159083 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:17.159052 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:17.159269 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:17.159060 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:17.159269 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:17.159157 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:17.159358 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:17.159270 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:17.477230 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:17.477145 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 14:51:17.477230 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:17.477181 2574 generic.go:356] "Generic (PLEG): container finished" podID="ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26" containerID="28cb663cb2daa8357b44a1e5af00092800678ced1fd1b133793d999848df23f6" exitCode=1 Jul 17 14:51:17.477608 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:17.477234 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt5k4" event={"ID":"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26","Type":"ContainerDied","Data":"28cb663cb2daa8357b44a1e5af00092800678ced1fd1b133793d999848df23f6"} Jul 17 14:51:17.477608 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:17.477557 2574 scope.go:117] "RemoveContainer" containerID="28cb663cb2daa8357b44a1e5af00092800678ced1fd1b133793d999848df23f6" Jul 17 14:51:18.162231 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:18.162039 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:18.162387 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:18.162307 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:18.481216 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:18.481125 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 14:51:18.481586 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:18.481211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt5k4" event={"ID":"ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26","Type":"ContainerStarted","Data":"235d88752b42bdc66a6fb9bcf0e13bcfd67996d90ae869391b2dddf4e054cd89"} Jul 17 14:51:19.125925 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:19.125886 2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Jul 17 14:51:19.159787 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:19.159755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:19.159937 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:19.159755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:19.159937 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:19.159886 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:19.160044 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:19.159946 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:20.158881 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:20.158846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:20.159272 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:20.158994 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:21.159563 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:21.159528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:21.159956 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:21.159532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:21.159956 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:21.159630 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:21.159956 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:21.159698 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:21.409164 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:21.409121 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:21.409515 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:21.409475 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:21.409835 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:21.409782 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Jul 17 14:51:21.409835 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:21.409820 2574 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" probeResult="unknown" Jul 17 14:51:22.159703 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:22.159672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:22.160063 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:22.159787 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:22.414242 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:22.414118 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:22.414455 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:22.414422 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:22.414736 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:22.414712 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Jul 17 14:51:22.414806 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:22.414759 2574 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" probeResult="unknown" Jul 17 14:51:23.158979 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:23.158941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:23.158979 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:23.158979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:23.159282 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:23.159061 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:23.159282 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:23.159142 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:23.961528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:23.961488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:23.961904 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:23.961611 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 14:51:23.961904 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:23.961663 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret podName:b66703c1-056c-48af-b986-c4dd73996a89 nodeName:}" failed. No retries permitted until 2026-07-17 14:53:25.961650553 +0000 UTC m=+252.313544164 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret") pod "global-pull-secret-syncer-42vbh" (UID: "b66703c1-056c-48af-b986-c4dd73996a89") : object "kube-system"/"original-pull-secret" not registered Jul 17 14:51:24.126159 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:24.126125 2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Jul 17 14:51:24.160551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:24.160518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:24.160701 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:24.160608 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:24.767512 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:24.767471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:24.767691 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:24.767618 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:51:24.767732 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:24.767691 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs podName:186f59e1-2bef-4115-80f2-2f2f83a0f50d nodeName:}" failed. No retries permitted until 2026-07-17 14:52:28.76767462 +0000 UTC m=+195.119568232 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs") pod "network-metrics-daemon-9kdnc" (UID: "186f59e1-2bef-4115-80f2-2f2f83a0f50d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 14:51:25.159576 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.159545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:25.159926 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.159545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:25.159926 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:25.159650 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:25.159926 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:25.159727 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:25.517213 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:25.517109 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" cmd=["test","-f","/etc/cni/net.d/10-ovn-kubernetes.conf"] Jul 17 14:51:25.518008 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:25.517979 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" cmd=["test","-f","/etc/cni/net.d/10-ovn-kubernetes.conf"] Jul 17 14:51:25.518847 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:25.518814 2574 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" cmd=["test","-f","/etc/cni/net.d/10-ovn-kubernetes.conf"] Jul 17 14:51:25.518902 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:25.518859 2574 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovnkube-controller" probeResult="unknown" Jul 17 14:51:25.623309 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.623289 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/1.log" Jul 17 14:51:25.623783 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.623768 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovnkube-controller/0.log" Jul 17 14:51:25.625017 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.625000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:51:25.625450 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.625436 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-node/0.log" Jul 17 14:51:25.625896 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.625879 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-controller/0.log" Jul 17 14:51:25.627111 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.627082 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:51:25.687277 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687247 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kxnd9"] Jul 17 14:51:25.687403 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687376 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" Jul 17 14:51:25.687403 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687388 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" Jul 17 14:51:25.687403 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687398 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="northd" Jul 17 14:51:25.687403 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687403 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="northd" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687409 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-controller" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687414 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-controller" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687420 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687425 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687434 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-ovn-metrics" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687440 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-ovn-metrics" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687446 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687451 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687457 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovnkube-controller" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687462 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovnkube-controller" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687468 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-node" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687474 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-node" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687499 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-node" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687506 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687511 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-controller" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687516 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="sbdb" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687520 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="kube-rbac-proxy-ovn-metrics" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687525 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687529 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="nbdb" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687533 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovnkube-controller" Jul 17 14:51:25.687548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687538 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="northd" Jul 17 14:51:25.688316 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687562 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" Jul 17 14:51:25.688316 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.687568 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerName="ovn-acl-logging" Jul 17 14:51:25.689285 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.689271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.774361 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774331 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-var-lib-openvswitch\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774373 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-ovn-kubernetes\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774403 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-env-overrides\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774428 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-etc-openvswitch\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774437 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774438 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774447 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-kubelet\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774528 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774514 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-netd\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774539 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-systemd-units\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774472 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774555 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-netns\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774473 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774588 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774585 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774586 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774601 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-slash\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774623 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-slash" (OuterVolumeSpecName: "host-slash") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774641 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6ff2a3c-00e4-4b86-846a-824e37213441-ovn-node-metrics-cert\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774664 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-node-log\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774691 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-openvswitch\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774705 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-systemd\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774725 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74cwl\" (UniqueName: \"kubernetes.io/projected/b6ff2a3c-00e4-4b86-846a-824e37213441-kube-api-access-74cwl\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774735 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774754 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-log-socket\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.774827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774760 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-node-log" (OuterVolumeSpecName: "node-log") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774780 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-bin\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774787 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-log-socket" (OuterVolumeSpecName: "log-socket") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774805 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-var-lib-cni-networks-ovn-kubernetes\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774811 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774834 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-config\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774854 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-ovn\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774860 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774880 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-script-lib\") pod \"b6ff2a3c-00e4-4b86-846a-824e37213441\" (UID: \"b6ff2a3c-00e4-4b86-846a-824e37213441\") " Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774912 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774940 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-ovnkube-config\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.774986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6lst\" (UniqueName: \"kubernetes.io/projected/8211c3aa-e993-4bd4-b03c-74013dc92534-kube-api-access-g6lst\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-etc-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-ovnkube-script-lib\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.775566 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-env-overrides\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775212 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8211c3aa-e993-4bd4-b03c-74013dc92534-ovn-node-metrics-cert\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775276 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-systemd-units\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-node-log\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-slash\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-var-lib-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-cni-bin\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-systemd\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-kubelet\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-run-netns\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-ovn\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-log-socket\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-cni-netd\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776065 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-run-ovn-kubernetes\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775706 2574 reconciler_common.go:299] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-script-lib\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775725 2574 reconciler_common.go:299] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-var-lib-openvswitch\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775738 2574 reconciler_common.go:299] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-ovn-kubernetes\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775757 2574 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-env-overrides\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775769 2574 reconciler_common.go:299] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-etc-openvswitch\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775780 2574 reconciler_common.go:299] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-kubelet\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775791 2574 reconciler_common.go:299] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-netd\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775801 2574 reconciler_common.go:299] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-systemd-units\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775812 2574 reconciler_common.go:299] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-run-netns\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775824 2574 reconciler_common.go:299] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-slash\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775834 2574 reconciler_common.go:299] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-node-log\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775846 2574 reconciler_common.go:299] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-openvswitch\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775856 2574 reconciler_common.go:299] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-log-socket\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775867 2574 reconciler_common.go:299] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-cni-bin\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775907 2574 reconciler_common.go:299] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-host-var-lib-cni-networks-ovn-kubernetes\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775920 2574 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6ff2a3c-00e4-4b86-846a-824e37213441-ovnkube-config\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.776569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.775934 2574 reconciler_common.go:299] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-ovn\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.778261 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.778242 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ff2a3c-00e4-4b86-846a-824e37213441-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:51:25.778509 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.778490 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ff2a3c-00e4-4b86-846a-824e37213441-kube-api-access-74cwl" (OuterVolumeSpecName: "kube-api-access-74cwl") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "kube-api-access-74cwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:51:25.779492 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.779474 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "b6ff2a3c-00e4-4b86-846a-824e37213441" (UID: "b6ff2a3c-00e4-4b86-846a-824e37213441"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 17 14:51:25.876884 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-var-lib-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.876884 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-cni-bin\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-systemd\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-kubelet\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-run-netns\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-var-lib-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.876972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-ovn\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877018 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-systemd\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877004 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-ovn\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877027 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-run-netns\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-log-socket\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877039 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-kubelet\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877065 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-log-socket\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-cni-bin\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-cni-netd\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877090 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-cni-netd\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-run-ovn-kubernetes\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-ovnkube-config\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6lst\" (UniqueName: \"kubernetes.io/projected/8211c3aa-e993-4bd4-b03c-74013dc92534-kube-api-access-g6lst\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-etc-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-ovnkube-script-lib\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877232 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-run-ovn-kubernetes\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877250 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-etc-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877276 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-env-overrides\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8211c3aa-e993-4bd4-b03c-74013dc92534-ovn-node-metrics-cert\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877321 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-systemd-units\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-run-openvswitch\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-node-log\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-slash\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.877743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877381 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-systemd-units\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877423 2574 reconciler_common.go:299] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6ff2a3c-00e4-4b86-846a-824e37213441-ovn-node-metrics-cert\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877440 2574 reconciler_common.go:299] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6ff2a3c-00e4-4b86-846a-824e37213441-run-systemd\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877455 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74cwl\" (UniqueName: \"kubernetes.io/projected/b6ff2a3c-00e4-4b86-846a-824e37213441-kube-api-access-74cwl\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877435 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-host-slash\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8211c3aa-e993-4bd4-b03c-74013dc92534-node-log\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877780 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-env-overrides\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877802 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-ovnkube-config\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.878305 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.877870 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8211c3aa-e993-4bd4-b03c-74013dc92534-ovnkube-script-lib\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.879680 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.879662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8211c3aa-e993-4bd4-b03c-74013dc92534-ovn-node-metrics-cert\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.889626 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.889609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6lst\" (UniqueName: \"kubernetes.io/projected/8211c3aa-e993-4bd4-b03c-74013dc92534-kube-api-access-g6lst\") pod \"ovnkube-node-kxnd9\" (UID: \"8211c3aa-e993-4bd4-b03c-74013dc92534\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:25.997157 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:25.997111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:26.005878 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:51:26.005852 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8211c3aa_e993_4bd4_b03c_74013dc92534.slice/crio-7dcf527b1e6f7731fd1744a269643f2658bec27a38d073316466c5b9242845c9 WatchSource:0}: Error finding container 7dcf527b1e6f7731fd1744a269643f2658bec27a38d073316466c5b9242845c9: Status 404 returned error can't find the container with id 7dcf527b1e6f7731fd1744a269643f2658bec27a38d073316466c5b9242845c9 Jul 17 14:51:26.159127 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.159107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:26.159286 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.159263 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:26.503963 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.503857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"a79e9b7aceacd3240278ceae42ac2f8514499afa23dc76b2fd961b3ab1743bc8"} Jul 17 14:51:26.504515 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.503986 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"532aa404c7d809545671597585a65a4176b555266a65aaf327509dc3d54c06af"} Jul 17 14:51:26.504515 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.504035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"875e8a878b57db650d33db077c122c0fff790f2de006c72b6b81d9fd13d09f8f"} Jul 17 14:51:26.504515 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.504081 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"eb36952c91086d8c1ecd564e287c1c2318083d1a655700c5bff939c9a8ea4a66"} Jul 17 14:51:26.504515 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.504130 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"b0343bfa5014c8716acceb0914604de6fb242c299b75650a40b2a8c2ef66fab2"} Jul 17 14:51:26.504515 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.504169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"b18e2fe2a952ab341ebb27c474c95a4d7f5bf587d05160c4272f464d4e19ea75"} Jul 17 14:51:26.504515 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.504236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"7dcf527b1e6f7731fd1744a269643f2658bec27a38d073316466c5b9242845c9"} Jul 17 14:51:26.505238 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.505222 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-acl-logging/1.log" Jul 17 14:51:26.505664 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.505651 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovnkube-controller/0.log" Jul 17 14:51:26.506837 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.506820 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:51:26.507216 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507184 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/kube-rbac-proxy-node/0.log" Jul 17 14:51:26.507547 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507534 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kr5x8_b6ff2a3c-00e4-4b86-846a-824e37213441/ovn-controller/0.log" Jul 17 14:51:26.507600 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507571 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6ff2a3c-00e4-4b86-846a-824e37213441" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" exitCode=137 Jul 17 14:51:26.507634 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536"} Jul 17 14:51:26.507697 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507684 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" Jul 17 14:51:26.507735 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507697 2574 scope.go:117] "RemoveContainer" containerID="a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2" Jul 17 14:51:26.507822 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.507684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kr5x8" event={"ID":"b6ff2a3c-00e4-4b86-846a-824e37213441","Type":"ContainerDied","Data":"d8b14849c79a2d5021626815d5453fe0569c87ee160562b699abaee92d172a41"} Jul 17 14:51:26.516046 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.516028 2574 scope.go:117] "RemoveContainer" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" Jul 17 14:51:26.523994 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.523976 2574 scope.go:117] "RemoveContainer" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" Jul 17 14:51:26.530154 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.530139 2574 scope.go:117] "RemoveContainer" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" Jul 17 14:51:26.536159 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.536142 2574 scope.go:117] "RemoveContainer" containerID="934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010" Jul 17 14:51:26.536715 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.536695 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kr5x8"] Jul 17 14:51:26.542322 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.542306 2574 scope.go:117] "RemoveContainer" containerID="d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f" Jul 17 14:51:26.548233 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.548212 2574 scope.go:117] "RemoveContainer" containerID="8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630" Jul 17 14:51:26.554414 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.554398 2574 scope.go:117] "RemoveContainer" containerID="e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1" Jul 17 14:51:26.558559 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.558536 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kr5x8"] Jul 17 14:51:26.569794 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.569601 2574 scope.go:117] "RemoveContainer" containerID="a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2" Jul 17 14:51:26.569916 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.569896 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2\": container with ID starting with a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2 not found: ID does not exist" containerID="a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2" Jul 17 14:51:26.569986 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.569929 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2"} err="failed to get container status \"a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2\": rpc error: code = NotFound desc = could not find container \"a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2\": container with ID starting with a4820fa505732872430c9e0c4a6fc7e19cbf1d68668dbfaa7a47f4bb085529b2 not found: ID does not exist" Jul 17 14:51:26.569986 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.569956 2574 scope.go:117] "RemoveContainer" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" Jul 17 14:51:26.570216 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.570175 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536\": container with ID starting with 0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536 not found: ID does not exist" containerID="0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536" Jul 17 14:51:26.570257 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570223 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536"} err="failed to get container status \"0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536\": rpc error: code = NotFound desc = could not find container \"0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536\": container with ID starting with 0da26c10c3f1897846bb832b0fe82539ae811dd16e99f211d95257caadfdd536 not found: ID does not exist" Jul 17 14:51:26.570257 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570246 2574 scope.go:117] "RemoveContainer" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" Jul 17 14:51:26.570451 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.570433 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061\": container with ID starting with 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 not found: ID does not exist" containerID="0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061" Jul 17 14:51:26.570514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570459 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061"} err="failed to get container status \"0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061\": rpc error: code = NotFound desc = could not find container \"0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061\": container with ID starting with 0e72e0c4ffcf03fe4b664f5dca1bce71e1fd5d803b72f3246c807d8e393c1061 not found: ID does not exist" Jul 17 14:51:26.570514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570478 2574 scope.go:117] "RemoveContainer" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" Jul 17 14:51:26.570679 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.570663 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1\": container with ID starting with cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 not found: ID does not exist" containerID="cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1" Jul 17 14:51:26.570712 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570683 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1"} err="failed to get container status \"cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1\": rpc error: code = NotFound desc = could not find container \"cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1\": container with ID starting with cb0ade2b5a10f7d234af0d8c709235c5365379bf1fdf3bf8773d380408fa0dc1 not found: ID does not exist" Jul 17 14:51:26.570712 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570702 2574 scope.go:117] "RemoveContainer" containerID="934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010" Jul 17 14:51:26.570898 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.570881 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010\": container with ID starting with 934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010 not found: ID does not exist" containerID="934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010" Jul 17 14:51:26.570938 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570901 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010"} err="failed to get container status \"934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010\": rpc error: code = NotFound desc = could not find container \"934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010\": container with ID starting with 934c96b0ef1a09932afc1a908b9f5a0cedd73ba0f0c96989ece835a60ea74010 not found: ID does not exist" Jul 17 14:51:26.570938 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.570915 2574 scope.go:117] "RemoveContainer" containerID="d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f" Jul 17 14:51:26.571103 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.571084 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f\": container with ID starting with d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f not found: ID does not exist" containerID="d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f" Jul 17 14:51:26.571140 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.571107 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f"} err="failed to get container status \"d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f\": rpc error: code = NotFound desc = could not find container \"d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f\": container with ID starting with d257cc6151c1f0797be993e13fef57d71c109871d6accac9ab66b8fb51e0246f not found: ID does not exist" Jul 17 14:51:26.571140 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.571118 2574 scope.go:117] "RemoveContainer" containerID="8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630" Jul 17 14:51:26.571352 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.571337 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630\": container with ID starting with 8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630 not found: ID does not exist" containerID="8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630" Jul 17 14:51:26.571394 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.571355 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630"} err="failed to get container status \"8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630\": rpc error: code = NotFound desc = could not find container \"8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630\": container with ID starting with 8d9fcd41d1bade73fed3096c4bd585bbea75d206734af36a7c806b6215d49630 not found: ID does not exist" Jul 17 14:51:26.571394 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.571366 2574 scope.go:117] "RemoveContainer" containerID="e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1" Jul 17 14:51:26.571541 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:26.571524 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1\": container with ID starting with e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1 not found: ID does not exist" containerID="e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1" Jul 17 14:51:26.571575 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:26.571543 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1"} err="failed to get container status \"e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1\": rpc error: code = NotFound desc = could not find container \"e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1\": container with ID starting with e6d2589adfc0f034f536bd1996e83534faad45fee95d5db2e8a8207b23080ae1 not found: ID does not exist" Jul 17 14:51:27.159275 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.159222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:27.159434 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.159222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:27.159434 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:27.159356 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:27.159434 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:27.159408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:27.744917 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.744884 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wzcdh"] Jul 17 14:51:27.748028 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.748012 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.751035 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.751018 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 14:51:27.751936 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.751918 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 14:51:27.752029 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.751921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m725j\"" Jul 17 14:51:27.891334 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.891295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51da87c7-aaad-458c-8095-362836c77817-hosts-file\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.891487 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.891355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da87c7-aaad-458c-8095-362836c77817-tmp-dir\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.891487 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.891382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv82n\" (UniqueName: \"kubernetes.io/projected/51da87c7-aaad-458c-8095-362836c77817-kube-api-access-kv82n\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.991766 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.991733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da87c7-aaad-458c-8095-362836c77817-tmp-dir\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.991891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.991773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv82n\" (UniqueName: \"kubernetes.io/projected/51da87c7-aaad-458c-8095-362836c77817-kube-api-access-kv82n\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.991891 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.991827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51da87c7-aaad-458c-8095-362836c77817-hosts-file\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.991981 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.991891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51da87c7-aaad-458c-8095-362836c77817-hosts-file\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:27.992076 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:27.992057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da87c7-aaad-458c-8095-362836c77817-tmp-dir\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:28.002617 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.002550 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv82n\" (UniqueName: \"kubernetes.io/projected/51da87c7-aaad-458c-8095-362836c77817-kube-api-access-kv82n\") pod \"node-resolver-wzcdh\" (UID: \"51da87c7-aaad-458c-8095-362836c77817\") " pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:28.055589 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.055555 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wzcdh" Jul 17 14:51:28.063723 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:51:28.063695 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51da87c7_aaad_458c_8095_362836c77817.slice/crio-aa6a292a536b12b9c01ebb1fd489301303e62060c2cdcfe40ede760588e9f632 WatchSource:0}: Error finding container aa6a292a536b12b9c01ebb1fd489301303e62060c2cdcfe40ede760588e9f632: Status 404 returned error can't find the container with id aa6a292a536b12b9c01ebb1fd489301303e62060c2cdcfe40ede760588e9f632 Jul 17 14:51:28.159828 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.159793 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:28.159965 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:28.159915 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:28.162857 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.162832 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ff2a3c-00e4-4b86-846a-824e37213441" path="/var/lib/kubelet/pods/b6ff2a3c-00e4-4b86-846a-824e37213441/volumes" Jul 17 14:51:28.516017 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.515978 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"c339e5a948c1b532c2a2e843ff39611b60a7074af972c739614699847de38456"} Jul 17 14:51:28.517292 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.517265 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wzcdh" event={"ID":"51da87c7-aaad-458c-8095-362836c77817","Type":"ContainerStarted","Data":"5c4f4bab05697227c7aa2232099eab757eb648e933bd1f6fa3f76c88619b3a32"} Jul 17 14:51:28.517413 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.517317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wzcdh" event={"ID":"51da87c7-aaad-458c-8095-362836c77817","Type":"ContainerStarted","Data":"aa6a292a536b12b9c01ebb1fd489301303e62060c2cdcfe40ede760588e9f632"} Jul 17 14:51:28.533274 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:28.533220 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wzcdh" podStartSLOduration=1.533185401 podStartE2EDuration="1.533185401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:28.532960153 +0000 UTC m=+134.884853785" watchObservedRunningTime="2026-07-17 14:51:28.533185401 +0000 UTC m=+134.885079033" Jul 17 14:51:29.126721 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:29.126673 2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Jul 17 14:51:29.159068 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:29.159035 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:29.159238 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:29.159048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:29.159238 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:29.159139 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:29.159316 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:29.159241 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:30.159297 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.159254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:30.159779 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:30.159368 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:30.524031 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.523994 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" event={"ID":"8211c3aa-e993-4bd4-b03c-74013dc92534","Type":"ContainerStarted","Data":"70730f55724d8eabadfe466509794300ca49f9ef800f21fc28164fc5227bb1fd"} Jul 17 14:51:30.524273 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.524249 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:30.524404 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.524377 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:30.524548 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.524465 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:30.539884 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.539858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:30.541289 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.541267 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:51:30.554793 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:30.554747 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" podStartSLOduration=5.554731067 podStartE2EDuration="5.554731067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:30.55413323 +0000 UTC m=+136.906026861" watchObservedRunningTime="2026-07-17 14:51:30.554731067 +0000 UTC m=+136.906624699" Jul 17 14:51:31.159466 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:31.159432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:31.159466 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:31.159460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:31.159850 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:31.159532 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:31.159850 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:31.159652 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:32.158843 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.158802 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:32.159050 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:32.158943 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:32.847650 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.847410 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9kdnc"] Jul 17 14:51:32.848467 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.847762 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:32.848467 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:32.847886 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:32.851102 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.851075 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-42vbh"] Jul 17 14:51:32.851260 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.851239 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:32.851368 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:32.851346 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:32.851833 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.851808 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gkbxj"] Jul 17 14:51:32.851924 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:32.851884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:32.851982 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:32.851963 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:34.127013 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:34.126970 2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Jul 17 14:51:34.160326 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:34.160299 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:34.160473 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:34.160389 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:35.159286 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:35.159204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:35.159636 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:35.159206 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:35.159636 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:35.159314 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:35.159636 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:35.159395 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:36.159006 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:36.158965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:36.159188 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:36.159080 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:37.159219 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:37.159114 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:37.159219 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:37.159144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:37.159606 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:37.159264 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9kdnc" podUID="186f59e1-2bef-4115-80f2-2f2f83a0f50d" Jul 17 14:51:37.159606 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:37.159378 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42vbh" podUID="b66703c1-056c-48af-b986-c4dd73996a89" Jul 17 14:51:37.659252 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:37.659042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:37.659252 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:37.659242 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 14:51:37.659252 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:37.659263 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 14:51:37.659468 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:37.659272 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4cvq5 for pod openshift-network-diagnostics/network-check-target-gkbxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:51:37.659468 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:37.659331 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5 podName:aaef1e59-1413-480a-89fb-32978e50436b nodeName:}" failed. No retries permitted until 2026-07-17 14:52:41.659318265 +0000 UTC m=+208.011211875 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cvq5" (UniqueName: "kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5") pod "network-check-target-gkbxj" (UID: "aaef1e59-1413-480a-89fb-32978e50436b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 14:51:38.159050 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:38.159008 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:38.159250 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:38.159120 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkbxj" podUID="aaef1e59-1413-480a-89fb-32978e50436b" Jul 17 14:51:39.158971 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:39.158938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:51:39.159275 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:39.158942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:51:39.161834 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:39.161814 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 14:51:39.161911 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:39.161814 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 14:51:39.162683 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:39.162669 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7594c\"" Jul 17 14:51:40.159743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:40.159698 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:51:40.164068 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:40.164034 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 14:51:40.164318 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:40.164297 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 14:51:40.164704 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:40.164682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8rtv\"" Jul 17 14:51:47.082984 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.082953 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-74.ec2.internal" event="NodeReady" Jul 17 14:51:47.147437 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.147410 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kvgff"] Jul 17 14:51:47.150454 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.150432 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s59sv"] Jul 17 14:51:47.150589 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.150566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.153573 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.153547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.156564 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.156542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 14:51:47.157166 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.157146 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 14:51:47.157284 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.157146 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 14:51:47.158420 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.158400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxssw\"" Jul 17 14:51:47.158561 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.158540 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 14:51:47.158697 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.158474 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 14:51:47.158697 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.158687 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kbfbg\"" Jul 17 14:51:47.165318 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.165296 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kvgff"] Jul 17 14:51:47.169920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.169897 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s59sv"] Jul 17 14:51:47.323261 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.323222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.323261 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.323270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a6b5e68-3510-479a-8a87-8d1032c7d098-tmp-dir\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.323497 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.323299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxg2n\" (UniqueName: \"kubernetes.io/projected/9a6b5e68-3510-479a-8a87-8d1032c7d098-kube-api-access-pxg2n\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.323497 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.323355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjfqz\" (UniqueName: \"kubernetes.io/projected/ad5aea99-3ae1-466e-9071-9544f678561a-kube-api-access-qjfqz\") pod \"ingress-canary-kvgff\" (UID: \"ad5aea99-3ae1-466e-9071-9544f678561a\") " pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.323497 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.323412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad5aea99-3ae1-466e-9071-9544f678561a-cert\") pod \"ingress-canary-kvgff\" (UID: \"ad5aea99-3ae1-466e-9071-9544f678561a\") " pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.323497 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.323489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b5e68-3510-479a-8a87-8d1032c7d098-config-volume\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.424693 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.424605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxg2n\" (UniqueName: \"kubernetes.io/projected/9a6b5e68-3510-479a-8a87-8d1032c7d098-kube-api-access-pxg2n\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.424693 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.424663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjfqz\" (UniqueName: \"kubernetes.io/projected/ad5aea99-3ae1-466e-9071-9544f678561a-kube-api-access-qjfqz\") pod \"ingress-canary-kvgff\" (UID: \"ad5aea99-3ae1-466e-9071-9544f678561a\") " pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.424858 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.424709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad5aea99-3ae1-466e-9071-9544f678561a-cert\") pod \"ingress-canary-kvgff\" (UID: \"ad5aea99-3ae1-466e-9071-9544f678561a\") " pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.424858 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.424758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b5e68-3510-479a-8a87-8d1032c7d098-config-volume\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.424959 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.424937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.425003 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.424967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a6b5e68-3510-479a-8a87-8d1032c7d098-tmp-dir\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.425079 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:47.425062 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 14:51:47.425145 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:47.425132 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls podName:9a6b5e68-3510-479a-8a87-8d1032c7d098 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:47.925111606 +0000 UTC m=+154.277005234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls") pod "dns-default-s59sv" (UID: "9a6b5e68-3510-479a-8a87-8d1032c7d098") : secret "dns-default-metrics-tls" not found Jul 17 14:51:47.425292 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.425274 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a6b5e68-3510-479a-8a87-8d1032c7d098-tmp-dir\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.425362 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.425346 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b5e68-3510-479a-8a87-8d1032c7d098-config-volume\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.428503 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.428488 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad5aea99-3ae1-466e-9071-9544f678561a-cert\") pod \"ingress-canary-kvgff\" (UID: \"ad5aea99-3ae1-466e-9071-9544f678561a\") " pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.434722 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.434698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjfqz\" (UniqueName: \"kubernetes.io/projected/ad5aea99-3ae1-466e-9071-9544f678561a-kube-api-access-qjfqz\") pod \"ingress-canary-kvgff\" (UID: \"ad5aea99-3ae1-466e-9071-9544f678561a\") " pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.434722 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.434715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxg2n\" (UniqueName: \"kubernetes.io/projected/9a6b5e68-3510-479a-8a87-8d1032c7d098-kube-api-access-pxg2n\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.462129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.462103 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kvgff" Jul 17 14:51:47.592215 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.592160 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kvgff"] Jul 17 14:51:47.595295 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:51:47.595257 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5aea99_3ae1_466e_9071_9544f678561a.slice/crio-0730fc647a6d88204b63961a4f94a60988288746c4c6e293629742a40c2149a1 WatchSource:0}: Error finding container 0730fc647a6d88204b63961a4f94a60988288746c4c6e293629742a40c2149a1: Status 404 returned error can't find the container with id 0730fc647a6d88204b63961a4f94a60988288746c4c6e293629742a40c2149a1 Jul 17 14:51:47.928390 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:47.928338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:47.928623 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:47.928526 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 14:51:47.928694 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:47.928623 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls podName:9a6b5e68-3510-479a-8a87-8d1032c7d098 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:48.928599232 +0000 UTC m=+155.280492850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls") pod "dns-default-s59sv" (UID: "9a6b5e68-3510-479a-8a87-8d1032c7d098") : secret "dns-default-metrics-tls" not found Jul 17 14:51:48.568018 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:48.567977 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kvgff" event={"ID":"ad5aea99-3ae1-466e-9071-9544f678561a","Type":"ContainerStarted","Data":"0730fc647a6d88204b63961a4f94a60988288746c4c6e293629742a40c2149a1"} Jul 17 14:51:48.936251 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:48.936164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:48.936388 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:48.936331 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 14:51:48.936440 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:48.936396 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls podName:9a6b5e68-3510-479a-8a87-8d1032c7d098 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:50.936380732 +0000 UTC m=+157.288274344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls") pod "dns-default-s59sv" (UID: "9a6b5e68-3510-479a-8a87-8d1032c7d098") : secret "dns-default-metrics-tls" not found Jul 17 14:51:50.573841 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:50.573805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kvgff" event={"ID":"ad5aea99-3ae1-466e-9071-9544f678561a","Type":"ContainerStarted","Data":"c7ed4236ce96fb05153d950e6eb872956bd01c9365f6ded2ecb5b733d9e74a35"} Jul 17 14:51:50.597749 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:50.597697 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kvgff" podStartSLOduration=1.517244382 podStartE2EDuration="3.597678053s" totalImagesPullingTime="2.080433671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:50.596496365 +0000 UTC m=+156.948389997" watchObservedRunningTime="2026-07-17 14:51:50.597678053 +0000 UTC m=+156.949571685" Jul 17 14:51:50.950921 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:50.950810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:50.951079 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:50.950954 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 14:51:50.951079 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:50.951023 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls podName:9a6b5e68-3510-479a-8a87-8d1032c7d098 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:54.951006721 +0000 UTC m=+161.302900341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls") pod "dns-default-s59sv" (UID: "9a6b5e68-3510-479a-8a87-8d1032c7d098") : secret "dns-default-metrics-tls" not found Jul 17 14:51:51.019171 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.019137 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ffl7m"] Jul 17 14:51:51.022092 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.022072 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.026266 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.026243 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 14:51:51.026266 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.026260 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rpvrl\"" Jul 17 14:51:51.026266 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.026247 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 14:51:51.026481 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.026246 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 14:51:51.027154 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.027139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 14:51:51.038774 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.038752 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffl7m"] Jul 17 14:51:51.051144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.051122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/835874ff-88cc-4a96-95b6-6caa0901e7b7-crio-socket\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.051248 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.051166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.051304 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.051266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.051380 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.051361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/835874ff-88cc-4a96-95b6-6caa0901e7b7-data-volume\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.051419 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.051390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdq4m\" (UniqueName: \"kubernetes.io/projected/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-api-access-sdq4m\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.151709 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.151674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/835874ff-88cc-4a96-95b6-6caa0901e7b7-data-volume\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.151709 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.151711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdq4m\" (UniqueName: \"kubernetes.io/projected/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-api-access-sdq4m\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.151942 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.151731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/835874ff-88cc-4a96-95b6-6caa0901e7b7-crio-socket\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.151942 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.151878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.152021 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.151944 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/835874ff-88cc-4a96-95b6-6caa0901e7b7-crio-socket\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.152021 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.151981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.152021 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.151989 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 14:51:51.152116 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.152058 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 14:51:51.152116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.152062 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/835874ff-88cc-4a96-95b6-6caa0901e7b7-data-volume\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.152116 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.152062 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:51.652031943 +0000 UTC m=+158.003925554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : secret "insights-runtime-extractor-tls" not found Jul 17 14:51:51.152261 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.152128 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:51.652112099 +0000 UTC m=+158.004005709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : configmap "kube-rbac-proxy" not found Jul 17 14:51:51.175140 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.175109 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdq4m\" (UniqueName: \"kubernetes.io/projected/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-api-access-sdq4m\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.654360 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.654326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.654770 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.654412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:51.654770 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.654474 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 14:51:51.654770 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.654499 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 14:51:51.654770 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.654550 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:52.654531421 +0000 UTC m=+159.006425046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : secret "insights-runtime-extractor-tls" not found Jul 17 14:51:51.654770 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:51.654571 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:52.654560035 +0000 UTC m=+159.006453646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : configmap "kube-rbac-proxy" not found Jul 17 14:51:51.681934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.681905 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt"] Jul 17 14:51:51.684843 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.684828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" Jul 17 14:51:51.687187 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.687164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 14:51:51.687187 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.687165 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 14:51:51.688081 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.688066 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7hllw\"" Jul 17 14:51:51.691473 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.691449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt"] Jul 17 14:51:51.755289 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.755253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwwz7\" (UniqueName: \"kubernetes.io/projected/ba826700-37f3-4480-a19e-00478139c545-kube-api-access-bwwz7\") pod \"migrator-7cc9c7ffd7-885bt\" (UID: \"ba826700-37f3-4480-a19e-00478139c545\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" Jul 17 14:51:51.856446 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.856403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwwz7\" (UniqueName: \"kubernetes.io/projected/ba826700-37f3-4480-a19e-00478139c545-kube-api-access-bwwz7\") pod \"migrator-7cc9c7ffd7-885bt\" (UID: \"ba826700-37f3-4480-a19e-00478139c545\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" Jul 17 14:51:51.866909 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.866873 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwwz7\" (UniqueName: \"kubernetes.io/projected/ba826700-37f3-4480-a19e-00478139c545-kube-api-access-bwwz7\") pod \"migrator-7cc9c7ffd7-885bt\" (UID: \"ba826700-37f3-4480-a19e-00478139c545\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" Jul 17 14:51:51.993582 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:51.993505 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" Jul 17 14:51:52.113498 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:52.113470 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt"] Jul 17 14:51:52.116207 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:51:52.116163 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba826700_37f3_4480_a19e_00478139c545.slice/crio-9ed2fe737dd7e1b2b01abc69ed20a3c3ecc1604390f5c0e76472407b2d6c5a01 WatchSource:0}: Error finding container 9ed2fe737dd7e1b2b01abc69ed20a3c3ecc1604390f5c0e76472407b2d6c5a01: Status 404 returned error can't find the container with id 9ed2fe737dd7e1b2b01abc69ed20a3c3ecc1604390f5c0e76472407b2d6c5a01 Jul 17 14:51:52.579467 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:52.579437 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" event={"ID":"ba826700-37f3-4480-a19e-00478139c545","Type":"ContainerStarted","Data":"9ed2fe737dd7e1b2b01abc69ed20a3c3ecc1604390f5c0e76472407b2d6c5a01"} Jul 17 14:51:52.660838 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:52.660792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:52.661247 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:52.660870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:52.661247 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:52.660934 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 14:51:52.661247 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:52.660960 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 14:51:52.661247 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:52.660995 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:54.66097971 +0000 UTC m=+161.012873320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : secret "insights-runtime-extractor-tls" not found Jul 17 14:51:52.661247 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:52.661009 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:54.661003305 +0000 UTC m=+161.012896915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : configmap "kube-rbac-proxy" not found Jul 17 14:51:53.205406 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:53.205380 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzcdh_51da87c7-aaad-458c-8095-362836c77817/dns-node-resolver/0.log" Jul 17 14:51:53.583905 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:53.583865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" event={"ID":"ba826700-37f3-4480-a19e-00478139c545","Type":"ContainerStarted","Data":"fac10399ef6614a1edf4e0ba0202568d52c744f2dba17c05580c3c40a3e4ce65"} Jul 17 14:51:53.584106 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:53.583936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" event={"ID":"ba826700-37f3-4480-a19e-00478139c545","Type":"ContainerStarted","Data":"2937ee549d607e289533f4794d496e03543a0d203ea7b78652213d7dd11ca41a"} Jul 17 14:51:53.601434 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:53.599953 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-885bt" podStartSLOduration=1.307650433 podStartE2EDuration="2.599933674s" totalImagesPullingTime="1.292283241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:53.598169209 +0000 UTC m=+159.950062843" watchObservedRunningTime="2026-07-17 14:51:53.599933674 +0000 UTC m=+159.951827308" Jul 17 14:51:53.804615 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:53.804584 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jnrx_7ece9582-f509-4f33-ad29-b52b0f78fdd1/node-ca/0.log" Jul 17 14:51:54.603897 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:54.603860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvgff_ad5aea99-3ae1-466e-9071-9544f678561a/serve-healthcheck-canary/0.log" Jul 17 14:51:54.673952 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:54.673914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:54.674102 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:54.674060 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 14:51:54.674102 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:54.674082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:54.674224 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:54.674118 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:58.674103098 +0000 UTC m=+165.025996707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : secret "insights-runtime-extractor-tls" not found Jul 17 14:51:54.674224 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:54.674136 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 14:51:54.674224 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:54.674184 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:58.674170494 +0000 UTC m=+165.026064121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : configmap "kube-rbac-proxy" not found Jul 17 14:51:54.976802 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:54.976686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:51:54.977244 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:54.976845 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 14:51:54.977244 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:54.976907 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls podName:9a6b5e68-3510-479a-8a87-8d1032c7d098 nodeName:}" failed. No retries permitted until 2026-07-17 14:52:02.976892002 +0000 UTC m=+169.328785616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls") pod "dns-default-s59sv" (UID: "9a6b5e68-3510-479a-8a87-8d1032c7d098") : secret "dns-default-metrics-tls" not found Jul 17 14:51:58.706138 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:58.706103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:58.706598 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:51:58.706175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:51:58.706598 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:58.706266 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 14:51:58.706598 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:58.706286 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 14:51:58.706598 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:58.706335 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:52:06.706319096 +0000 UTC m=+173.058212705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : configmap "kube-rbac-proxy" not found Jul 17 14:51:58.706598 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:51:58.706349 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls podName:835874ff-88cc-4a96-95b6-6caa0901e7b7 nodeName:}" failed. No retries permitted until 2026-07-17 14:52:06.706343342 +0000 UTC m=+173.058236952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffl7m" (UID: "835874ff-88cc-4a96-95b6-6caa0901e7b7") : secret "insights-runtime-extractor-tls" not found Jul 17 14:52:02.539457 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:02.539427 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxnd9" Jul 17 14:52:03.039569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:03.039536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:52:03.041965 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:03.041927 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6b5e68-3510-479a-8a87-8d1032c7d098-metrics-tls\") pod \"dns-default-s59sv\" (UID: \"9a6b5e68-3510-479a-8a87-8d1032c7d098\") " pod="openshift-dns/dns-default-s59sv" Jul 17 14:52:03.067444 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:03.067406 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s59sv" Jul 17 14:52:03.196751 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:03.196719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s59sv"] Jul 17 14:52:03.202006 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:03.201977 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6b5e68_3510_479a_8a87_8d1032c7d098.slice/crio-0a822470a1edbab016c41f0d716577c8aab94bb8804d1992c57435157b11b7ae WatchSource:0}: Error finding container 0a822470a1edbab016c41f0d716577c8aab94bb8804d1992c57435157b11b7ae: Status 404 returned error can't find the container with id 0a822470a1edbab016c41f0d716577c8aab94bb8804d1992c57435157b11b7ae Jul 17 14:52:03.610018 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:03.609985 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s59sv" event={"ID":"9a6b5e68-3510-479a-8a87-8d1032c7d098","Type":"ContainerStarted","Data":"0a822470a1edbab016c41f0d716577c8aab94bb8804d1992c57435157b11b7ae"} Jul 17 14:52:05.617729 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:05.617692 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s59sv" event={"ID":"9a6b5e68-3510-479a-8a87-8d1032c7d098","Type":"ContainerStarted","Data":"a579d5915c095c20334b5459dad4ca897c12bbcb0e1a48d77684ea637ee81244"} Jul 17 14:52:05.618119 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:05.617777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s59sv" event={"ID":"9a6b5e68-3510-479a-8a87-8d1032c7d098","Type":"ContainerStarted","Data":"f1f9051ea111ed61009748c0b4245422788e9fb931700c6372dce17e9fa1a2e3"} Jul 17 14:52:05.618119 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:05.617840 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s59sv" Jul 17 14:52:05.640476 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:05.640416 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s59sv" podStartSLOduration=16.825271061 podStartE2EDuration="18.640400983s" totalImagesPullingTime="1.815129922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:05.63892315 +0000 UTC m=+171.990816774" watchObservedRunningTime="2026-07-17 14:52:05.640400983 +0000 UTC m=+171.992294615" Jul 17 14:52:06.769263 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:06.769222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:52:06.769656 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:06.769315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:52:06.769795 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:06.769773 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835874ff-88cc-4a96-95b6-6caa0901e7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:52:06.773859 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:06.772923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835874ff-88cc-4a96-95b6-6caa0901e7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffl7m\" (UID: \"835874ff-88cc-4a96-95b6-6caa0901e7b7\") " pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:52:06.930985 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:06.930944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffl7m" Jul 17 14:52:07.053329 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:07.053296 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffl7m"] Jul 17 14:52:07.057300 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:07.057264 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835874ff_88cc_4a96_95b6_6caa0901e7b7.slice/crio-4d17eaab97799b34d9f7d9abddc2c56ece41c91e8372651babfdc11784e82b1e WatchSource:0}: Error finding container 4d17eaab97799b34d9f7d9abddc2c56ece41c91e8372651babfdc11784e82b1e: Status 404 returned error can't find the container with id 4d17eaab97799b34d9f7d9abddc2c56ece41c91e8372651babfdc11784e82b1e Jul 17 14:52:07.623857 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:07.623821 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffl7m" event={"ID":"835874ff-88cc-4a96-95b6-6caa0901e7b7","Type":"ContainerStarted","Data":"4d17eaab97799b34d9f7d9abddc2c56ece41c91e8372651babfdc11784e82b1e"} Jul 17 14:52:15.622015 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:15.621984 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s59sv" Jul 17 14:52:17.148978 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.148933 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-l72kz"] Jul 17 14:52:17.153159 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.153143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:17.157848 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.157825 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 14:52:17.158024 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.157928 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 14:52:17.158024 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.157991 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c7dhl\"" Jul 17 14:52:17.168057 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.168037 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-l72kz"] Jul 17 14:52:17.243844 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.243804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhd6\" (UniqueName: \"kubernetes.io/projected/d77fe87f-67d5-44f1-81e3-fdc89c53db6b-kube-api-access-hwhd6\") pod \"downloads-5bc67dcd46-l72kz\" (UID: \"d77fe87f-67d5-44f1-81e3-fdc89c53db6b\") " pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:17.259776 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.259746 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55d89dc498-8r4pz"] Jul 17 14:52:17.262601 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.262586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.267935 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.267903 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 14:52:17.278774 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.278753 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 14:52:17.279203 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.279176 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdwrv\"" Jul 17 14:52:17.279263 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.279246 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 14:52:17.283697 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.283677 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d89dc498-8r4pz"] Jul 17 14:52:17.311356 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.311328 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 14:52:17.344739 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhd6\" (UniqueName: \"kubernetes.io/projected/d77fe87f-67d5-44f1-81e3-fdc89c53db6b-kube-api-access-hwhd6\") pod \"downloads-5bc67dcd46-l72kz\" (UID: \"d77fe87f-67d5-44f1-81e3-fdc89c53db6b\") " pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:17.344739 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322fb337-9bf1-452f-bf0a-df72045d64d0-trusted-ca\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.344934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322fb337-9bf1-452f-bf0a-df72045d64d0-installation-pull-secrets\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.344934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-registry-tls\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.344934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322fb337-9bf1-452f-bf0a-df72045d64d0-ca-trust-extracted\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.344934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322fb337-9bf1-452f-bf0a-df72045d64d0-image-registry-private-configuration\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.345064 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.344954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-bound-sa-token\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.345064 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.345011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hzt\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-kube-api-access-x6hzt\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.345064 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.345038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322fb337-9bf1-452f-bf0a-df72045d64d0-registry-certificates\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.383138 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.383102 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhd6\" (UniqueName: \"kubernetes.io/projected/d77fe87f-67d5-44f1-81e3-fdc89c53db6b-kube-api-access-hwhd6\") pod \"downloads-5bc67dcd46-l72kz\" (UID: \"d77fe87f-67d5-44f1-81e3-fdc89c53db6b\") " pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:17.445475 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322fb337-9bf1-452f-bf0a-df72045d64d0-ca-trust-extracted\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445475 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322fb337-9bf1-452f-bf0a-df72045d64d0-image-registry-private-configuration\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445475 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-bound-sa-token\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445708 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hzt\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-kube-api-access-x6hzt\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445708 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322fb337-9bf1-452f-bf0a-df72045d64d0-registry-certificates\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445708 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322fb337-9bf1-452f-bf0a-df72045d64d0-trusted-ca\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445708 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322fb337-9bf1-452f-bf0a-df72045d64d0-installation-pull-secrets\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445708 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-registry-tls\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.445938 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.445887 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322fb337-9bf1-452f-bf0a-df72045d64d0-ca-trust-extracted\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.446604 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.446578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322fb337-9bf1-452f-bf0a-df72045d64d0-registry-certificates\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.447262 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.447243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322fb337-9bf1-452f-bf0a-df72045d64d0-trusted-ca\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.448092 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.448073 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322fb337-9bf1-452f-bf0a-df72045d64d0-installation-pull-secrets\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.448685 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.448663 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-registry-tls\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.448854 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.448836 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322fb337-9bf1-452f-bf0a-df72045d64d0-image-registry-private-configuration\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.462182 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.462163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:17.464692 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.464665 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-bound-sa-token\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.465743 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.465722 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hzt\" (UniqueName: \"kubernetes.io/projected/322fb337-9bf1-452f-bf0a-df72045d64d0-kube-api-access-x6hzt\") pod \"image-registry-55d89dc498-8r4pz\" (UID: \"322fb337-9bf1-452f-bf0a-df72045d64d0\") " pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.470040 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:52:17.470002 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-kube-rbac-proxy:latest" Jul 17 14:52:17.470141 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:52:17.470103 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy start failed in pod insights-runtime-extractor-ffl7m_openshift-insights(835874ff-88cc-4a96-95b6-6caa0901e7b7): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 17 14:52:17.570973 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.570939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:17.598958 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.598883 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-l72kz"] Jul 17 14:52:17.603719 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:17.603687 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77fe87f_67d5_44f1_81e3_fdc89c53db6b.slice/crio-b8aa9732c679711d2e66fd6e5a358fb16a77c4a5f89f53255ebc491c29de5b4a WatchSource:0}: Error finding container b8aa9732c679711d2e66fd6e5a358fb16a77c4a5f89f53255ebc491c29de5b4a: Status 404 returned error can't find the container with id b8aa9732c679711d2e66fd6e5a358fb16a77c4a5f89f53255ebc491c29de5b4a Jul 17 14:52:17.650934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.650899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-l72kz" event={"ID":"d77fe87f-67d5-44f1-81e3-fdc89c53db6b","Type":"ContainerStarted","Data":"b8aa9732c679711d2e66fd6e5a358fb16a77c4a5f89f53255ebc491c29de5b4a"} Jul 17 14:52:17.710775 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:17.710679 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d89dc498-8r4pz"] Jul 17 14:52:17.713396 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:17.713367 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322fb337_9bf1_452f_bf0a_df72045d64d0.slice/crio-f2f36634bff9be56a4be76d8b41213abc5415f868ba19613a138cca429ab4d86 WatchSource:0}: Error finding container f2f36634bff9be56a4be76d8b41213abc5415f868ba19613a138cca429ab4d86: Status 404 returned error can't find the container with id f2f36634bff9be56a4be76d8b41213abc5415f868ba19613a138cca429ab4d86 Jul 17 14:52:18.210287 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.209147 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6555f4fd-sqvn4"] Jul 17 14:52:18.213603 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.212401 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.217008 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.216983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f5x7f\"" Jul 17 14:52:18.218867 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.218846 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 14:52:18.219120 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.219103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 14:52:18.219839 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.219820 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 14:52:18.220007 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.219964 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 14:52:18.220331 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.220312 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 14:52:18.230090 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.228912 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6555f4fd-sqvn4"] Jul 17 14:52:18.253288 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.253081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-serving-cert\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.253288 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.253135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-oauth-config\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.253288 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.253261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnww2\" (UniqueName: \"kubernetes.io/projected/b3a41768-8102-460b-a92e-40496b57f7a6-kube-api-access-fnww2\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.253637 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.253307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-console-config\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.253637 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.253482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-oauth-serving-cert\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.253637 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.253534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-service-ca\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.355110 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.354993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-serving-cert\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.355110 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.355054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-oauth-config\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.355370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.355265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnww2\" (UniqueName: \"kubernetes.io/projected/b3a41768-8102-460b-a92e-40496b57f7a6-kube-api-access-fnww2\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.355370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.355309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-console-config\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.355483 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.355385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-oauth-serving-cert\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.355483 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.355427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-service-ca\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.357423 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.356775 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-oauth-serving-cert\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.357423 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.356929 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-service-ca\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.357423 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.357355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-console-config\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.359520 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.359492 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-serving-cert\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.359847 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.359822 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-oauth-config\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.367676 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.367628 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnww2\" (UniqueName: \"kubernetes.io/projected/b3a41768-8102-460b-a92e-40496b57f7a6-kube-api-access-fnww2\") pod \"console-b6555f4fd-sqvn4\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.531463 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.531424 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:18.657715 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.657671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" event={"ID":"322fb337-9bf1-452f-bf0a-df72045d64d0","Type":"ContainerStarted","Data":"f21f9c92af4a153639a5a458a3dbd0ce2b147ff20ef59e7ba19687a5f2e01c77"} Jul 17 14:52:18.657895 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.657742 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" event={"ID":"322fb337-9bf1-452f-bf0a-df72045d64d0","Type":"ContainerStarted","Data":"f2f36634bff9be56a4be76d8b41213abc5415f868ba19613a138cca429ab4d86"} Jul 17 14:52:18.658039 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.657992 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:18.680842 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.680608 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" podStartSLOduration=1.6805862230000002 podStartE2EDuration="1.680586223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:18.67857699 +0000 UTC m=+185.030470623" watchObservedRunningTime="2026-07-17 14:52:18.680586223 +0000 UTC m=+185.032479856" Jul 17 14:52:18.699592 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:18.699553 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6555f4fd-sqvn4"] Jul 17 14:52:18.703916 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:18.703884 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a41768_8102_460b_a92e_40496b57f7a6.slice/crio-99c31322b32fd99398279270f379383f92d27213382be5b1acb5d31a71ca56b1 WatchSource:0}: Error finding container 99c31322b32fd99398279270f379383f92d27213382be5b1acb5d31a71ca56b1: Status 404 returned error can't find the container with id 99c31322b32fd99398279270f379383f92d27213382be5b1acb5d31a71ca56b1 Jul 17 14:52:19.663592 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:19.663510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6555f4fd-sqvn4" event={"ID":"b3a41768-8102-460b-a92e-40496b57f7a6","Type":"ContainerStarted","Data":"99c31322b32fd99398279270f379383f92d27213382be5b1acb5d31a71ca56b1"} Jul 17 14:52:21.675909 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:21.675855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffl7m" event={"ID":"835874ff-88cc-4a96-95b6-6caa0901e7b7","Type":"ContainerStarted","Data":"19cfddfd1093371e766075f30a70bd6dbfe40a653c5ea6cf1bb539ac51042b9c"} Jul 17 14:52:25.828588 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:52:25.828547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-ffl7m" podUID="835874ff-88cc-4a96-95b6-6caa0901e7b7" Jul 17 14:52:26.699002 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:26.698756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6555f4fd-sqvn4" event={"ID":"b3a41768-8102-460b-a92e-40496b57f7a6","Type":"ContainerStarted","Data":"d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2"} Jul 17 14:52:26.700976 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:26.700907 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffl7m" event={"ID":"835874ff-88cc-4a96-95b6-6caa0901e7b7","Type":"ContainerStarted","Data":"ae96ffb03d66be666bb0d57e9e17b6774b0a224aa2e42298fbd7b455461cb1e0"} Jul 17 14:52:26.701747 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:52:26.701720 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-ffl7m" podUID="835874ff-88cc-4a96-95b6-6caa0901e7b7" Jul 17 14:52:26.727892 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:26.727830 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6555f4fd-sqvn4" podStartSLOduration=1.690355625 podStartE2EDuration="8.727815138s" totalImagesPullingTime="7.037459513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:26.727453952 +0000 UTC m=+193.079347581" watchObservedRunningTime="2026-07-17 14:52:26.727815138 +0000 UTC m=+193.079708829" Jul 17 14:52:27.061876 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.061835 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj"] Jul 17 14:52:27.066464 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.066440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.069545 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.069522 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 17 14:52:27.069683 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.069582 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 14:52:27.069832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.069817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 14:52:27.069907 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.069888 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 17 14:52:27.069960 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.069902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 14:52:27.070271 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.070254 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kmvrv\"" Jul 17 14:52:27.084033 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.084007 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj"] Jul 17 14:52:27.109872 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.109839 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m9mj9"] Jul 17 14:52:27.113934 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.113909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.116466 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.116418 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bbgng\"" Jul 17 14:52:27.116607 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.116544 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 14:52:27.116607 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.116574 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 14:52:27.116914 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.116891 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 14:52:27.133071 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.133038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljsj\" (UniqueName: \"kubernetes.io/projected/0284b3d2-f480-48ef-8d51-d778d79da6f3-kube-api-access-bljsj\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.133233 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.133088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0284b3d2-f480-48ef-8d51-d778d79da6f3-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.133233 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.133183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0284b3d2-f480-48ef-8d51-d778d79da6f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.133331 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.133283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0284b3d2-f480-48ef-8d51-d778d79da6f3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.233678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0284b3d2-f480-48ef-8d51-d778d79da6f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.233869 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0284b3d2-f480-48ef-8d51-d778d79da6f3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.233869 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vszq\" (UniqueName: \"kubernetes.io/projected/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-kube-api-access-2vszq\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.233869 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-tls\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.233869 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.233869 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-wtmp\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.234129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-sys\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.234129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233935 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-textfile\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.234129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.233951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-metrics-client-ca\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.234129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.234009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljsj\" (UniqueName: \"kubernetes.io/projected/0284b3d2-f480-48ef-8d51-d778d79da6f3-kube-api-access-bljsj\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.234129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.234071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.234129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.234123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0284b3d2-f480-48ef-8d51-d778d79da6f3-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.234472 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.234153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-root\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.234763 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.234745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0284b3d2-f480-48ef-8d51-d778d79da6f3-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.236551 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.236525 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0284b3d2-f480-48ef-8d51-d778d79da6f3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.236751 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.236729 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0284b3d2-f480-48ef-8d51-d778d79da6f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.245118 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.245094 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljsj\" (UniqueName: \"kubernetes.io/projected/0284b3d2-f480-48ef-8d51-d778d79da6f3-kube-api-access-bljsj\") pod \"openshift-state-metrics-79f6958cdf-lcnhj\" (UID: \"0284b3d2-f480-48ef-8d51-d778d79da6f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.335130 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-root\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335130 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vszq\" (UniqueName: \"kubernetes.io/projected/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-kube-api-access-2vszq\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-tls\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-root\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335370 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-wtmp\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-wtmp\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-sys\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-textfile\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-metrics-client-ca\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335517 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-sys\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335578 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.335856 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.335839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-textfile\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.336128 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.336100 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-metrics-client-ca\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.336495 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.336466 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.337945 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.337924 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.338346 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.338324 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-node-exporter-tls\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.345374 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.345322 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vszq\" (UniqueName: \"kubernetes.io/projected/657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9-kube-api-access-2vszq\") pod \"node-exporter-m9mj9\" (UID: \"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9\") " pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.378032 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.378002 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" Jul 17 14:52:27.425903 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.425867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m9mj9" Jul 17 14:52:27.440796 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:27.440701 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657b4ea5_6eea_4ac2_9b94_1e69ce0c82a9.slice/crio-69528cca57e3f6eae6d339b47ffc8e7e0b2c8fd1889afb15d5f1ed86136cd489 WatchSource:0}: Error finding container 69528cca57e3f6eae6d339b47ffc8e7e0b2c8fd1889afb15d5f1ed86136cd489: Status 404 returned error can't find the container with id 69528cca57e3f6eae6d339b47ffc8e7e0b2c8fd1889afb15d5f1ed86136cd489 Jul 17 14:52:27.554482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.554448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj"] Jul 17 14:52:27.557836 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:27.557809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0284b3d2_f480_48ef_8d51_d778d79da6f3.slice/crio-fa0a6b699bb8267fe33ad555c94b792cc716c19275616e249cfa9bc2dc9ce829 WatchSource:0}: Error finding container fa0a6b699bb8267fe33ad555c94b792cc716c19275616e249cfa9bc2dc9ce829: Status 404 returned error can't find the container with id fa0a6b699bb8267fe33ad555c94b792cc716c19275616e249cfa9bc2dc9ce829 Jul 17 14:52:27.706300 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.706262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9mj9" event={"ID":"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9","Type":"ContainerStarted","Data":"69528cca57e3f6eae6d339b47ffc8e7e0b2c8fd1889afb15d5f1ed86136cd489"} Jul 17 14:52:27.708673 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.708642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" event={"ID":"0284b3d2-f480-48ef-8d51-d778d79da6f3","Type":"ContainerStarted","Data":"9d33e591f27284fb0cccb57effc5e13020c059b9fd936ebc8f9a6d9c8674d267"} Jul 17 14:52:27.708824 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.708707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" event={"ID":"0284b3d2-f480-48ef-8d51-d778d79da6f3","Type":"ContainerStarted","Data":"69f735d4dca5eb52b61040766a95d1caa0ea472ce5356930e347860f41e8635e"} Jul 17 14:52:27.708824 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:27.708736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" event={"ID":"0284b3d2-f480-48ef-8d51-d778d79da6f3","Type":"ContainerStarted","Data":"fa0a6b699bb8267fe33ad555c94b792cc716c19275616e249cfa9bc2dc9ce829"} Jul 17 14:52:28.532479 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.532436 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:28.532918 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.532519 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:28.538572 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.538544 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:28.717169 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.717135 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:52:28.851479 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.851377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:52:28.854175 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.854143 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 14:52:28.865336 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.865306 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/186f59e1-2bef-4115-80f2-2f2f83a0f50d-metrics-certs\") pod \"network-metrics-daemon-9kdnc\" (UID: \"186f59e1-2bef-4115-80f2-2f2f83a0f50d\") " pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:52:28.971545 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.971508 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7594c\"" Jul 17 14:52:28.979893 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:28.979857 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9kdnc" Jul 17 14:52:29.130289 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.130178 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv"] Jul 17 14:52:29.133807 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.133783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.138929 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.138907 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3q9k5etcnts2d\"" Jul 17 14:52:29.139063 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.138907 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 17 14:52:29.139136 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.139082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 17 14:52:29.139368 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.139347 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 17 14:52:29.139462 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.139371 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 17 14:52:29.139523 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.139478 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5h5cw\"" Jul 17 14:52:29.139956 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.139938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 17 14:52:29.144755 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.144731 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv"] Jul 17 14:52:29.254069 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-grpc-tls\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254069 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-tls\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pdd2\" (UniqueName: \"kubernetes.io/projected/4c12bde9-8747-4aab-9abe-c5a3322a4115-kube-api-access-9pdd2\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.254351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.254343 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c12bde9-8747-4aab-9abe-c5a3322a4115-metrics-client-ca\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355545 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c12bde9-8747-4aab-9abe-c5a3322a4115-metrics-client-ca\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-grpc-tls\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-tls\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.355988 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.355748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pdd2\" (UniqueName: \"kubernetes.io/projected/4c12bde9-8747-4aab-9abe-c5a3322a4115-kube-api-access-9pdd2\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.356422 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.356354 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c12bde9-8747-4aab-9abe-c5a3322a4115-metrics-client-ca\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.358885 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.358855 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-grpc-tls\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.359031 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.359010 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.359221 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.359156 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.359594 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.359572 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-tls\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.359692 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.359655 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.359782 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.359756 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c12bde9-8747-4aab-9abe-c5a3322a4115-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.365722 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.365699 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pdd2\" (UniqueName: \"kubernetes.io/projected/4c12bde9-8747-4aab-9abe-c5a3322a4115-kube-api-access-9pdd2\") pod \"thanos-querier-7fc4d8dc97-fbklv\" (UID: \"4c12bde9-8747-4aab-9abe-c5a3322a4115\") " pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:29.445142 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:29.445046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:31.812560 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.812523 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5"] Jul 17 14:52:31.816075 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.816046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:31.819088 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.819064 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 17 14:52:31.819250 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.819180 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-czlpc\"" Jul 17 14:52:31.831876 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.831850 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5"] Jul 17 14:52:31.981545 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.981502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznj7\" (UniqueName: \"kubernetes.io/projected/3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b-kube-api-access-nznj7\") pod \"monitoring-plugin-7b7b7bc8bf-7pfg5\" (UID: \"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:31.981749 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:31.981699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7pfg5\" (UID: \"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:32.082323 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:32.082227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7pfg5\" (UID: \"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:32.082323 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:32.082289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nznj7\" (UniqueName: \"kubernetes.io/projected/3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b-kube-api-access-nznj7\") pod \"monitoring-plugin-7b7b7bc8bf-7pfg5\" (UID: \"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:32.085210 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:32.085165 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7pfg5\" (UID: \"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:32.093358 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:32.093335 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznj7\" (UniqueName: \"kubernetes.io/projected/3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b-kube-api-access-nznj7\") pod \"monitoring-plugin-7b7b7bc8bf-7pfg5\" (UID: \"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:32.127286 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:32.127251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:33.370631 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.370593 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:52:33.374573 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.374532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.379133 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 14:52:33.379278 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 14:52:33.379631 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2p98uq5eaahot\"" Jul 17 14:52:33.379770 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379666 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z9l92\"" Jul 17 14:52:33.379975 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379944 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 14:52:33.380064 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379975 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 14:52:33.380064 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.379985 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 14:52:33.380275 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.380254 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 14:52:33.380275 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.380275 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 14:52:33.380536 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.380506 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 14:52:33.380643 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.380552 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 14:52:33.380643 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.380515 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 14:52:33.381351 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.381326 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 14:52:33.381441 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.381382 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 14:52:33.382291 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.382185 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 14:52:33.389021 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.389000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 14:52:33.390959 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.390942 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 14:52:33.398114 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.398090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:52:33.494748 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.494930 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.494930 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.494930 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.494930 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.494967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495173 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8ss4\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-kube-api-access-q8ss4\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495693 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.495693 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.495485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.596380 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.596333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.596580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.596391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.596580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.596420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.596580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.596445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.596580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.596476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.596580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.596505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597185 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597154 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597430 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597490 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597728 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8ss4\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-kube-api-access-q8ss4\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597728 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597728 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597728 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597728 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597965 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597965 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597965 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597965 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.597965 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.597867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.600660 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.599395 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.600660 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.599785 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.600823 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.600698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.600878 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.600817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.601613 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.601309 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.601613 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.601473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.601613 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.601499 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.601899 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.601857 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.602095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.601861 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.602095 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.602015 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.602527 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.602486 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.603112 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.603073 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.603243 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.603159 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.603307 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.603184 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.603832 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.603800 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.603899 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.603853 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.605141 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.605118 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.612908 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.612874 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8ss4\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-kube-api-access-q8ss4\") pod \"prometheus-k8s-0\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:33.690742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:33.690646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:34.996827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:34.996792 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv"] Jul 17 14:52:35.026253 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.026221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:52:35.031721 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:35.031398 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd44b2d_2dea_481b_96bb_a6540b0d72ee.slice/crio-7f079db3db118d9e9f75a19614660c8df6d6df3d29bd582e1e4bacf15388bcd7 WatchSource:0}: Error finding container 7f079db3db118d9e9f75a19614660c8df6d6df3d29bd582e1e4bacf15388bcd7: Status 404 returned error can't find the container with id 7f079db3db118d9e9f75a19614660c8df6d6df3d29bd582e1e4bacf15388bcd7 Jul 17 14:52:35.257537 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.257408 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5"] Jul 17 14:52:35.261224 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.260786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9kdnc"] Jul 17 14:52:35.262963 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:35.262876 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a421ec8_d921_4adc_91c6_1d7c1ce3ef3b.slice/crio-63bf9ca2d506970732933974828a5610a79006a09763c9f8098d1be45d49da82 WatchSource:0}: Error finding container 63bf9ca2d506970732933974828a5610a79006a09763c9f8098d1be45d49da82: Status 404 returned error can't find the container with id 63bf9ca2d506970732933974828a5610a79006a09763c9f8098d1be45d49da82 Jul 17 14:52:35.263474 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:35.263429 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186f59e1_2bef_4115_80f2_2f2f83a0f50d.slice/crio-19a4ddecb07f7606b0ee5ee60873890357511cd35f9e403ab167086b4605ba86 WatchSource:0}: Error finding container 19a4ddecb07f7606b0ee5ee60873890357511cd35f9e403ab167086b4605ba86: Status 404 returned error can't find the container with id 19a4ddecb07f7606b0ee5ee60873890357511cd35f9e403ab167086b4605ba86 Jul 17 14:52:35.760875 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.760672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-l72kz" event={"ID":"d77fe87f-67d5-44f1-81e3-fdc89c53db6b","Type":"ContainerStarted","Data":"62c13e386ddf4a742c7a3eec7c07773c7d0cfb77fb546f3b95fc7a06951398d4"} Jul 17 14:52:35.763626 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.763050 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:35.766488 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.766454 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"7f079db3db118d9e9f75a19614660c8df6d6df3d29bd582e1e4bacf15388bcd7"} Jul 17 14:52:35.787498 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.775476 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"85954df57ac8cf2e903c204d33a97d445801abb56f4fe64088bf9d47764afc53"} Jul 17 14:52:35.787498 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.776828 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-l72kz" Jul 17 14:52:35.787498 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.777564 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" event={"ID":"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b","Type":"ContainerStarted","Data":"63bf9ca2d506970732933974828a5610a79006a09763c9f8098d1be45d49da82"} Jul 17 14:52:35.787498 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.783449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9kdnc" event={"ID":"186f59e1-2bef-4115-80f2-2f2f83a0f50d","Type":"ContainerStarted","Data":"19a4ddecb07f7606b0ee5ee60873890357511cd35f9e403ab167086b4605ba86"} Jul 17 14:52:35.808355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:35.807751 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-l72kz" podStartSLOduration=1.5129000559999999 podStartE2EDuration="18.807726663s" totalImagesPullingTime="17.294826607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:35.787380641 +0000 UTC m=+202.139274292" watchObservedRunningTime="2026-07-17 14:52:35.807726663 +0000 UTC m=+202.159620298" Jul 17 14:52:39.670042 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:39.669999 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55d89dc498-8r4pz" Jul 17 14:52:41.693328 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:41.693289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:52:41.696062 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:41.696039 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 14:52:41.706553 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:41.706529 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 14:52:41.717580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:41.717553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvq5\" (UniqueName: \"kubernetes.io/projected/aaef1e59-1413-480a-89fb-32978e50436b-kube-api-access-4cvq5\") pod \"network-check-target-gkbxj\" (UID: \"aaef1e59-1413-480a-89fb-32978e50436b\") " pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:52:41.975283 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:41.975184 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8rtv\"" Jul 17 14:52:41.982876 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:41.982849 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:52:44.409720 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.409630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gkbxj"] Jul 17 14:52:44.410332 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:52:44.410229 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaef1e59_1413_480a_89fb_32978e50436b.slice/crio-62a5ea4be8a701042e5580b63d1b00dd973e4fb2fc255b76182f3e363585dd03 WatchSource:0}: Error finding container 62a5ea4be8a701042e5580b63d1b00dd973e4fb2fc255b76182f3e363585dd03: Status 404 returned error can't find the container with id 62a5ea4be8a701042e5580b63d1b00dd973e4fb2fc255b76182f3e363585dd03 Jul 17 14:52:44.826047 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.826011 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="5d85d4b0783133f42186a854efb5ff9eca205d9c208ffad82c5c762430c8b379" exitCode=0 Jul 17 14:52:44.826257 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.826115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"5d85d4b0783133f42186a854efb5ff9eca205d9c208ffad82c5c762430c8b379"} Jul 17 14:52:44.828671 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.828648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"719474329a54e344ca57f7a6d360926b3df2aed151d9cc1b52f3929fe5308dbf"} Jul 17 14:52:44.828783 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.828719 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"37aa65e35f7544e756451871d6914a71207f8fcf7fbc1d99d83bba442ef209c1"} Jul 17 14:52:44.828783 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.828766 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"52636fdf561225a13e8c949b4712f40251b7eb0174ffdff40588fc80f280e13c"} Jul 17 14:52:44.830559 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.830524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" event={"ID":"3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b","Type":"ContainerStarted","Data":"d06f9718c884b1fe0959514a74a16da352e5add2344c7b49117edc210a217be1"} Jul 17 14:52:44.830667 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.830579 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:44.834842 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.834776 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9kdnc" event={"ID":"186f59e1-2bef-4115-80f2-2f2f83a0f50d","Type":"ContainerStarted","Data":"bea60346636449e36e7b3836de89c3006742dcf2db83b667a2c219ab84a52fb4"} Jul 17 14:52:44.835432 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.834937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9kdnc" event={"ID":"186f59e1-2bef-4115-80f2-2f2f83a0f50d","Type":"ContainerStarted","Data":"69f1ac58e38b645a29d41b65d55d1b4a95c3edef3008437d551a4d1c06339790"} Jul 17 14:52:44.837133 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.836775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gkbxj" event={"ID":"aaef1e59-1413-480a-89fb-32978e50436b","Type":"ContainerStarted","Data":"62a5ea4be8a701042e5580b63d1b00dd973e4fb2fc255b76182f3e363585dd03"} Jul 17 14:52:44.837926 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.837905 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" Jul 17 14:52:44.838680 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.838548 2574 generic.go:356] "Generic (PLEG): container finished" podID="657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9" containerID="6b7a58c73a69add5e903fc334265631671e06769404a8522a1e9df86c2977a12" exitCode=0 Jul 17 14:52:44.838680 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.838639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9mj9" event={"ID":"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9","Type":"ContainerDied","Data":"6b7a58c73a69add5e903fc334265631671e06769404a8522a1e9df86c2977a12"} Jul 17 14:52:44.841182 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.841155 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffl7m" event={"ID":"835874ff-88cc-4a96-95b6-6caa0901e7b7","Type":"ContainerStarted","Data":"a89cea56971188c175eef785566ea73f6f1bfc2867e9a83bc5acf035ba609ff1"} Jul 17 14:52:44.844340 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.844317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" event={"ID":"0284b3d2-f480-48ef-8d51-d778d79da6f3","Type":"ContainerStarted","Data":"e579b57a6d0844c8d6adc51dff8eec229ce8d2372abdd9f429531747343db259"} Jul 17 14:52:44.857559 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.857533 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6555f4fd-sqvn4"] Jul 17 14:52:44.898420 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.898354 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-lcnhj" podStartSLOduration=2.73983029 podStartE2EDuration="17.898333846s" totalImagesPullingTime="15.158503556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:44.897276946 +0000 UTC m=+211.249170582" watchObservedRunningTime="2026-07-17 14:52:44.898333846 +0000 UTC m=+211.250227503" Jul 17 14:52:44.922296 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.922237 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9kdnc" podStartSLOduration=135.949655285 podStartE2EDuration="2m24.922217931s" totalImagesPullingTime="8.972562646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:44.921945838 +0000 UTC m=+211.273839470" watchObservedRunningTime="2026-07-17 14:52:44.922217931 +0000 UTC m=+211.274111558" Jul 17 14:52:44.944076 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:44.944015 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ffl7m" podStartSLOduration=17.415918697 podStartE2EDuration="54.943997609s" totalImagesPullingTime="37.528078912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:51:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 14:52:44.942795816 +0000 UTC m=+211.294689450" watchObservedRunningTime="2026-07-17 14:52:44.943997609 +0000 UTC m=+211.295891242" Jul 17 14:52:45.009647 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:45.009591 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7pfg5" podStartSLOduration=5.034816852 podStartE2EDuration="14.009568782s" totalImagesPullingTime="8.97475193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:45.008596183 +0000 UTC m=+211.360489815" watchObservedRunningTime="2026-07-17 14:52:45.009568782 +0000 UTC m=+211.361462394" Jul 17 14:52:45.853630 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:45.853593 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9mj9" event={"ID":"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9","Type":"ContainerStarted","Data":"bdca275a92827bf4d736bcd8a91011429f2143544f45c33dfe0468a010ad1dc0"} Jul 17 14:52:45.854327 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:45.853679 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9mj9" event={"ID":"657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9","Type":"ContainerStarted","Data":"8c725d195254d9870251f8af4afd9e3bfe22dd46aa6e4d99261f16bb3761f2a5"} Jul 17 14:52:45.877036 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:45.876978 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m9mj9" podStartSLOduration=3.8419965940000003 podStartE2EDuration="18.87695837s" totalImagesPullingTime="14.943662052s" totalInitContainerRuntime="91.299724ms" isStatefulPod=true podCreationTimestamp="2026-07-17 14:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:45.875825532 +0000 UTC m=+212.227719157" watchObservedRunningTime="2026-07-17 14:52:45.87695837 +0000 UTC m=+212.228852002" Jul 17 14:52:46.861296 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:46.861252 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"81e86c65bd62c5393874f536e13851c8706cb38032a2adfac417a49d4bfc3114"} Jul 17 14:52:46.861857 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:46.861378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"6582370b312be1b3849d70f5f55633c35b8785becd8c40aab2a26af9941021c5"} Jul 17 14:52:46.861857 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:46.861423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" event={"ID":"4c12bde9-8747-4aab-9abe-c5a3322a4115","Type":"ContainerStarted","Data":"237f1d73e659308437337b206fb0f83f06754cabcfac9b4ae3521c553d1dfa0c"} Jul 17 14:52:46.889231 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:46.889152 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" podStartSLOduration=7.446939761 podStartE2EDuration="17.889113443s" totalImagesPullingTime="10.442173682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:46.888852015 +0000 UTC m=+213.240745663" watchObservedRunningTime="2026-07-17 14:52:46.889113443 +0000 UTC m=+213.241007105" Jul 17 14:52:47.866655 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:47.866605 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:52:49.877119 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.877088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"43b9bfc948bc05251b97b0841deb97436d7202928df8fba211d3baab2c1499f8"} Jul 17 14:52:49.877554 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.877207 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"6da6f49b5b1e387246eeec33e86edefa8ff7d37d7ae8642ac1621f07239aeba7"} Jul 17 14:52:49.877554 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.877250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"05760cd2db800cd47594ff679b9477aa168d139b1dee39d0279f92f29b1e2d28"} Jul 17 14:52:49.877554 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.877281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"a1873d8cf124a0c2805ef8f346110962c1a8a18cd4351b9bc8fc18f404b667b5"} Jul 17 14:52:49.877554 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.877317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"667296ed57e3d6b337f544f96b0ae7e1d4063b17518c5512847557acb7e6bb07"} Jul 17 14:52:49.878485 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.878459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gkbxj" event={"ID":"aaef1e59-1413-480a-89fb-32978e50436b","Type":"ContainerStarted","Data":"d7ba1862186deb71018ca791b46f3014fafe0735e3b6b618851b678a418a585b"} Jul 17 14:52:49.878676 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.878660 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:52:49.898037 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:49.897927 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gkbxj" podStartSLOduration=132.169612837 podStartE2EDuration="2m16.897905835s" totalImagesPullingTime="4.728292998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:49.896536325 +0000 UTC m=+216.248429952" watchObservedRunningTime="2026-07-17 14:52:49.897905835 +0000 UTC m=+216.249799469" Jul 17 14:52:50.885164 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:50.885121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerStarted","Data":"0232fa44c31518703b0a4abce4657de726f16737a69bd2575290a52437b1bd3d"} Jul 17 14:52:50.921819 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:50.921761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.858140599 podStartE2EDuration="17.921739723s" totalImagesPullingTime="13.037076006s" totalInitContainerRuntime="26.523118ms" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:50.919170567 +0000 UTC m=+217.271064201" watchObservedRunningTime="2026-07-17 14:52:50.921739723 +0000 UTC m=+217.273633356" Jul 17 14:52:53.691786 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:53.691752 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:52:53.876079 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:52:53.876053 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7fc4d8dc97-fbklv" Jul 17 14:53:01.381106 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:01.381072 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvgff_ad5aea99-3ae1-466e-9071-9544f678561a/serve-healthcheck-canary/0.log" Jul 17 14:53:09.888165 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:09.888103 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b6555f4fd-sqvn4" podUID="b3a41768-8102-460b-a92e-40496b57f7a6" containerName="console" containerID="cri-o://d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2" gracePeriod=15 Jul 17 14:53:10.140269 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.140213 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:53:10.244504 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244469 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-service-ca\") pod \"b3a41768-8102-460b-a92e-40496b57f7a6\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " Jul 17 14:53:10.244678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244568 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-serving-cert\") pod \"b3a41768-8102-460b-a92e-40496b57f7a6\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " Jul 17 14:53:10.244678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244601 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnww2\" (UniqueName: \"kubernetes.io/projected/b3a41768-8102-460b-a92e-40496b57f7a6-kube-api-access-fnww2\") pod \"b3a41768-8102-460b-a92e-40496b57f7a6\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " Jul 17 14:53:10.244678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244637 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-oauth-serving-cert\") pod \"b3a41768-8102-460b-a92e-40496b57f7a6\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " Jul 17 14:53:10.244678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244675 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-oauth-config\") pod \"b3a41768-8102-460b-a92e-40496b57f7a6\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " Jul 17 14:53:10.244901 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244701 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-console-config\") pod \"b3a41768-8102-460b-a92e-40496b57f7a6\" (UID: \"b3a41768-8102-460b-a92e-40496b57f7a6\") " Jul 17 14:53:10.244958 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.244916 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3a41768-8102-460b-a92e-40496b57f7a6" (UID: "b3a41768-8102-460b-a92e-40496b57f7a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:10.245160 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.245129 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3a41768-8102-460b-a92e-40496b57f7a6" (UID: "b3a41768-8102-460b-a92e-40496b57f7a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:10.245160 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.245127 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-console-config" (OuterVolumeSpecName: "console-config") pod "b3a41768-8102-460b-a92e-40496b57f7a6" (UID: "b3a41768-8102-460b-a92e-40496b57f7a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:10.247062 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.247038 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3a41768-8102-460b-a92e-40496b57f7a6" (UID: "b3a41768-8102-460b-a92e-40496b57f7a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:10.247153 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.247064 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3a41768-8102-460b-a92e-40496b57f7a6" (UID: "b3a41768-8102-460b-a92e-40496b57f7a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:10.247153 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.247090 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a41768-8102-460b-a92e-40496b57f7a6-kube-api-access-fnww2" (OuterVolumeSpecName: "kube-api-access-fnww2") pod "b3a41768-8102-460b-a92e-40496b57f7a6" (UID: "b3a41768-8102-460b-a92e-40496b57f7a6"). InnerVolumeSpecName "kube-api-access-fnww2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:53:10.345621 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.345582 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-serving-cert\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:10.345621 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.345613 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnww2\" (UniqueName: \"kubernetes.io/projected/b3a41768-8102-460b-a92e-40496b57f7a6-kube-api-access-fnww2\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:10.345621 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.345623 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-oauth-serving-cert\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:10.345621 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.345631 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a41768-8102-460b-a92e-40496b57f7a6-console-oauth-config\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:10.345865 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.345640 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-console-config\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:10.345865 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.345648 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a41768-8102-460b-a92e-40496b57f7a6-service-ca\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:10.963382 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.963338 2574 generic.go:356] "Generic (PLEG): container finished" podID="b3a41768-8102-460b-a92e-40496b57f7a6" containerID="d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2" exitCode=0 Jul 17 14:53:10.963802 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.963388 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6555f4fd-sqvn4" Jul 17 14:53:10.963802 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.963429 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6555f4fd-sqvn4" event={"ID":"b3a41768-8102-460b-a92e-40496b57f7a6","Type":"ContainerDied","Data":"d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2"} Jul 17 14:53:10.963802 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.963479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6555f4fd-sqvn4" event={"ID":"b3a41768-8102-460b-a92e-40496b57f7a6","Type":"ContainerDied","Data":"99c31322b32fd99398279270f379383f92d27213382be5b1acb5d31a71ca56b1"} Jul 17 14:53:10.963802 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.963499 2574 scope.go:117] "RemoveContainer" containerID="d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2" Jul 17 14:53:10.972066 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.972047 2574 scope.go:117] "RemoveContainer" containerID="d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2" Jul 17 14:53:10.972361 ip-10-0-139-74 kubenswrapper[2574]: E0717 14:53:10.972345 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2\": container with ID starting with d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2 not found: ID does not exist" containerID="d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2" Jul 17 14:53:10.972417 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.972370 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2"} err="failed to get container status \"d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2\": rpc error: code = NotFound desc = could not find container \"d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2\": container with ID starting with d506b2589c78e03728725df187ab1bb6436d289a97ae16ea991deb9ab5cdc7a2 not found: ID does not exist" Jul 17 14:53:10.990558 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.990533 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6555f4fd-sqvn4"] Jul 17 14:53:10.996389 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:10.996358 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6555f4fd-sqvn4"] Jul 17 14:53:12.164520 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:12.164489 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a41768-8102-460b-a92e-40496b57f7a6" path="/var/lib/kubelet/pods/b3a41768-8102-460b-a92e-40496b57f7a6/volumes" Jul 17 14:53:20.887292 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:20.887262 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gkbxj" Jul 17 14:53:25.982553 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:25.982511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:53:25.985356 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:25.985337 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 14:53:25.996081 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:25.996059 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b66703c1-056c-48af-b986-c4dd73996a89-original-pull-secret\") pod \"global-pull-secret-syncer-42vbh\" (UID: \"b66703c1-056c-48af-b986-c4dd73996a89\") " pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:53:26.274177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:26.274149 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42vbh" Jul 17 14:53:26.468678 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:26.468652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-42vbh"] Jul 17 14:53:26.471176 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:53:26.471146 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66703c1_056c_48af_b986_c4dd73996a89.slice/crio-66d64c761057ca92a06471327b75236ed257712359eb3ffa0a681269eabba3a8 WatchSource:0}: Error finding container 66d64c761057ca92a06471327b75236ed257712359eb3ffa0a681269eabba3a8: Status 404 returned error can't find the container with id 66d64c761057ca92a06471327b75236ed257712359eb3ffa0a681269eabba3a8 Jul 17 14:53:27.026228 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:27.026174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-42vbh" event={"ID":"b66703c1-056c-48af-b986-c4dd73996a89","Type":"ContainerStarted","Data":"66d64c761057ca92a06471327b75236ed257712359eb3ffa0a681269eabba3a8"} Jul 17 14:53:31.043932 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:31.043894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-42vbh" event={"ID":"b66703c1-056c-48af-b986-c4dd73996a89","Type":"ContainerStarted","Data":"12bbdef4620e8ef29746d0c090f4049410c54b160483ec0ad53454b90363054e"} Jul 17 14:53:31.078103 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:31.078052 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-42vbh" podStartSLOduration=252.682862178 podStartE2EDuration="4m17.078036674s" totalImagesPullingTime="4.395174496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:53:31.077612587 +0000 UTC m=+257.429506234" watchObservedRunningTime="2026-07-17 14:53:31.078036674 +0000 UTC m=+257.429930306" Jul 17 14:53:33.691155 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:33.691101 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:33.711518 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:33.711480 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:34.070258 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:34.070228 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:51.902425 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902388 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:53:51.902853 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902706 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="prometheus" containerID="cri-o://667296ed57e3d6b337f544f96b0ae7e1d4063b17518c5512847557acb7e6bb07" gracePeriod=600 Jul 17 14:53:51.902853 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902761 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-web" containerID="cri-o://6da6f49b5b1e387246eeec33e86edefa8ff7d37d7ae8642ac1621f07239aeba7" gracePeriod=600 Jul 17 14:53:51.902853 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902796 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="thanos-sidecar" containerID="cri-o://05760cd2db800cd47594ff679b9477aa168d139b1dee39d0279f92f29b1e2d28" gracePeriod=600 Jul 17 14:53:51.902853 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902716 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy" containerID="cri-o://43b9bfc948bc05251b97b0841deb97436d7202928df8fba211d3baab2c1499f8" gracePeriod=600 Jul 17 14:53:51.903058 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902760 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0232fa44c31518703b0a4abce4657de726f16737a69bd2575290a52437b1bd3d" gracePeriod=600 Jul 17 14:53:51.903058 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:51.902796 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="config-reloader" containerID="cri-o://a1873d8cf124a0c2805ef8f346110962c1a8a18cd4351b9bc8fc18f404b667b5" gracePeriod=600 Jul 17 14:53:52.127681 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127649 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="0232fa44c31518703b0a4abce4657de726f16737a69bd2575290a52437b1bd3d" exitCode=0 Jul 17 14:53:52.127681 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127678 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="43b9bfc948bc05251b97b0841deb97436d7202928df8fba211d3baab2c1499f8" exitCode=0 Jul 17 14:53:52.127681 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127686 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="6da6f49b5b1e387246eeec33e86edefa8ff7d37d7ae8642ac1621f07239aeba7" exitCode=0 Jul 17 14:53:52.127681 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127693 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="05760cd2db800cd47594ff679b9477aa168d139b1dee39d0279f92f29b1e2d28" exitCode=0 Jul 17 14:53:52.127681 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127702 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="a1873d8cf124a0c2805ef8f346110962c1a8a18cd4351b9bc8fc18f404b667b5" exitCode=0 Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127709 2574 generic.go:356] "Generic (PLEG): container finished" podID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerID="667296ed57e3d6b337f544f96b0ae7e1d4063b17518c5512847557acb7e6bb07" exitCode=0 Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"0232fa44c31518703b0a4abce4657de726f16737a69bd2575290a52437b1bd3d"} Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"43b9bfc948bc05251b97b0841deb97436d7202928df8fba211d3baab2c1499f8"} Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"6da6f49b5b1e387246eeec33e86edefa8ff7d37d7ae8642ac1621f07239aeba7"} Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"05760cd2db800cd47594ff679b9477aa168d139b1dee39d0279f92f29b1e2d28"} Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"a1873d8cf124a0c2805ef8f346110962c1a8a18cd4351b9bc8fc18f404b667b5"} Jul 17 14:53:52.127972 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.127890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"667296ed57e3d6b337f544f96b0ae7e1d4063b17518c5512847557acb7e6bb07"} Jul 17 14:53:52.153715 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.153656 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:52.197944 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.197915 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config-out\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.197944 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.197954 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-trusted-ca-bundle\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.197975 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-0\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198007 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-1\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8ss4\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-kube-api-access-q8ss4\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-grpc-tls\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198094 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-thanos-prometheus-http-client-file\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198124 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-tls-assets\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198152 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-metrics-client-ca\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198315 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198355 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198352 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-kube-rbac-proxy\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198426 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198456 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-metrics-client-certs\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198488 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-web-config\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198511 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-2\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198505 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198548 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.198825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.198578 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-tls\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.199481 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.199456 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-kubelet-serving-ca-bundle\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.199591 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.199536 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-db\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.199591 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.199571 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-serving-certs-ca-bundle\") pod \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\" (UID: \"8bd44b2d-2dea-481b-96bb-a6540b0d72ee\") " Jul 17 14:53:52.199716 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.199614 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.200326 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.199819 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.200326 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.199840 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.200326 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.200238 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.201737 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.200847 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.201737 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.201336 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.202154 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.202102 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.202277 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.202176 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:53:52.203770 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.203723 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:53:52.204354 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.204322 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.205209 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205142 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.205209 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205160 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config-out" (OuterVolumeSpecName: "config-out") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:53:52.205209 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205159 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:53:52.205417 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205330 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.205477 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205447 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.205568 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205542 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.205642 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205616 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-kube-api-access-q8ss4" (OuterVolumeSpecName: "kube-api-access-q8ss4") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "kube-api-access-q8ss4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:53:52.205699 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205657 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config" (OuterVolumeSpecName: "config") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.205751 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.205730 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.206521 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.206498 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.215879 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.215854 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-web-config" (OuterVolumeSpecName: "web-config") pod "8bd44b2d-2dea-481b-96bb-a6540b0d72ee" (UID: "8bd44b2d-2dea-481b-96bb-a6540b0d72ee"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:53:52.301117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301080 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-metrics-client-ca\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301111 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301120 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-kube-rbac-proxy\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301117 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301129 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301137 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-metrics-client-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301146 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-web-config\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301154 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301164 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301172 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301180 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-db\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301188 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301223 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-config-out\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301232 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301240 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301248 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8ss4\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-kube-api-access-q8ss4\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301256 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-secret-grpc-tls\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301264 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:52.301410 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:52.301273 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd44b2d-2dea-481b-96bb-a6540b0d72ee-tls-assets\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 14:53:53.139459 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.139424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd44b2d-2dea-481b-96bb-a6540b0d72ee","Type":"ContainerDied","Data":"7f079db3db118d9e9f75a19614660c8df6d6df3d29bd582e1e4bacf15388bcd7"} Jul 17 14:53:53.139858 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.139520 2574 scope.go:117] "RemoveContainer" containerID="0232fa44c31518703b0a4abce4657de726f16737a69bd2575290a52437b1bd3d" Jul 17 14:53:53.139858 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.139533 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.147386 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.147271 2574 scope.go:117] "RemoveContainer" containerID="43b9bfc948bc05251b97b0841deb97436d7202928df8fba211d3baab2c1499f8" Jul 17 14:53:53.154510 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.154490 2574 scope.go:117] "RemoveContainer" containerID="6da6f49b5b1e387246eeec33e86edefa8ff7d37d7ae8642ac1621f07239aeba7" Jul 17 14:53:53.161369 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.161346 2574 scope.go:117] "RemoveContainer" containerID="05760cd2db800cd47594ff679b9477aa168d139b1dee39d0279f92f29b1e2d28" Jul 17 14:53:53.168152 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.168134 2574 scope.go:117] "RemoveContainer" containerID="a1873d8cf124a0c2805ef8f346110962c1a8a18cd4351b9bc8fc18f404b667b5" Jul 17 14:53:53.171096 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.171072 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:53:53.176048 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.176031 2574 scope.go:117] "RemoveContainer" containerID="667296ed57e3d6b337f544f96b0ae7e1d4063b17518c5512847557acb7e6bb07" Jul 17 14:53:53.177238 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.177217 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:53:53.183787 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.183771 2574 scope.go:117] "RemoveContainer" containerID="5d85d4b0783133f42186a854efb5ff9eca205d9c208ffad82c5c762430c8b379" Jul 17 14:53:53.218156 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218115 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:53:53.218398 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218386 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="config-reloader" Jul 17 14:53:53.218398 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218399 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="config-reloader" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218407 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-thanos" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218413 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-thanos" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218426 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="init-config-reloader" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218432 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="init-config-reloader" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218439 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218443 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218449 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="thanos-sidecar" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218454 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="thanos-sidecar" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218460 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-web" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218464 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-web" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218470 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="prometheus" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218475 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="prometheus" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218483 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a41768-8102-460b-a92e-40496b57f7a6" containerName="console" Jul 17 14:53:53.218482 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218488 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a41768-8102-460b-a92e-40496b57f7a6" containerName="console" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218530 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="thanos-sidecar" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218538 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-thanos" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218545 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a41768-8102-460b-a92e-40496b57f7a6" containerName="console" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218551 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="config-reloader" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218557 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy-web" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218562 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="kube-rbac-proxy" Jul 17 14:53:53.218920 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.218567 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" containerName="prometheus" Jul 17 14:53:53.222569 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.222553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.225598 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.225576 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2p98uq5eaahot\"" Jul 17 14:53:53.225737 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.225621 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 14:53:53.225815 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.225736 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 14:53:53.230612 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.230593 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 14:53:53.230612 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.230604 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 14:53:53.231071 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.231053 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 14:53:53.232537 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.232522 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 14:53:53.233274 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.233260 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 14:53:53.233914 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.233901 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 14:53:53.233985 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.233969 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z9l92\"" Jul 17 14:53:53.234144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.234133 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 14:53:53.234282 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.234263 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 14:53:53.234397 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.234324 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 14:53:53.237625 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.237611 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 14:53:53.238514 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.238500 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 14:53:53.249607 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.249589 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 14:53:53.255469 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.255453 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 14:53:53.259014 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.258995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:53:53.307997 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.307958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgfxv\" (UniqueName: \"kubernetes.io/projected/a402912e-0470-426b-b9b6-cc3ece202a09-kube-api-access-cgfxv\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.307997 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.307999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-config\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308280 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a402912e-0470-426b-b9b6-cc3ece202a09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308344 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308516 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308799 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-web-config\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308799 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308799 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308799 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.308799 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.308656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a402912e-0470-426b-b9b6-cc3ece202a09-config-out\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.409925 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.409885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.409925 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.409921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.409939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-web-config\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410144 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a402912e-0470-426b-b9b6-cc3ece202a09-config-out\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410363 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgfxv\" (UniqueName: \"kubernetes.io/projected/a402912e-0470-426b-b9b6-cc3ece202a09-kube-api-access-cgfxv\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-config\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a402912e-0470-426b-b9b6-cc3ece202a09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.411073 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.411073 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.410689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.412874 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.411856 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.412874 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.412332 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413334 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413268 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a402912e-0470-426b-b9b6-cc3ece202a09-config-out\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413474 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413539 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413626 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413602 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413692 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413618 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413792 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413765 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413908 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413814 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.413908 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.413875 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-web-config\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.414184 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.414161 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.415037 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.414950 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.415565 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.415535 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-config\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.415864 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.415840 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a402912e-0470-426b-b9b6-cc3ece202a09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.416104 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.416086 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.416492 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.416475 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.416853 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.416834 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a402912e-0470-426b-b9b6-cc3ece202a09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.417125 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.417108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a402912e-0470-426b-b9b6-cc3ece202a09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.422031 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.421980 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgfxv\" (UniqueName: \"kubernetes.io/projected/a402912e-0470-426b-b9b6-cc3ece202a09-kube-api-access-cgfxv\") pod \"prometheus-k8s-0\" (UID: \"a402912e-0470-426b-b9b6-cc3ece202a09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.531932 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.531892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:53:53.686634 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:53.686537 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 14:53:53.690806 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:53:53.690778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda402912e_0470_426b_b9b6_cc3ece202a09.slice/crio-6a34d431d33c91113507be63811d7f795a33e3f44110ea9332d99960b991312c WatchSource:0}: Error finding container 6a34d431d33c91113507be63811d7f795a33e3f44110ea9332d99960b991312c: Status 404 returned error can't find the container with id 6a34d431d33c91113507be63811d7f795a33e3f44110ea9332d99960b991312c Jul 17 14:53:54.145827 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:54.145790 2574 generic.go:356] "Generic (PLEG): container finished" podID="a402912e-0470-426b-b9b6-cc3ece202a09" containerID="50a7e3be7c57e6ff9066ca1f687a7358b210462d2e010aa50b40cd749c456147" exitCode=0 Jul 17 14:53:54.146225 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:54.145832 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerDied","Data":"50a7e3be7c57e6ff9066ca1f687a7358b210462d2e010aa50b40cd749c456147"} Jul 17 14:53:54.146225 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:54.145894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"6a34d431d33c91113507be63811d7f795a33e3f44110ea9332d99960b991312c"} Jul 17 14:53:54.164271 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:54.164245 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bd44b2d-2dea-481b-96bb-a6540b0d72ee" path="/var/lib/kubelet/pods/8bd44b2d-2dea-481b-96bb-a6540b0d72ee/volumes" Jul 17 14:53:55.153580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.153546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"1c7a6bc7c1bcf414af65568606151bb6b6b3a1314fbcd542f7192cdf9b3e5caf"} Jul 17 14:53:55.153973 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.153639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"4e3583d719dd6028579e6ebbcbd619096aa0f009d817077c48245eee47ca3c51"} Jul 17 14:53:55.153973 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.153665 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"0f160acdfd05c15a121cba16eea8e3e6eb542f041842d9ff49d516344181f13c"} Jul 17 14:53:55.153973 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.153689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"fc83a38bc5facaf127e082830f390e4b569cae9dde78a2eec709aba080980ab3"} Jul 17 14:53:55.153973 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.153713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"e01d50b9c973500f04e8739c35cebf691c5e1c1de7c985fe3ffcf3094c051218"} Jul 17 14:53:55.153973 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.153738 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a402912e-0470-426b-b9b6-cc3ece202a09","Type":"ContainerStarted","Data":"f518c827e0ea38fee743a96571decb10112b2bf0aaf342babc52b574a08f751c"} Jul 17 14:53:55.198881 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:55.198831 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.181297493 podStartE2EDuration="2.198815644s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.518151ms" isStatefulPod=false podCreationTimestamp="2026-07-17 14:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:53:55.196703595 +0000 UTC m=+281.548597227" watchObservedRunningTime="2026-07-17 14:53:55.198815644 +0000 UTC m=+281.550709277" Jul 17 14:53:58.532239 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:53:58.532178 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:54:14.058585 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:54:14.058557 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 14:54:14.060555 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:54:14.060531 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 14:54:14.063706 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:54:14.063520 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 14:54:53.532584 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:54:53.532542 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:54:53.548742 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:54:53.548710 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:54:54.385968 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:54:54.385936 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 14:57:09.950889 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.950842 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl"] Jul 17 14:57:09.953152 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.953136 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:09.962313 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.962288 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ndbhs\"" Jul 17 14:57:09.967734 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.967714 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 14:57:09.968469 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.968450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 14:57:09.968608 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.968592 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 14:57:09.973810 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.973795 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 14:57:09.981230 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.981187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-tmp\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:09.981333 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.981283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:09.981333 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.981327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dctkx\" (UniqueName: \"kubernetes.io/projected/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-kube-api-access-dctkx\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:09.981405 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.981349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:09.981405 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.981376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-manifests\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:09.982481 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:09.982461 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl"] Jul 17 14:57:10.082133 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.082096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-tmp\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.082360 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.082155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.082360 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.082211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dctkx\" (UniqueName: \"kubernetes.io/projected/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-kube-api-access-dctkx\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.082360 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.082236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.082360 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.082256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-manifests\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.082580 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.082565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-manifests\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.084621 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.084589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-tmp\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.084772 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.084714 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.084877 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.084858 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.106226 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.106181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dctkx\" (UniqueName: \"kubernetes.io/projected/f3f973aa-9e22-4f9f-93f2-7e2271c257f8-kube-api-access-dctkx\") pod \"opendatahub-operator-controller-manager-dcf5668f8-fbdjl\" (UID: \"f3f973aa-9e22-4f9f-93f2-7e2271c257f8\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.263233 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.263129 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:10.426564 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.426514 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl"] Jul 17 14:57:10.429886 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:57:10.429858 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f973aa_9e22_4f9f_93f2_7e2271c257f8.slice/crio-33e597a6a46653b62d15632c3b69080c74e9a842a4c53707406958471bd206a2 WatchSource:0}: Error finding container 33e597a6a46653b62d15632c3b69080c74e9a842a4c53707406958471bd206a2: Status 404 returned error can't find the container with id 33e597a6a46653b62d15632c3b69080c74e9a842a4c53707406958471bd206a2 Jul 17 14:57:10.431473 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.431458 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:57:10.870290 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:10.870257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" event={"ID":"f3f973aa-9e22-4f9f-93f2-7e2271c257f8","Type":"ContainerStarted","Data":"33e597a6a46653b62d15632c3b69080c74e9a842a4c53707406958471bd206a2"} Jul 17 14:57:13.885946 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:13.885912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" event={"ID":"f3f973aa-9e22-4f9f-93f2-7e2271c257f8","Type":"ContainerStarted","Data":"7f33e9a47fc61c92f894a99e952f7d7f4cbb59c821b06351aa502b572e452947"} Jul 17 14:57:14.890711 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:14.890672 2574 generic.go:356] "Generic (PLEG): container finished" podID="f3f973aa-9e22-4f9f-93f2-7e2271c257f8" containerID="7f33e9a47fc61c92f894a99e952f7d7f4cbb59c821b06351aa502b572e452947" exitCode=0 Jul 17 14:57:14.891160 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:14.890717 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" event={"ID":"f3f973aa-9e22-4f9f-93f2-7e2271c257f8","Type":"ContainerDied","Data":"7f33e9a47fc61c92f894a99e952f7d7f4cbb59c821b06351aa502b572e452947"} Jul 17 14:57:15.896906 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:15.896872 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" event={"ID":"f3f973aa-9e22-4f9f-93f2-7e2271c257f8","Type":"ContainerStarted","Data":"fc5bbab6dda99ffe94a163dcae7c5234a112f319afa0a7da19ca39f65a3bcc35"} Jul 17 14:57:15.897327 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:15.896968 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:15.921893 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:15.921839 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" podStartSLOduration=2.69134818 podStartE2EDuration="6.921822367s" totalImagesPullingTime="3.183355288s" totalInitContainerRuntime="1.047118899s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:15.92097412 +0000 UTC m=+482.272867752" watchObservedRunningTime="2026-07-17 14:57:15.921822367 +0000 UTC m=+482.273716000" Jul 17 14:57:26.903211 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:26.903174 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-fbdjl" Jul 17 14:57:27.698714 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.698658 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7"] Jul 17 14:57:27.707882 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.707854 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.710921 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.710900 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 14:57:27.711967 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.711938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 14:57:27.711967 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.711951 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 14:57:27.711967 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.711964 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 14:57:27.712175 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.711978 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 14:57:27.712175 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.712123 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x22dr\"" Jul 17 14:57:27.717250 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.717225 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7"] Jul 17 14:57:27.840653 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.840613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d137105b-016e-435e-9ce0-70e716285ccb-cert\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.840850 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.840666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqm8d\" (UniqueName: \"kubernetes.io/projected/d137105b-016e-435e-9ce0-70e716285ccb-kube-api-access-wqm8d\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.840850 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.840763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d137105b-016e-435e-9ce0-70e716285ccb-metrics-cert\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.840850 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.840815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d137105b-016e-435e-9ce0-70e716285ccb-manager-config\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.941842 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.941812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d137105b-016e-435e-9ce0-70e716285ccb-cert\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.942333 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.941859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqm8d\" (UniqueName: \"kubernetes.io/projected/d137105b-016e-435e-9ce0-70e716285ccb-kube-api-access-wqm8d\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.942333 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.941934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d137105b-016e-435e-9ce0-70e716285ccb-metrics-cert\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.942333 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.941975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d137105b-016e-435e-9ce0-70e716285ccb-manager-config\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.942757 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.942731 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d137105b-016e-435e-9ce0-70e716285ccb-manager-config\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.944921 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.944887 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d137105b-016e-435e-9ce0-70e716285ccb-cert\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.945066 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.944889 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d137105b-016e-435e-9ce0-70e716285ccb-metrics-cert\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:27.955051 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:27.954948 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqm8d\" (UniqueName: \"kubernetes.io/projected/d137105b-016e-435e-9ce0-70e716285ccb-kube-api-access-wqm8d\") pod \"lws-controller-manager-9db68d568-lh7h7\" (UID: \"d137105b-016e-435e-9ce0-70e716285ccb\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:28.018038 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:28.017995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:28.155990 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:28.155964 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7"] Jul 17 14:57:28.158421 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:57:28.158393 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd137105b_016e_435e_9ce0_70e716285ccb.slice/crio-c231129d3c7da8e7a1d860e60dc0942878788a06c369ccf9c12a0ece771ca4c2 WatchSource:0}: Error finding container c231129d3c7da8e7a1d860e60dc0942878788a06c369ccf9c12a0ece771ca4c2: Status 404 returned error can't find the container with id c231129d3c7da8e7a1d860e60dc0942878788a06c369ccf9c12a0ece771ca4c2 Jul 17 14:57:28.948116 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:28.948081 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" event={"ID":"d137105b-016e-435e-9ce0-70e716285ccb","Type":"ContainerStarted","Data":"c231129d3c7da8e7a1d860e60dc0942878788a06c369ccf9c12a0ece771ca4c2"} Jul 17 14:57:30.149269 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.149225 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd"] Jul 17 14:57:30.152153 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.152125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.155991 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.155941 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 14:57:30.156131 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.156109 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 17 14:57:30.157964 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.157943 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 14:57:30.158407 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.158359 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzdsf\"" Jul 17 14:57:30.158902 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.158883 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 14:57:30.170880 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.170826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd"] Jul 17 14:57:30.261473 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.261435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-tls-certs\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.261473 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.261478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-tmp\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.261726 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.261507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhbd\" (UniqueName: \"kubernetes.io/projected/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-kube-api-access-jhhbd\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.362607 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.362574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-tls-certs\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.362607 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.362610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-tmp\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.362847 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.362635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhbd\" (UniqueName: \"kubernetes.io/projected/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-kube-api-access-jhhbd\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.365028 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.365003 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-tmp\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.365177 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.365154 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-tls-certs\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.380838 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.380801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhbd\" (UniqueName: \"kubernetes.io/projected/cca1bb56-a6ee-446c-be3b-dc3163e5ea6d-kube-api-access-jhhbd\") pod \"kube-auth-proxy-56cdb8d648-2drgd\" (UID: \"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d\") " pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:30.464990 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:30.464911 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" Jul 17 14:57:31.509892 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:31.509864 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd"] Jul 17 14:57:31.513315 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:57:31.513290 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca1bb56_a6ee_446c_be3b_dc3163e5ea6d.slice/crio-3317427f3bdea8bb397ce0c3cb8fe9833c8a1912306e8568d0f70b715bea1dd3 WatchSource:0}: Error finding container 3317427f3bdea8bb397ce0c3cb8fe9833c8a1912306e8568d0f70b715bea1dd3: Status 404 returned error can't find the container with id 3317427f3bdea8bb397ce0c3cb8fe9833c8a1912306e8568d0f70b715bea1dd3 Jul 17 14:57:31.965715 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:31.965676 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" event={"ID":"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d","Type":"ContainerStarted","Data":"3317427f3bdea8bb397ce0c3cb8fe9833c8a1912306e8568d0f70b715bea1dd3"} Jul 17 14:57:31.967718 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:31.967675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" event={"ID":"d137105b-016e-435e-9ce0-70e716285ccb","Type":"ContainerStarted","Data":"cb712e8730943ab2fec23162ff6f23530b1369ae8f8a1686c209b4ca0c8b9a40"} Jul 17 14:57:31.967861 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:31.967805 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:31.997011 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:31.996948 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" podStartSLOduration=1.725838048 podStartE2EDuration="4.996925672s" totalImagesPullingTime="3.271087624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:31.996318094 +0000 UTC m=+498.348211740" watchObservedRunningTime="2026-07-17 14:57:31.996925672 +0000 UTC m=+498.348819307" Jul 17 14:57:33.977949 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:33.977862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" event={"ID":"cca1bb56-a6ee-446c-be3b-dc3163e5ea6d","Type":"ContainerStarted","Data":"d9bb94a1fd35e79b3c35525e445addcc4adfaa493274b85868aefa08807c3634"} Jul 17 14:57:34.008562 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:34.008501 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56cdb8d648-2drgd" podStartSLOduration=1.8860500820000001 podStartE2EDuration="4.008484974s" totalImagesPullingTime="2.122434892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:34.007314493 +0000 UTC m=+500.359208124" watchObservedRunningTime="2026-07-17 14:57:34.008484974 +0000 UTC m=+500.360378605" Jul 17 14:57:42.975184 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:42.975153 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9db68d568-lh7h7" Jul 17 14:57:45.347352 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.347321 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv"] Jul 17 14:57:45.350507 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.350489 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.362684 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.362662 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 14:57:45.363169 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.363153 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-j5tv6\"" Jul 17 14:57:45.385129 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.385099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv"] Jul 17 14:57:45.496091 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496091 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04c202c1-2fe4-4ef0-8937-2b444d54db08-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwgkl\" (UniqueName: \"kubernetes.io/projected/04c202c1-2fe4-4ef0-8937-2b444d54db08-kube-api-access-rwgkl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496344 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.496535 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.496402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.596900 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.596857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.596900 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.596905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597092 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.596930 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04c202c1-2fe4-4ef0-8937-2b444d54db08-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597092 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.596962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwgkl\" (UniqueName: \"kubernetes.io/projected/04c202c1-2fe4-4ef0-8937-2b444d54db08-kube-api-access-rwgkl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597092 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597092 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597393 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597563 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597408 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597563 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597487 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597659 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597571 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.597935 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.597918 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04c202c1-2fe4-4ef0-8937-2b444d54db08-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.598263 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.598239 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.599538 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.599513 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.599777 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.599755 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.620776 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.620747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04c202c1-2fe4-4ef0-8937-2b444d54db08-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.621813 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.621791 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwgkl\" (UniqueName: \"kubernetes.io/projected/04c202c1-2fe4-4ef0-8937-2b444d54db08-kube-api-access-rwgkl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sldrv\" (UID: \"04c202c1-2fe4-4ef0-8937-2b444d54db08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.660927 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.660895 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:45.814840 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:45.814816 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv"] Jul 17 14:57:45.816514 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:57:45.816480 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c202c1_2fe4_4ef0_8937_2b444d54db08.slice/crio-3d7aa3cc25eb7f99aaad8b3f463b2d2eb6462e7eb6a11aa765bd2aac467403b5 WatchSource:0}: Error finding container 3d7aa3cc25eb7f99aaad8b3f463b2d2eb6462e7eb6a11aa765bd2aac467403b5: Status 404 returned error can't find the container with id 3d7aa3cc25eb7f99aaad8b3f463b2d2eb6462e7eb6a11aa765bd2aac467403b5 Jul 17 14:57:46.025784 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:46.025746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" event={"ID":"04c202c1-2fe4-4ef0-8937-2b444d54db08","Type":"ContainerStarted","Data":"3d7aa3cc25eb7f99aaad8b3f463b2d2eb6462e7eb6a11aa765bd2aac467403b5"} Jul 17 14:57:48.474379 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:48.474341 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 14:57:48.474677 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:48.474423 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 14:57:48.474677 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:48.474455 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 14:57:49.041110 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:49.041035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" event={"ID":"04c202c1-2fe4-4ef0-8937-2b444d54db08","Type":"ContainerStarted","Data":"520c31d102d61132f6a90d012b2fc29278134ff5607c83539ceb0cbed005f493"} Jul 17 14:57:49.117081 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:49.117014 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" podStartSLOduration=1.461608505 podStartE2EDuration="4.116996352s" totalImagesPullingTime="2.655387847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:49.116391293 +0000 UTC m=+515.468284924" watchObservedRunningTime="2026-07-17 14:57:49.116996352 +0000 UTC m=+515.468889983" Jul 17 14:57:49.661640 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:49.661601 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:49.666864 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:49.666827 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:50.045046 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:50.045019 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:57:50.046111 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:57:50.046089 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sldrv" Jul 17 14:59:14.019304 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.019272 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z"] Jul 17 14:59:14.022714 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.022695 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 14:59:14.026863 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.026840 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gkhpr\"" Jul 17 14:59:14.026975 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.026883 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 14:59:14.027876 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.027859 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 14:59:14.045120 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.045093 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z"] Jul 17 14:59:14.085968 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.085937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 14:59:14.086169 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.086043 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 14:59:14.168421 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.168384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rmrw\" (UniqueName: \"kubernetes.io/projected/02bd38f7-0e19-4e51-bacd-6e2f9088fc02-kube-api-access-9rmrw\") pod \"authorino-operator-75cc8d5cb7-6rd8z\" (UID: \"02bd38f7-0e19-4e51-bacd-6e2f9088fc02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 14:59:14.269845 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.269759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rmrw\" (UniqueName: \"kubernetes.io/projected/02bd38f7-0e19-4e51-bacd-6e2f9088fc02-kube-api-access-9rmrw\") pod \"authorino-operator-75cc8d5cb7-6rd8z\" (UID: \"02bd38f7-0e19-4e51-bacd-6e2f9088fc02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 14:59:14.282766 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.282740 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 14:59:14.293028 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.293004 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 14:59:14.302921 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.302890 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rmrw\" (UniqueName: \"kubernetes.io/projected/02bd38f7-0e19-4e51-bacd-6e2f9088fc02-kube-api-access-9rmrw\") pod \"authorino-operator-75cc8d5cb7-6rd8z\" (UID: \"02bd38f7-0e19-4e51-bacd-6e2f9088fc02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 14:59:14.335450 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.335418 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gkhpr\"" Jul 17 14:59:14.342687 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.342668 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 14:59:14.487661 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:14.487629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z"] Jul 17 14:59:14.492022 ip-10-0-139-74 kubenswrapper[2574]: W0717 14:59:14.491994 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bd38f7_0e19_4e51_bacd_6e2f9088fc02.slice/crio-22203953dd57da5a1e2c1d35daa306e3957684de537ba5f1236aabed29014e63 WatchSource:0}: Error finding container 22203953dd57da5a1e2c1d35daa306e3957684de537ba5f1236aabed29014e63: Status 404 returned error can't find the container with id 22203953dd57da5a1e2c1d35daa306e3957684de537ba5f1236aabed29014e63 Jul 17 14:59:15.385057 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:15.385017 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" event={"ID":"02bd38f7-0e19-4e51-bacd-6e2f9088fc02","Type":"ContainerStarted","Data":"22203953dd57da5a1e2c1d35daa306e3957684de537ba5f1236aabed29014e63"} Jul 17 14:59:17.402825 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:17.402790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" event={"ID":"02bd38f7-0e19-4e51-bacd-6e2f9088fc02","Type":"ContainerStarted","Data":"7608e1d3ba491be8a15dfb0b3ff176611cd84f19ef2c207ef7398c47cadb1277"} Jul 17 14:59:17.403241 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:17.402944 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 14:59:17.423132 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:17.423069 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" podStartSLOduration=2.259575474 podStartE2EDuration="4.423051606s" totalImagesPullingTime="2.163476132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:59:17.422516239 +0000 UTC m=+603.774409882" watchObservedRunningTime="2026-07-17 14:59:17.423051606 +0000 UTC m=+603.774945294" Jul 17 14:59:28.410651 ip-10-0-139-74 kubenswrapper[2574]: I0717 14:59:28.410620 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rd8z" Jul 17 15:00:10.104931 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.104896 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb"] Jul 17 15:00:10.108285 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.108269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.111584 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.111564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nxlgj\"" Jul 17 15:00:10.127118 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.127092 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb"] Jul 17 15:00:10.258388 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258568 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b223b28-7819-4143-8068-810636109d8b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258568 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258568 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258568 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b223b28-7819-4143-8068-810636109d8b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258568 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94ddz\" (UniqueName: \"kubernetes.io/projected/7b223b28-7819-4143-8068-810636109d8b-kube-api-access-94ddz\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258817 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b223b28-7819-4143-8068-810636109d8b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258817 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.258817 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.258690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359596 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359596 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359596 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b223b28-7819-4143-8068-810636109d8b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b223b28-7819-4143-8068-810636109d8b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ddz\" (UniqueName: \"kubernetes.io/projected/7b223b28-7819-4143-8068-810636109d8b-kube-api-access-94ddz\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.359883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b223b28-7819-4143-8068-810636109d8b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.360210 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.359971 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.360210 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.360001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.360210 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.360129 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.360364 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.360234 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.360560 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.360541 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b223b28-7819-4143-8068-810636109d8b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.362044 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.362014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b223b28-7819-4143-8068-810636109d8b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.362446 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.362423 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b223b28-7819-4143-8068-810636109d8b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.372636 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.372612 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94ddz\" (UniqueName: \"kubernetes.io/projected/7b223b28-7819-4143-8068-810636109d8b-kube-api-access-94ddz\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.372789 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.372768 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b223b28-7819-4143-8068-810636109d8b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-75fdb\" (UID: \"7b223b28-7819-4143-8068-810636109d8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.418053 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.418015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:10.565991 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.565959 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb"] Jul 17 15:00:10.570682 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:00:10.570655 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b223b28_7819_4143_8068_810636109d8b.slice/crio-124738a7ce533c83d31540e914485888f2655a12718298aafa0e1d585f20627e WatchSource:0}: Error finding container 124738a7ce533c83d31540e914485888f2655a12718298aafa0e1d585f20627e: Status 404 returned error can't find the container with id 124738a7ce533c83d31540e914485888f2655a12718298aafa0e1d585f20627e Jul 17 15:00:10.572651 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.572622 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:00:10.572714 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.572689 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:00:10.572750 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.572716 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:00:10.621808 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:10.621782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" event={"ID":"7b223b28-7819-4143-8068-810636109d8b","Type":"ContainerStarted","Data":"124738a7ce533c83d31540e914485888f2655a12718298aafa0e1d585f20627e"} Jul 17 15:00:11.627370 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:11.627338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" event={"ID":"7b223b28-7819-4143-8068-810636109d8b","Type":"ContainerStarted","Data":"2b234b99e0c3981a1a4c266c0bee738c16a453851eecea45df17ce729c41a525"} Jul 17 15:00:11.661597 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:11.661548 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podStartSLOduration=1.6615322049999999 podStartE2EDuration="1.661532205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:00:11.661156804 +0000 UTC m=+658.013050436" watchObservedRunningTime="2026-07-17 15:00:11.661532205 +0000 UTC m=+658.013425836" Jul 17 15:00:12.418832 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:12.418793 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:12.423586 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:12.423562 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:12.631499 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:12.631470 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:12.632547 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:12.632517 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:00:13.678229 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.678178 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z8btz"] Jul 17 15:00:13.681706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.681687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:13.686223 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.686177 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z5dcn\"" Jul 17 15:00:13.691518 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.691492 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8btz"] Jul 17 15:00:13.790613 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.790573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcr8c\" (UniqueName: \"kubernetes.io/projected/a91ee764-ff67-4188-a571-24053a167b1a-kube-api-access-dcr8c\") pod \"authorino-58cd955675-z8btz\" (UID: \"a91ee764-ff67-4188-a571-24053a167b1a\") " pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:13.891546 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.891509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcr8c\" (UniqueName: \"kubernetes.io/projected/a91ee764-ff67-4188-a571-24053a167b1a-kube-api-access-dcr8c\") pod \"authorino-58cd955675-z8btz\" (UID: \"a91ee764-ff67-4188-a571-24053a167b1a\") " pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:13.901395 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:13.901371 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcr8c\" (UniqueName: \"kubernetes.io/projected/a91ee764-ff67-4188-a571-24053a167b1a-kube-api-access-dcr8c\") pod \"authorino-58cd955675-z8btz\" (UID: \"a91ee764-ff67-4188-a571-24053a167b1a\") " pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:14.002454 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:14.002354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:14.144700 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:14.144676 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8btz"] Jul 17 15:00:14.147140 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:00:14.147101 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda91ee764_ff67_4188_a571_24053a167b1a.slice/crio-f77ee50059a3e2ec0f3d2deaec1e36b296c6897a53a84682bcbf194eb8092743 WatchSource:0}: Error finding container f77ee50059a3e2ec0f3d2deaec1e36b296c6897a53a84682bcbf194eb8092743: Status 404 returned error can't find the container with id f77ee50059a3e2ec0f3d2deaec1e36b296c6897a53a84682bcbf194eb8092743 Jul 17 15:00:14.640257 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:14.640220 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8btz" event={"ID":"a91ee764-ff67-4188-a571-24053a167b1a","Type":"ContainerStarted","Data":"f77ee50059a3e2ec0f3d2deaec1e36b296c6897a53a84682bcbf194eb8092743"} Jul 17 15:00:18.663350 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:18.663315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8btz" event={"ID":"a91ee764-ff67-4188-a571-24053a167b1a","Type":"ContainerStarted","Data":"6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d"} Jul 17 15:00:18.682918 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:18.682865 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z8btz" podStartSLOduration=2.072604108 podStartE2EDuration="5.682846153s" totalImagesPullingTime="3.610242045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:00:18.682053339 +0000 UTC m=+665.033946971" watchObservedRunningTime="2026-07-17 15:00:18.682846153 +0000 UTC m=+665.034739784" Jul 17 15:00:19.688047 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:19.688012 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8btz"] Jul 17 15:00:20.672300 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:20.672255 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z8btz" podUID="a91ee764-ff67-4188-a571-24053a167b1a" containerName="authorino" containerID="cri-o://6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d" gracePeriod=30 Jul 17 15:00:20.927588 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:20.927527 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:20.958428 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:20.958393 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcr8c\" (UniqueName: \"kubernetes.io/projected/a91ee764-ff67-4188-a571-24053a167b1a-kube-api-access-dcr8c\") pod \"a91ee764-ff67-4188-a571-24053a167b1a\" (UID: \"a91ee764-ff67-4188-a571-24053a167b1a\") " Jul 17 15:00:20.960874 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:20.960846 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91ee764-ff67-4188-a571-24053a167b1a-kube-api-access-dcr8c" (OuterVolumeSpecName: "kube-api-access-dcr8c") pod "a91ee764-ff67-4188-a571-24053a167b1a" (UID: "a91ee764-ff67-4188-a571-24053a167b1a"). InnerVolumeSpecName "kube-api-access-dcr8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:00:21.059350 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.059295 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcr8c\" (UniqueName: \"kubernetes.io/projected/a91ee764-ff67-4188-a571-24053a167b1a-kube-api-access-dcr8c\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:00:21.677774 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.677737 2574 generic.go:356] "Generic (PLEG): container finished" podID="a91ee764-ff67-4188-a571-24053a167b1a" containerID="6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d" exitCode=0 Jul 17 15:00:21.677774 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.677777 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8btz" Jul 17 15:00:21.677984 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.677818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8btz" event={"ID":"a91ee764-ff67-4188-a571-24053a167b1a","Type":"ContainerDied","Data":"6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d"} Jul 17 15:00:21.677984 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.677855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8btz" event={"ID":"a91ee764-ff67-4188-a571-24053a167b1a","Type":"ContainerDied","Data":"f77ee50059a3e2ec0f3d2deaec1e36b296c6897a53a84682bcbf194eb8092743"} Jul 17 15:00:21.677984 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.677873 2574 scope.go:117] "RemoveContainer" containerID="6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d" Jul 17 15:00:21.686616 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.686595 2574 scope.go:117] "RemoveContainer" containerID="6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d" Jul 17 15:00:21.686883 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:00:21.686862 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d\": container with ID starting with 6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d not found: ID does not exist" containerID="6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d" Jul 17 15:00:21.686944 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.686894 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d"} err="failed to get container status \"6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d\": rpc error: code = NotFound desc = could not find container \"6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d\": container with ID starting with 6e87c4921fb8bc1c7573064ae0b0ccb3769d9dbd93ebd37dd04da65feb59f86d not found: ID does not exist" Jul 17 15:00:21.701065 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.701033 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8btz"] Jul 17 15:00:21.708409 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:21.708381 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8btz"] Jul 17 15:00:22.164906 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:00:22.164873 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a91ee764-ff67-4188-a571-24053a167b1a" path="/var/lib/kubelet/pods/a91ee764-ff67-4188-a571-24053a167b1a/volumes" Jul 17 15:01:31.982970 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:31.982935 2574 generic.go:356] "Generic (PLEG): container finished" podID="7b223b28-7819-4143-8068-810636109d8b" containerID="2b234b99e0c3981a1a4c266c0bee738c16a453851eecea45df17ce729c41a525" exitCode=0 Jul 17 15:01:31.983403 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:31.983010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" event={"ID":"7b223b28-7819-4143-8068-810636109d8b","Type":"ContainerDied","Data":"2b234b99e0c3981a1a4c266c0bee738c16a453851eecea45df17ce729c41a525"} Jul 17 15:01:31.983447 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:31.983433 2574 scope.go:117] "RemoveContainer" containerID="2b234b99e0c3981a1a4c266c0bee738c16a453851eecea45df17ce729c41a525" Jul 17 15:01:31.984429 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:31.984405 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:01:31.984509 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:31.984470 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:01:31.984546 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:31.984512 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:01:32.989591 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:32.989551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" event={"ID":"7b223b28-7819-4143-8068-810636109d8b","Type":"ContainerStarted","Data":"d179f761d30a4d0ccce57cba73e39a05b9c4016aa01ef8718c17eab528110f5a"} Jul 17 15:01:33.418644 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:33.418599 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:01:33.418846 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:33.418825 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-75fdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 17 15:01:33.418899 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:33.418870 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podUID="7b223b28-7819-4143-8068-810636109d8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 17 15:01:34.419266 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:34.419234 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-75fdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 17 15:01:34.419646 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:34.419304 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podUID="7b223b28-7819-4143-8068-810636109d8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 17 15:01:35.419544 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:35.419507 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-75fdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 17 15:01:35.420135 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:35.420103 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podUID="7b223b28-7819-4143-8068-810636109d8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 17 15:01:36.418721 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:36.418682 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-75fdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 17 15:01:36.419096 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:36.419054 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podUID="7b223b28-7819-4143-8068-810636109d8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 17 15:01:37.418823 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:37.418783 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-75fdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 17 15:01:37.419481 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:37.419437 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podUID="7b223b28-7819-4143-8068-810636109d8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 17 15:01:38.419121 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:38.419079 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-75fdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 17 15:01:38.419768 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:38.419732 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" podUID="7b223b28-7819-4143-8068-810636109d8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 17 15:01:39.422643 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:39.422610 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:01:39.423028 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:39.422939 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:01:39.423721 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:01:39.423703 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-75fdb" Jul 17 15:02:23.991371 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.991334 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk"] Jul 17 15:02:23.991980 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.991844 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91ee764-ff67-4188-a571-24053a167b1a" containerName="authorino" Jul 17 15:02:23.991980 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.991863 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91ee764-ff67-4188-a571-24053a167b1a" containerName="authorino" Jul 17 15:02:23.991980 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.991941 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91ee764-ff67-4188-a571-24053a167b1a" containerName="authorino" Jul 17 15:02:23.994048 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.994028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:23.998123 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.998100 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 15:02:23.999336 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.999314 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 15:02:23.999336 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.999321 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 15:02:23.999511 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:23.999356 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qmdn8\"" Jul 17 15:02:24.006714 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.006691 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk"] Jul 17 15:02:24.151496 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.151458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.151696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.151534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.151696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.151565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9kn\" (UniqueName: \"kubernetes.io/projected/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-kube-api-access-4b9kn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.151696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.151610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.151696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.151675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.151839 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.151704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253104 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253104 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253104 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9kn\" (UniqueName: \"kubernetes.io/projected/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-kube-api-access-4b9kn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253435 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253435 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253435 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253597 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253463 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253597 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.253597 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.253579 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.255559 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.255531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.255776 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.255758 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.264472 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.264445 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9kn\" (UniqueName: \"kubernetes.io/projected/d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb-kube-api-access-4b9kn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzsvk\" (UID: \"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.304362 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.304331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:24.441835 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.441800 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk"] Jul 17 15:02:24.443042 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:02:24.443010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b162c2_6ed3_46eb_9ff9_9ceb3c7dd5eb.slice/crio-ca5f4ee51c4c82bcec511482438640f7b214b143fdc5eb8ce68143f0c8e82467 WatchSource:0}: Error finding container ca5f4ee51c4c82bcec511482438640f7b214b143fdc5eb8ce68143f0c8e82467: Status 404 returned error can't find the container with id ca5f4ee51c4c82bcec511482438640f7b214b143fdc5eb8ce68143f0c8e82467 Jul 17 15:02:24.444390 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:24.444375 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 15:02:25.215426 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:25.215388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" event={"ID":"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb","Type":"ContainerStarted","Data":"ca5f4ee51c4c82bcec511482438640f7b214b143fdc5eb8ce68143f0c8e82467"} Jul 17 15:02:26.221661 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:26.221622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" event={"ID":"d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb","Type":"ContainerStarted","Data":"8a0ae47677e9a82a082024097882b5b5d976cbf520f07ed233de45d444f6a27e"} Jul 17 15:02:26.248324 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:26.248272 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" podStartSLOduration=1.986816991 podStartE2EDuration="3.248257781s" totalImagesPullingTime="1.26144079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:02:26.24814968 +0000 UTC m=+792.600043325" watchObservedRunningTime="2026-07-17 15:02:26.248257781 +0000 UTC m=+792.600151414" Jul 17 15:02:31.299357 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.299326 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s"] Jul 17 15:02:31.302906 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.302889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.319505 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.319476 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 17 15:02:31.338074 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.338051 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s"] Jul 17 15:02:31.419811 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.419777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.419811 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.419819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.420040 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.419846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.420040 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.419897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.420040 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.419960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz866\" (UniqueName: \"kubernetes.io/projected/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-kube-api-access-cz866\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.420040 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.419978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.520582 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.520540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.520582 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.520586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.520803 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.520620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.520803 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.520637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.520803 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.520686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz866\" (UniqueName: \"kubernetes.io/projected/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-kube-api-access-cz866\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.520803 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.520713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.521059 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.521036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.521124 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.521048 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.521124 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.521098 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.523155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.523132 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.523513 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.523489 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.532692 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.532671 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz866\" (UniqueName: \"kubernetes.io/projected/b1ea15d2-6efe-47f8-a9cc-684e26ee4b13-kube-api-access-cz866\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s\" (UID: \"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.613220 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.613111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:31.751385 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:31.751349 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s"] Jul 17 15:02:31.754220 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:02:31.754178 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ea15d2_6efe_47f8_a9cc_684e26ee4b13.slice/crio-e34062a0749c22a510d39eb6aaf8c5db869084cdd5fa388f70f6f4a8f1658df1 WatchSource:0}: Error finding container e34062a0749c22a510d39eb6aaf8c5db869084cdd5fa388f70f6f4a8f1658df1: Status 404 returned error can't find the container with id e34062a0749c22a510d39eb6aaf8c5db869084cdd5fa388f70f6f4a8f1658df1 Jul 17 15:02:32.247817 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:32.247770 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" event={"ID":"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13","Type":"ContainerStarted","Data":"e34062a0749c22a510d39eb6aaf8c5db869084cdd5fa388f70f6f4a8f1658df1"} Jul 17 15:02:34.304884 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:34.304853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:34.305290 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:34.304911 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:34.317910 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:34.317886 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:35.261853 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:35.261818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" event={"ID":"b1ea15d2-6efe-47f8-a9cc-684e26ee4b13","Type":"ContainerStarted","Data":"4ad6b3d43ce50e28810ec53c01fa0b024719c2d8f3583011ec16f04942265582"} Jul 17 15:02:35.273643 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:35.273618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzsvk" Jul 17 15:02:35.287733 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:35.287683 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" podStartSLOduration=1.548286584 podStartE2EDuration="4.287667665s" totalImagesPullingTime="2.739381081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:02:35.286112383 +0000 UTC m=+801.638006037" watchObservedRunningTime="2026-07-17 15:02:35.287667665 +0000 UTC m=+801.639561296" Jul 17 15:02:41.613772 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:41.613731 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:41.614168 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:41.613820 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:41.626521 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:41.626493 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:02:42.304280 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:02:42.304251 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s" Jul 17 15:03:00.786365 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.786333 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n"] Jul 17 15:03:00.792886 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.792862 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.796027 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.796006 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 17 15:03:00.801289 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.801268 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n"] Jul 17 15:03:00.889558 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.889523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.889736 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.889576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.889736 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.889643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmq46\" (UniqueName: \"kubernetes.io/projected/d77d787e-bd7c-4167-a734-ca6418c7dbff-kube-api-access-fmq46\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.889736 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.889668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.889736 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.889714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77d787e-bd7c-4167-a734-ca6418c7dbff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.889883 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.889780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991137 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77d787e-bd7c-4167-a734-ca6418c7dbff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991346 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991346 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991346 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991346 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmq46\" (UniqueName: \"kubernetes.io/projected/d77d787e-bd7c-4167-a734-ca6418c7dbff-kube-api-access-fmq46\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991346 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991691 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991756 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991732 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.991799 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.991759 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.993726 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.993706 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d77d787e-bd7c-4167-a734-ca6418c7dbff-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:00.993981 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:00.993962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77d787e-bd7c-4167-a734-ca6418c7dbff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:01.003102 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:01.003077 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmq46\" (UniqueName: \"kubernetes.io/projected/d77d787e-bd7c-4167-a734-ca6418c7dbff-kube-api-access-fmq46\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n\" (UID: \"d77d787e-bd7c-4167-a734-ca6418c7dbff\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:01.111465 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:01.111379 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:01.256898 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:01.256754 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n"] Jul 17 15:03:01.259608 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:03:01.259574 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd77d787e_bd7c_4167_a734_ca6418c7dbff.slice/crio-3a1d8caf20b0d0a5f66f4d06c09efbdba67a10243515ba54c3ff283bdaadcc20 WatchSource:0}: Error finding container 3a1d8caf20b0d0a5f66f4d06c09efbdba67a10243515ba54c3ff283bdaadcc20: Status 404 returned error can't find the container with id 3a1d8caf20b0d0a5f66f4d06c09efbdba67a10243515ba54c3ff283bdaadcc20 Jul 17 15:03:01.377642 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:01.377545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" event={"ID":"d77d787e-bd7c-4167-a734-ca6418c7dbff","Type":"ContainerStarted","Data":"3a1d8caf20b0d0a5f66f4d06c09efbdba67a10243515ba54c3ff283bdaadcc20"} Jul 17 15:03:02.383353 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:02.383302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" event={"ID":"d77d787e-bd7c-4167-a734-ca6418c7dbff","Type":"ContainerStarted","Data":"ed6278cdb17a6e1a35fe72ca2cd4186426e4b3c8f6d536756ee576e75c8e6f05"} Jul 17 15:03:02.412877 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:02.412824 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" podStartSLOduration=2.155590765 podStartE2EDuration="2.412806273s" totalImagesPullingTime="257.215508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:03:02.410332954 +0000 UTC m=+828.762226586" watchObservedRunningTime="2026-07-17 15:03:02.412806273 +0000 UTC m=+828.764699904" Jul 17 15:03:11.112070 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:11.112035 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:11.112467 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:11.112090 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:11.124642 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:11.124616 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:03:11.434628 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:03:11.434541 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n" Jul 17 15:04:14.115318 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:04:14.115242 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:04:14.115876 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:04:14.115696 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:09:14.141647 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:09:14.141618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:09:14.143740 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:09:14.143718 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:14:14.175389 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:14:14.175361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:14:14.178415 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:14:14.178397 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:18:55.282563 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.281869 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4"] Jul 17 15:18:55.285157 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.285138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.288959 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.288938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8bd9392b-openshift-default-dockercfg-lc2f5\"" Jul 17 15:18:55.363634 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e172cdd-ec18-4046-9bef-39e321dab481-istiod-ca-cert\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.363818 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-certs\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.363818 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-credential-socket\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.363818 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-istio-token\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.363818 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-data\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.363818 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-socket\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.363818 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-envoy\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.364155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qc5b\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-kube-api-access-8qc5b\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.364155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.363918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e172cdd-ec18-4046-9bef-39e321dab481-istio-podinfo\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.371158 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.371113 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4"] Jul 17 15:18:55.465357 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-certs\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465357 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-credential-socket\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465608 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-istio-token\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465608 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-data\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465608 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-socket\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465608 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-envoy\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465608 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qc5b\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-kube-api-access-8qc5b\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465840 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e172cdd-ec18-4046-9bef-39e321dab481-istio-podinfo\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.465840 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e172cdd-ec18-4046-9bef-39e321dab481-istiod-ca-cert\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.466006 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.465845 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-certs\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.466062 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.466006 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-socket\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.466062 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.466051 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-data\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.466166 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.466105 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-credential-socket\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.466540 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.466516 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e172cdd-ec18-4046-9bef-39e321dab481-istiod-ca-cert\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.468216 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.468166 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-envoy\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.468307 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.468291 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e172cdd-ec18-4046-9bef-39e321dab481-istio-podinfo\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.479723 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.479696 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-istio-token\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.481013 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.480996 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qc5b\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-kube-api-access-8qc5b\") pod \"e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.597313 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.597224 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:55.749443 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.749320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4"] Jul 17 15:18:55.752164 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:18:55.752136 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e172cdd_ec18_4046_9bef_39e321dab481.slice/crio-bae27ddddb151500b82c0c3e643b403117b4f88f452338778bea18bcfe28a45e WatchSource:0}: Error finding container bae27ddddb151500b82c0c3e643b403117b4f88f452338778bea18bcfe28a45e: Status 404 returned error can't find the container with id bae27ddddb151500b82c0c3e643b403117b4f88f452338778bea18bcfe28a45e Jul 17 15:18:55.754210 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.754163 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:18:55.754299 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.754264 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:18:55.754343 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:55.754299 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:18:56.633714 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:56.633676 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" event={"ID":"9e172cdd-ec18-4046-9bef-39e321dab481","Type":"ContainerStarted","Data":"b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8"} Jul 17 15:18:56.634081 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:56.633732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" event={"ID":"9e172cdd-ec18-4046-9bef-39e321dab481","Type":"ContainerStarted","Data":"bae27ddddb151500b82c0c3e643b403117b4f88f452338778bea18bcfe28a45e"} Jul 17 15:18:56.780376 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:56.780320 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podStartSLOduration=1.7803005280000002 podStartE2EDuration="1.780300528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:56.758456822 +0000 UTC m=+1783.110350454" watchObservedRunningTime="2026-07-17 15:18:56.780300528 +0000 UTC m=+1783.132194177" Jul 17 15:18:57.598008 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:57.597969 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:57.603124 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:57.603099 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:57.638450 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:57.638407 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:18:57.639648 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:18:57.639617 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:19:10.699801 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:10.699769 2574 generic.go:356] "Generic (PLEG): container finished" podID="9e172cdd-ec18-4046-9bef-39e321dab481" containerID="b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8" exitCode=0 Jul 17 15:19:10.699801 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:10.699808 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" event={"ID":"9e172cdd-ec18-4046-9bef-39e321dab481","Type":"ContainerDied","Data":"b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8"} Jul 17 15:19:10.700370 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:10.700178 2574 scope.go:117] "RemoveContainer" containerID="b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8" Jul 17 15:19:10.701244 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:10.701216 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:19:10.701304 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:10.701286 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:19:10.701349 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:10.701320 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 15:19:11.705901 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:11.705867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" event={"ID":"9e172cdd-ec18-4046-9bef-39e321dab481","Type":"ContainerStarted","Data":"cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3"} Jul 17 15:19:12.597809 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:12.597769 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:19:12.598978 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:12.598945 2574 patch_prober.go:28] interesting pod/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 17 15:19:12.599116 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:12.599009 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 17 15:19:12.638897 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:12.638852 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:19:13.598184 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:13.598151 2574 patch_prober.go:28] interesting pod/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 17 15:19:13.598603 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:13.598244 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 17 15:19:14.202260 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:14.202232 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:19:14.207765 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:14.207743 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:19:14.598624 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:14.598583 2574 patch_prober.go:28] interesting pod/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 17 15:19:14.599081 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:14.598644 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 17 15:19:15.598046 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:15.598011 2574 patch_prober.go:28] interesting pod/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 17 15:19:15.598264 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:15.598071 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 17 15:19:16.601824 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:16.601792 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:19:16.602953 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:19:16.602932 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:21:26.965226 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:26.965163 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4"] Jul 17 15:21:26.966514 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:26.966479 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" containerID="cri-o://cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3" gracePeriod=30 Jul 17 15:21:31.604600 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:31.604564 2574 patch_prober.go:28] interesting pod/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 15:21:31.604988 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:31.604636 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 15:21:32.216539 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.216502 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:21:32.294249 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294217 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e172cdd-ec18-4046-9bef-39e321dab481-istiod-ca-cert\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294521 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294264 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-socket\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294521 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294371 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-certs\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294521 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294432 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-envoy\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294521 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294470 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e172cdd-ec18-4046-9bef-39e321dab481-istio-podinfo\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294521 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294502 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-credential-socket\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294800 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294534 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-istio-token\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294800 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294553 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:21:32.294800 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294560 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qc5b\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-kube-api-access-8qc5b\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294800 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294601 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-data\") pod \"9e172cdd-ec18-4046-9bef-39e321dab481\" (UID: \"9e172cdd-ec18-4046-9bef-39e321dab481\") " Jul 17 15:21:32.294800 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294629 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e172cdd-ec18-4046-9bef-39e321dab481-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:21:32.295076 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294874 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:21:32.295076 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294928 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e172cdd-ec18-4046-9bef-39e321dab481-istiod-ca-cert\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.295076 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.294947 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-socket\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.295481 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.295455 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:21:32.295917 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.295888 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:21:32.297286 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.297259 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:21:32.297395 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.297368 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e172cdd-ec18-4046-9bef-39e321dab481-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 15:21:32.297395 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.297377 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:21:32.297804 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.297781 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-kube-api-access-8qc5b" (OuterVolumeSpecName: "kube-api-access-8qc5b") pod "9e172cdd-ec18-4046-9bef-39e321dab481" (UID: "9e172cdd-ec18-4046-9bef-39e321dab481"). InnerVolumeSpecName "kube-api-access-8qc5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:21:32.350007 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.349971 2574 generic.go:356] "Generic (PLEG): container finished" podID="9e172cdd-ec18-4046-9bef-39e321dab481" containerID="cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3" exitCode=0 Jul 17 15:21:32.350181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.350022 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" Jul 17 15:21:32.350181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.350102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" event={"ID":"9e172cdd-ec18-4046-9bef-39e321dab481","Type":"ContainerDied","Data":"cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3"} Jul 17 15:21:32.350181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.350153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4" event={"ID":"9e172cdd-ec18-4046-9bef-39e321dab481","Type":"ContainerDied","Data":"bae27ddddb151500b82c0c3e643b403117b4f88f452338778bea18bcfe28a45e"} Jul 17 15:21:32.350332 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.350181 2574 scope.go:117] "RemoveContainer" containerID="cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3" Jul 17 15:21:32.360079 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.360035 2574 scope.go:117] "RemoveContainer" containerID="b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8" Jul 17 15:21:32.367979 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.367962 2574 scope.go:117] "RemoveContainer" containerID="cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3" Jul 17 15:21:32.368272 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:21:32.368249 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3\": container with ID starting with cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3 not found: ID does not exist" containerID="cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3" Jul 17 15:21:32.368385 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.368280 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3"} err="failed to get container status \"cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3\": rpc error: code = NotFound desc = could not find container \"cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3\": container with ID starting with cbf57addccdd40c3ad994724df3f66455e0f205093a29323a32f701eb62a49f3 not found: ID does not exist" Jul 17 15:21:32.368385 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.368302 2574 scope.go:117] "RemoveContainer" containerID="b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8" Jul 17 15:21:32.368605 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:21:32.368584 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8\": container with ID starting with b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8 not found: ID does not exist" containerID="b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8" Jul 17 15:21:32.368653 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.368609 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8"} err="failed to get container status \"b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8\": rpc error: code = NotFound desc = could not find container \"b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8\": container with ID starting with b5f426f7c850943c10f7d7dea7f6ef55bab71f0f4e50421bd801d26796b4fea8 not found: ID does not exist" Jul 17 15:21:32.374749 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.374725 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4"] Jul 17 15:21:32.379587 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.379560 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8bd9392b-openshift-default-75768bf5f7-qzsf4"] Jul 17 15:21:32.396361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396334 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-workload-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.396361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396362 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-envoy\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.396550 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396373 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e172cdd-ec18-4046-9bef-39e321dab481-istio-podinfo\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.396550 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396386 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-credential-socket\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.396550 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396399 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-istio-token\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.396550 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396411 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qc5b\" (UniqueName: \"kubernetes.io/projected/9e172cdd-ec18-4046-9bef-39e321dab481-kube-api-access-8qc5b\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:32.396550 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:32.396422 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e172cdd-ec18-4046-9bef-39e321dab481-istio-data\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:21:34.165330 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:21:34.165298 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" path="/var/lib/kubelet/pods/9e172cdd-ec18-4046-9bef-39e321dab481/volumes" Jul 17 15:24:14.229695 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:24:14.229664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:24:14.235236 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:24:14.235220 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:29:14.264031 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:29:14.263913 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:29:14.270080 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:29:14.270051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:31:12.965733 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.965695 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj"] Jul 17 15:31:12.966361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.966245 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" Jul 17 15:31:12.966361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.966264 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" Jul 17 15:31:12.966361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.966277 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" Jul 17 15:31:12.966361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.966286 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" Jul 17 15:31:12.966667 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.966384 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" Jul 17 15:31:12.966667 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.966395 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e172cdd-ec18-4046-9bef-39e321dab481" containerName="istio-proxy" Jul 17 15:31:12.969566 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.969538 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:12.973716 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.973682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a502a35a\"/\"default-dockercfg-2tc5f\"" Jul 17 15:31:12.973849 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.973721 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a502a35a\"/\"openshift-service-ca.crt\"" Jul 17 15:31:12.973849 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.973682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a502a35a\"/\"e2e-lifecycle-model-a502a35a-kserve-self-signed-certs\"" Jul 17 15:31:12.973849 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.973698 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a502a35a\"/\"kube-root-ca.crt\"" Jul 17 15:31:12.979385 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:12.979358 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj"] Jul 17 15:31:13.082534 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.082498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgfbv\" (UniqueName: \"kubernetes.io/projected/1b60a186-01aa-46fd-a62a-88d982433241-kube-api-access-zgfbv\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.082696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.082565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-model-cache\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.082696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.082591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-tmp-dir\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.082696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.082609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-home\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.082803 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.082696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-dshm\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.082803 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.082725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b60a186-01aa-46fd-a62a-88d982433241-tls-certs\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184018 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.183981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-dshm\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184018 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b60a186-01aa-46fd-a62a-88d982433241-tls-certs\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184253 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgfbv\" (UniqueName: \"kubernetes.io/projected/1b60a186-01aa-46fd-a62a-88d982433241-kube-api-access-zgfbv\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184253 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-model-cache\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184253 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-tmp-dir\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184253 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184224 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-home\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184581 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184562 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-model-cache\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184647 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184588 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-tmp-dir\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.184691 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.184643 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-home\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.186555 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.186535 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-dshm\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.186809 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.186791 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b60a186-01aa-46fd-a62a-88d982433241-tls-certs\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.193917 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.193891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgfbv\" (UniqueName: \"kubernetes.io/projected/1b60a186-01aa-46fd-a62a-88d982433241-kube-api-access-zgfbv\") pod \"e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.279499 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.279461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:13.420288 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.420262 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj"] Jul 17 15:31:13.422955 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:31:13.422926 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b60a186_01aa_46fd_a62a_88d982433241.slice/crio-ca7399dedede2a56f9f95642e02346f0e8c121f05c4485e239bba628336a0fe1 WatchSource:0}: Error finding container ca7399dedede2a56f9f95642e02346f0e8c121f05c4485e239bba628336a0fe1: Status 404 returned error can't find the container with id ca7399dedede2a56f9f95642e02346f0e8c121f05c4485e239bba628336a0fe1 Jul 17 15:31:13.979424 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.979385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" event={"ID":"1b60a186-01aa-46fd-a62a-88d982433241","Type":"ContainerStarted","Data":"05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4"} Jul 17 15:31:13.979424 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:13.979427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" event={"ID":"1b60a186-01aa-46fd-a62a-88d982433241","Type":"ContainerStarted","Data":"ca7399dedede2a56f9f95642e02346f0e8c121f05c4485e239bba628336a0fe1"} Jul 17 15:31:14.000481 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:14.000436 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" podStartSLOduration=2.000418063 podStartE2EDuration="2.000418063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:31:13.998346336 +0000 UTC m=+2520.350239969" watchObservedRunningTime="2026-07-17 15:31:14.000418063 +0000 UTC m=+2520.352311694" Jul 17 15:31:23.280460 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:23.280409 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:23.280907 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:23.280486 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:23.293285 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:23.293263 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:31:24.034547 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:31:24.034516 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:32:00.173795 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:00.173758 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj"] Jul 17 15:32:15.195644 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.195578 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" podUID="1b60a186-01aa-46fd-a62a-88d982433241" containerName="main" containerID="cri-o://05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4" gracePeriod=45 Jul 17 15:32:15.451865 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.451797 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:32:15.551975 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.551937 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-dshm\") pod \"1b60a186-01aa-46fd-a62a-88d982433241\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " Jul 17 15:32:15.552154 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552004 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-home\") pod \"1b60a186-01aa-46fd-a62a-88d982433241\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " Jul 17 15:32:15.552154 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-tmp-dir\") pod \"1b60a186-01aa-46fd-a62a-88d982433241\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " Jul 17 15:32:15.552154 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552054 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-model-cache\") pod \"1b60a186-01aa-46fd-a62a-88d982433241\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " Jul 17 15:32:15.552154 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552112 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgfbv\" (UniqueName: \"kubernetes.io/projected/1b60a186-01aa-46fd-a62a-88d982433241-kube-api-access-zgfbv\") pod \"1b60a186-01aa-46fd-a62a-88d982433241\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " Jul 17 15:32:15.552154 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552137 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b60a186-01aa-46fd-a62a-88d982433241-tls-certs\") pod \"1b60a186-01aa-46fd-a62a-88d982433241\" (UID: \"1b60a186-01aa-46fd-a62a-88d982433241\") " Jul 17 15:32:15.552417 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552282 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b60a186-01aa-46fd-a62a-88d982433241" (UID: "1b60a186-01aa-46fd-a62a-88d982433241"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:32:15.552417 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552299 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-home" (OuterVolumeSpecName: "home") pod "1b60a186-01aa-46fd-a62a-88d982433241" (UID: "1b60a186-01aa-46fd-a62a-88d982433241"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:32:15.552493 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552417 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b60a186-01aa-46fd-a62a-88d982433241" (UID: "1b60a186-01aa-46fd-a62a-88d982433241"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:32:15.552581 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552563 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-home\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:32:15.552644 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552584 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-tmp-dir\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:32:15.552644 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.552593 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-model-cache\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:32:15.554432 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.554406 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-dshm" (OuterVolumeSpecName: "dshm") pod "1b60a186-01aa-46fd-a62a-88d982433241" (UID: "1b60a186-01aa-46fd-a62a-88d982433241"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:32:15.554432 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.554406 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b60a186-01aa-46fd-a62a-88d982433241-kube-api-access-zgfbv" (OuterVolumeSpecName: "kube-api-access-zgfbv") pod "1b60a186-01aa-46fd-a62a-88d982433241" (UID: "1b60a186-01aa-46fd-a62a-88d982433241"). InnerVolumeSpecName "kube-api-access-zgfbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:32:15.554596 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.554434 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b60a186-01aa-46fd-a62a-88d982433241-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b60a186-01aa-46fd-a62a-88d982433241" (UID: "1b60a186-01aa-46fd-a62a-88d982433241"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:32:15.653307 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.653265 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b60a186-01aa-46fd-a62a-88d982433241-dshm\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:32:15.653307 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.653300 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgfbv\" (UniqueName: \"kubernetes.io/projected/1b60a186-01aa-46fd-a62a-88d982433241-kube-api-access-zgfbv\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:32:15.653307 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:15.653311 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b60a186-01aa-46fd-a62a-88d982433241-tls-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:32:16.265046 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.265007 2574 generic.go:356] "Generic (PLEG): container finished" podID="1b60a186-01aa-46fd-a62a-88d982433241" containerID="05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4" exitCode=0 Jul 17 15:32:16.265046 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.265050 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" Jul 17 15:32:16.265561 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.265100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" event={"ID":"1b60a186-01aa-46fd-a62a-88d982433241","Type":"ContainerDied","Data":"05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4"} Jul 17 15:32:16.265561 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.265141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj" event={"ID":"1b60a186-01aa-46fd-a62a-88d982433241","Type":"ContainerDied","Data":"ca7399dedede2a56f9f95642e02346f0e8c121f05c4485e239bba628336a0fe1"} Jul 17 15:32:16.265561 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.265158 2574 scope.go:117] "RemoveContainer" containerID="05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4" Jul 17 15:32:16.273777 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.273758 2574 scope.go:117] "RemoveContainer" containerID="05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4" Jul 17 15:32:16.274053 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:32:16.274034 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4\": container with ID starting with 05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4 not found: ID does not exist" containerID="05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4" Jul 17 15:32:16.274110 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.274063 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4"} err="failed to get container status \"05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4\": rpc error: code = NotFound desc = could not find container \"05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4\": container with ID starting with 05b0cf7c3c69d23b3a83fe486cbb291f4b9492752102077343c1d342a1c1fba4 not found: ID does not exist" Jul 17 15:32:16.293705 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.293659 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj"] Jul 17 15:32:16.295433 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:16.295410 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a502a35a/e2e-lifecycle-model-a502a35a-kserve-9c787bf99-42gnj"] Jul 17 15:32:18.164440 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:32:18.164400 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b60a186-01aa-46fd-a62a-88d982433241" path="/var/lib/kubelet/pods/1b60a186-01aa-46fd-a62a-88d982433241/volumes" Jul 17 15:34:14.291388 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:14.291357 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:34:14.297571 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:14.297552 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:34:24.809830 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.809799 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8"] Jul 17 15:34:24.810386 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.810230 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b60a186-01aa-46fd-a62a-88d982433241" containerName="main" Jul 17 15:34:24.810386 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.810244 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b60a186-01aa-46fd-a62a-88d982433241" containerName="main" Jul 17 15:34:24.810386 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.810327 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b60a186-01aa-46fd-a62a-88d982433241" containerName="main" Jul 17 15:34:24.813358 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.813339 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:24.818631 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.818605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c10dc4\"/\"test-model-c10dc4-kserve-self-signed-certs\"" Jul 17 15:34:24.818927 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.818902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c10dc4\"/\"kube-root-ca.crt\"" Jul 17 15:34:24.819061 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.818914 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c10dc4\"/\"default-dockercfg-bt8tl\"" Jul 17 15:34:24.819061 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.818935 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c10dc4\"/\"openshift-service-ca.crt\"" Jul 17 15:34:24.835285 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.835251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8"] Jul 17 15:34:24.932685 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.932645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tmp-dir\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:24.932685 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.932689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-model-cache\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:24.932949 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.932714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tls-certs\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:24.932949 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.932762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-home\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:24.932949 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.932802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttpj\" (UniqueName: \"kubernetes.io/projected/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-kube-api-access-6ttpj\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:24.932949 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:24.932831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-dshm\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.033963 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.033926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tls-certs\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034230 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.033972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-home\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034230 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttpj\" (UniqueName: \"kubernetes.io/projected/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-kube-api-access-6ttpj\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034230 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-dshm\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034230 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tmp-dir\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034230 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-model-cache\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034523 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034461 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-home\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034523 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tmp-dir\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.034621 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.034581 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-model-cache\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.036505 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.036481 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-dshm\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.036677 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.036661 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tls-certs\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.045712 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.045692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttpj\" (UniqueName: \"kubernetes.io/projected/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-kube-api-access-6ttpj\") pod \"test-model-c10dc4-kserve-5c8744d7f9-6qjl8\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.124469 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.124377 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:25.269429 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.269398 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8"] Jul 17 15:34:25.271911 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:34:25.271886 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod482dee0f_ca4f_44f6_8f46_b7c0f49c89e0.slice/crio-1b745615964bfc32453d0d24b3b0c07cbe688c579a205397b3cd4ba3e1ee2fa0 WatchSource:0}: Error finding container 1b745615964bfc32453d0d24b3b0c07cbe688c579a205397b3cd4ba3e1ee2fa0: Status 404 returned error can't find the container with id 1b745615964bfc32453d0d24b3b0c07cbe688c579a205397b3cd4ba3e1ee2fa0 Jul 17 15:34:25.842820 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.842776 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" event={"ID":"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0","Type":"ContainerStarted","Data":"8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1"} Jul 17 15:34:25.842820 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.842825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" event={"ID":"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0","Type":"ContainerStarted","Data":"1b745615964bfc32453d0d24b3b0c07cbe688c579a205397b3cd4ba3e1ee2fa0"} Jul 17 15:34:25.869385 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:25.869333 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" podStartSLOduration=1.869315246 podStartE2EDuration="1.869315246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:34:25.867416353 +0000 UTC m=+2712.219309985" watchObservedRunningTime="2026-07-17 15:34:25.869315246 +0000 UTC m=+2712.221208926" Jul 17 15:34:35.124983 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:35.124943 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:35.125479 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:35.125005 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:35.137220 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:35.137180 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:35.899507 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:35.899472 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:34:50.360386 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:34:50.360350 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8"] Jul 17 15:35:05.380503 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.380465 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" podUID="482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" containerName="main" containerID="cri-o://8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1" gracePeriod=45 Jul 17 15:35:05.634360 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.634295 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:35:05.705509 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705469 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-home\") pod \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " Jul 17 15:35:05.705706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705525 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tmp-dir\") pod \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " Jul 17 15:35:05.705706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705548 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-dshm\") pod \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " Jul 17 15:35:05.705706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705586 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ttpj\" (UniqueName: \"kubernetes.io/projected/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-kube-api-access-6ttpj\") pod \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " Jul 17 15:35:05.705706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705634 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-model-cache\") pod \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " Jul 17 15:35:05.705706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705659 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tls-certs\") pod \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\" (UID: \"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0\") " Jul 17 15:35:05.705941 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705763 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-home" (OuterVolumeSpecName: "home") pod "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" (UID: "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:35:05.705941 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705848 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" (UID: "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:35:05.705941 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.705926 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" (UID: "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:35:05.706054 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.706029 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-home\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:35:05.706054 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.706042 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tmp-dir\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:35:05.706054 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.706052 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-model-cache\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:35:05.707915 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.707890 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-dshm" (OuterVolumeSpecName: "dshm") pod "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" (UID: "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:35:05.708032 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.707977 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-kube-api-access-6ttpj" (OuterVolumeSpecName: "kube-api-access-6ttpj") pod "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" (UID: "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0"). InnerVolumeSpecName "kube-api-access-6ttpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:35:05.708032 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.708021 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" (UID: "482dee0f-ca4f-44f6-8f46-b7c0f49c89e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:35:05.806951 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.806913 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-dshm\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:35:05.806951 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.806947 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ttpj\" (UniqueName: \"kubernetes.io/projected/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-kube-api-access-6ttpj\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:35:05.807162 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:05.806958 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0-tls-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:35:06.027215 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.027166 2574 generic.go:356] "Generic (PLEG): container finished" podID="482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" containerID="8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1" exitCode=0 Jul 17 15:35:06.027375 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.027227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" event={"ID":"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0","Type":"ContainerDied","Data":"8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1"} Jul 17 15:35:06.027375 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.027256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" event={"ID":"482dee0f-ca4f-44f6-8f46-b7c0f49c89e0","Type":"ContainerDied","Data":"1b745615964bfc32453d0d24b3b0c07cbe688c579a205397b3cd4ba3e1ee2fa0"} Jul 17 15:35:06.027375 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.027274 2574 scope.go:117] "RemoveContainer" containerID="8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1" Jul 17 15:35:06.027375 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.027229 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8" Jul 17 15:35:06.038370 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.038348 2574 scope.go:117] "RemoveContainer" containerID="8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1" Jul 17 15:35:06.038742 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:35:06.038716 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1\": container with ID starting with 8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1 not found: ID does not exist" containerID="8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1" Jul 17 15:35:06.038844 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.038755 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1"} err="failed to get container status \"8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1\": rpc error: code = NotFound desc = could not find container \"8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1\": container with ID starting with 8af3f703cdfa2fc870e8324137f28a783fd30abf18929776d3a38fc4f399a4c1 not found: ID does not exist" Jul 17 15:35:06.049936 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.049896 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8"] Jul 17 15:35:06.055762 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.055739 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c10dc4/test-model-c10dc4-kserve-5c8744d7f9-6qjl8"] Jul 17 15:35:06.164715 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:35:06.164681 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" path="/var/lib/kubelet/pods/482dee0f-ca4f-44f6-8f46-b7c0f49c89e0/volumes" Jul 17 15:37:42.794616 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.794577 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6"] Jul 17 15:37:42.795079 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.795001 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" containerName="main" Jul 17 15:37:42.795079 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.795015 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" containerName="main" Jul 17 15:37:42.795154 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.795082 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="482dee0f-ca4f-44f6-8f46-b7c0f49c89e0" containerName="main" Jul 17 15:37:42.798166 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.798151 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.801708 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.801685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"kube-root-ca.crt\"" Jul 17 15:37:42.802099 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.802077 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"default-dockercfg-7th9q\"" Jul 17 15:37:42.802226 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.802126 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"auth-test-model-ae3cc1-kserve-self-signed-certs\"" Jul 17 15:37:42.802226 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.802077 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"openshift-service-ca.crt\"" Jul 17 15:37:42.809295 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.809272 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6"] Jul 17 15:37:42.816830 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.816807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-model-cache\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.816937 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.816837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-dshm\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.816937 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.816859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-home\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.817059 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.816968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tls-certs\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.817059 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.817027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbjlb\" (UniqueName: \"kubernetes.io/projected/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-kube-api-access-gbjlb\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.817164 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.817060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tmp-dir\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918487 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-dshm\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918487 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-home\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918705 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tls-certs\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918705 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbjlb\" (UniqueName: \"kubernetes.io/projected/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-kube-api-access-gbjlb\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918705 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tmp-dir\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918814 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-model-cache\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.918922 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.918901 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-home\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.919052 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.919028 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tmp-dir\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.919115 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.919077 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-model-cache\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.920894 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.920874 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-dshm\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.921206 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.921178 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tls-certs\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:42.930369 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:42.930350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbjlb\" (UniqueName: \"kubernetes.io/projected/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-kube-api-access-gbjlb\") pod \"auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:43.106920 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:43.106819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:43.245754 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:43.245721 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6"] Jul 17 15:37:43.248951 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:37:43.248914 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27572cc6_a6e8_4b9b_9ae0_fd68322c017a.slice/crio-6d8bb4ef35f6c9fa3fe9986e5dc4ab768730ff0eb1690577bee10e01caa535a9 WatchSource:0}: Error finding container 6d8bb4ef35f6c9fa3fe9986e5dc4ab768730ff0eb1690577bee10e01caa535a9: Status 404 returned error can't find the container with id 6d8bb4ef35f6c9fa3fe9986e5dc4ab768730ff0eb1690577bee10e01caa535a9 Jul 17 15:37:43.751634 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:43.751596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" event={"ID":"27572cc6-a6e8-4b9b-9ae0-fd68322c017a","Type":"ContainerStarted","Data":"5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd"} Jul 17 15:37:43.751634 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:43.751636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" event={"ID":"27572cc6-a6e8-4b9b-9ae0-fd68322c017a","Type":"ContainerStarted","Data":"6d8bb4ef35f6c9fa3fe9986e5dc4ab768730ff0eb1690577bee10e01caa535a9"} Jul 17 15:37:43.773479 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:43.773425 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" podStartSLOduration=1.77340987 podStartE2EDuration="1.77340987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:37:43.772582256 +0000 UTC m=+2910.124475889" watchObservedRunningTime="2026-07-17 15:37:43.77340987 +0000 UTC m=+2910.125303502" Jul 17 15:37:53.107876 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:53.107840 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:53.107876 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:53.107884 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:53.120605 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:53.120575 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:37:53.808617 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:37:53.808589 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:39:14.321017 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:39:14.320906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:39:14.327600 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:39:14.327581 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:39:59.569904 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:39:59.569860 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6"] Jul 17 15:40:13.790314 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.790274 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk"] Jul 17 15:40:13.793605 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.793585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.796451 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.796428 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c4e0c6\"/\"kube-root-ca.crt\"" Jul 17 15:40:13.797549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.797528 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c4e0c6\"/\"openshift-service-ca.crt\"" Jul 17 15:40:13.797634 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.797542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4e0c6\"/\"sub-test-model-c4e0c6-kserve-self-signed-certs\"" Jul 17 15:40:13.797972 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.797949 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4e0c6\"/\"default-dockercfg-m4h8n\"" Jul 17 15:40:13.803747 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.803718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk"] Jul 17 15:40:13.897360 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.897323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-model-cache\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.897534 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.897368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-dshm\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.897534 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.897433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bb1f50-a546-4c93-8478-5562edf27e9f-tls-certs\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.897534 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.897460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-home\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.897643 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.897531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjmg\" (UniqueName: \"kubernetes.io/projected/d8bb1f50-a546-4c93-8478-5562edf27e9f-kube-api-access-6bjmg\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.897643 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.897572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-tmp-dir\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.998671 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.998639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-model-cache\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.998882 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.998683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-dshm\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.998882 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.998749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bb1f50-a546-4c93-8478-5562edf27e9f-tls-certs\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.998882 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.998784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-home\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.998882 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.998827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjmg\" (UniqueName: \"kubernetes.io/projected/d8bb1f50-a546-4c93-8478-5562edf27e9f-kube-api-access-6bjmg\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.998882 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.998866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-tmp-dir\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.999155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.999106 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-model-cache\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.999291 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.999267 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-home\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:13.999331 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:13.999277 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-tmp-dir\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:14.001252 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.001230 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-dshm\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:14.001526 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.001507 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bb1f50-a546-4c93-8478-5562edf27e9f-tls-certs\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:14.009013 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.008994 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjmg\" (UniqueName: \"kubernetes.io/projected/d8bb1f50-a546-4c93-8478-5562edf27e9f-kube-api-access-6bjmg\") pod \"sub-test-model-c4e0c6-kserve-f66959f69-qxxkk\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:14.107024 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.106944 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4e0c6\"/\"default-dockercfg-m4h8n\"" Jul 17 15:40:14.114561 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.114536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:14.253228 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.253186 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk"] Jul 17 15:40:14.255990 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:40:14.255962 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8bb1f50_a546_4c93_8478_5562edf27e9f.slice/crio-1fea4b2c11485fce1d2c3c3d639dfa3494836de8530fd08882965e14b1e94a98 WatchSource:0}: Error finding container 1fea4b2c11485fce1d2c3c3d639dfa3494836de8530fd08882965e14b1e94a98: Status 404 returned error can't find the container with id 1fea4b2c11485fce1d2c3c3d639dfa3494836de8530fd08882965e14b1e94a98 Jul 17 15:40:14.431723 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.431622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" event={"ID":"d8bb1f50-a546-4c93-8478-5562edf27e9f","Type":"ContainerStarted","Data":"3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768"} Jul 17 15:40:14.431723 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.431666 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" event={"ID":"d8bb1f50-a546-4c93-8478-5562edf27e9f","Type":"ContainerStarted","Data":"1fea4b2c11485fce1d2c3c3d639dfa3494836de8530fd08882965e14b1e94a98"} Jul 17 15:40:14.453368 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.453313 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" podStartSLOduration=1.453297115 podStartE2EDuration="1.453297115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:40:14.452438473 +0000 UTC m=+3060.804332105" watchObservedRunningTime="2026-07-17 15:40:14.453297115 +0000 UTC m=+3060.805190746" Jul 17 15:40:14.590694 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.590645 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" podUID="27572cc6-a6e8-4b9b-9ae0-fd68322c017a" containerName="main" containerID="cri-o://5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd" gracePeriod=45 Jul 17 15:40:14.832677 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.832640 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:40:14.906982 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.906951 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbjlb\" (UniqueName: \"kubernetes.io/projected/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-kube-api-access-gbjlb\") pod \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " Jul 17 15:40:14.907181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907007 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-model-cache\") pod \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " Jul 17 15:40:14.907181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907028 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tmp-dir\") pod \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " Jul 17 15:40:14.907181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907075 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-home\") pod \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " Jul 17 15:40:14.907181 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907162 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tls-certs\") pod \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " Jul 17 15:40:14.907444 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907236 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-dshm\") pod \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\" (UID: \"27572cc6-a6e8-4b9b-9ae0-fd68322c017a\") " Jul 17 15:40:14.907444 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907324 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-model-cache" (OuterVolumeSpecName: "model-cache") pod "27572cc6-a6e8-4b9b-9ae0-fd68322c017a" (UID: "27572cc6-a6e8-4b9b-9ae0-fd68322c017a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:40:14.907444 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907394 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-home" (OuterVolumeSpecName: "home") pod "27572cc6-a6e8-4b9b-9ae0-fd68322c017a" (UID: "27572cc6-a6e8-4b9b-9ae0-fd68322c017a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:40:14.907444 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907408 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27572cc6-a6e8-4b9b-9ae0-fd68322c017a" (UID: "27572cc6-a6e8-4b9b-9ae0-fd68322c017a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:40:14.907626 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907610 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-model-cache\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:40:14.907675 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907630 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tmp-dir\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:40:14.907675 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.907640 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-home\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:40:14.910034 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.910001 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-dshm" (OuterVolumeSpecName: "dshm") pod "27572cc6-a6e8-4b9b-9ae0-fd68322c017a" (UID: "27572cc6-a6e8-4b9b-9ae0-fd68322c017a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:40:14.910034 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.910017 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-kube-api-access-gbjlb" (OuterVolumeSpecName: "kube-api-access-gbjlb") pod "27572cc6-a6e8-4b9b-9ae0-fd68322c017a" (UID: "27572cc6-a6e8-4b9b-9ae0-fd68322c017a"). InnerVolumeSpecName "kube-api-access-gbjlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:40:14.910034 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:14.910001 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27572cc6-a6e8-4b9b-9ae0-fd68322c017a" (UID: "27572cc6-a6e8-4b9b-9ae0-fd68322c017a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:40:15.009077 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.009044 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-tls-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:40:15.009077 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.009077 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-dshm\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:40:15.009315 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.009092 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbjlb\" (UniqueName: \"kubernetes.io/projected/27572cc6-a6e8-4b9b-9ae0-fd68322c017a-kube-api-access-gbjlb\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:40:15.439070 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.439036 2574 generic.go:356] "Generic (PLEG): container finished" podID="27572cc6-a6e8-4b9b-9ae0-fd68322c017a" containerID="5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd" exitCode=0 Jul 17 15:40:15.439273 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.439082 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" Jul 17 15:40:15.439273 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.439118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" event={"ID":"27572cc6-a6e8-4b9b-9ae0-fd68322c017a","Type":"ContainerDied","Data":"5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd"} Jul 17 15:40:15.439273 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.439164 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6" event={"ID":"27572cc6-a6e8-4b9b-9ae0-fd68322c017a","Type":"ContainerDied","Data":"6d8bb4ef35f6c9fa3fe9986e5dc4ab768730ff0eb1690577bee10e01caa535a9"} Jul 17 15:40:15.439273 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.439182 2574 scope.go:117] "RemoveContainer" containerID="5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd" Jul 17 15:40:15.448313 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.448293 2574 scope.go:117] "RemoveContainer" containerID="5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd" Jul 17 15:40:15.448579 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:40:15.448560 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd\": container with ID starting with 5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd not found: ID does not exist" containerID="5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd" Jul 17 15:40:15.448627 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.448589 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd"} err="failed to get container status \"5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd\": rpc error: code = NotFound desc = could not find container \"5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd\": container with ID starting with 5b6ad75450688c525cea14b3c744b891d8ad1f79130e7d3a30716bae9956e1bd not found: ID does not exist" Jul 17 15:40:15.461310 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.461281 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6"] Jul 17 15:40:15.465682 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:15.465662 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/auth-test-model-ae3cc1-kserve-7658f9bfc5-dm5q6"] Jul 17 15:40:16.164963 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:16.164920 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27572cc6-a6e8-4b9b-9ae0-fd68322c017a" path="/var/lib/kubelet/pods/27572cc6-a6e8-4b9b-9ae0-fd68322c017a/volumes" Jul 17 15:40:24.115728 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:24.115687 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:24.116135 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:24.115747 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:24.128568 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:24.128541 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:24.492513 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:24.492407 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:40:30.378615 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.378537 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m"] Jul 17 15:40:30.379147 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.379048 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27572cc6-a6e8-4b9b-9ae0-fd68322c017a" containerName="main" Jul 17 15:40:30.379147 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.379066 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="27572cc6-a6e8-4b9b-9ae0-fd68322c017a" containerName="main" Jul 17 15:40:30.379302 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.379178 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="27572cc6-a6e8-4b9b-9ae0-fd68322c017a" containerName="main" Jul 17 15:40:30.382081 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.382061 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.385183 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.385162 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"openshift-service-ca.crt\"" Jul 17 15:40:30.385316 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.385262 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"kube-root-ca.crt\"" Jul 17 15:40:30.386505 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.386483 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"sub-test-model-ae3cc1-kserve-self-signed-certs\"" Jul 17 15:40:30.386607 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.386520 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"default-dockercfg-7th9q\"" Jul 17 15:40:30.392704 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.392681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m"] Jul 17 15:40:30.554003 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.553972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tmp-dir\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.554292 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.554014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-home\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.554292 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.554034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-model-cache\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.554292 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.554121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tls-certs\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.554292 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.554157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-dshm\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.554292 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.554238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wjz\" (UniqueName: \"kubernetes.io/projected/736f2268-f5f5-439b-8d44-a1b9f1aa0101-kube-api-access-t9wjz\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.655614 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.655523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tls-certs\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.655614 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.655568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-dshm\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.655614 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.655602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wjz\" (UniqueName: \"kubernetes.io/projected/736f2268-f5f5-439b-8d44-a1b9f1aa0101-kube-api-access-t9wjz\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.655881 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.655648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tmp-dir\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.655881 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.655680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-home\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.655881 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.655703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-model-cache\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.656111 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.656085 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-home\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.656214 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.656108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-model-cache\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.656214 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.656160 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tmp-dir\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.658063 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.658044 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-dshm\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.658158 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.658140 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tls-certs\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.665860 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.665837 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wjz\" (UniqueName: \"kubernetes.io/projected/736f2268-f5f5-439b-8d44-a1b9f1aa0101-kube-api-access-t9wjz\") pod \"sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.692867 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.692834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:30.832087 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:30.832047 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m"] Jul 17 15:40:30.835721 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:40:30.835694 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod736f2268_f5f5_439b_8d44_a1b9f1aa0101.slice/crio-d6dbfe667f37ce1f3e6c488514db6f7072521b937e930f89a88bf684c75a4f7c WatchSource:0}: Error finding container d6dbfe667f37ce1f3e6c488514db6f7072521b937e930f89a88bf684c75a4f7c: Status 404 returned error can't find the container with id d6dbfe667f37ce1f3e6c488514db6f7072521b937e930f89a88bf684c75a4f7c Jul 17 15:40:31.514079 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:31.514036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" event={"ID":"736f2268-f5f5-439b-8d44-a1b9f1aa0101","Type":"ContainerStarted","Data":"acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e"} Jul 17 15:40:31.514523 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:31.514091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" event={"ID":"736f2268-f5f5-439b-8d44-a1b9f1aa0101","Type":"ContainerStarted","Data":"d6dbfe667f37ce1f3e6c488514db6f7072521b937e930f89a88bf684c75a4f7c"} Jul 17 15:40:31.535682 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:31.535627 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" podStartSLOduration=1.535611002 podStartE2EDuration="1.535611002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:40:31.533898932 +0000 UTC m=+3077.885792566" watchObservedRunningTime="2026-07-17 15:40:31.535611002 +0000 UTC m=+3077.887504633" Jul 17 15:40:40.693726 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:40.693680 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:40.693726 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:40.693736 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:40.705908 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:40.705879 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:40:41.571989 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:40:41.571956 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:41:11.887062 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:11.887028 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk"] Jul 17 15:41:12.694923 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:12.694874 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m"] Jul 17 15:41:26.907426 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:26.907349 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" podUID="d8bb1f50-a546-4c93-8478-5562edf27e9f" containerName="main" containerID="cri-o://3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768" gracePeriod=45 Jul 17 15:41:27.159541 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.159473 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:41:27.189229 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189178 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bjmg\" (UniqueName: \"kubernetes.io/projected/d8bb1f50-a546-4c93-8478-5562edf27e9f-kube-api-access-6bjmg\") pod \"d8bb1f50-a546-4c93-8478-5562edf27e9f\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " Jul 17 15:41:27.189405 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-tmp-dir\") pod \"d8bb1f50-a546-4c93-8478-5562edf27e9f\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " Jul 17 15:41:27.189405 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189348 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-model-cache\") pod \"d8bb1f50-a546-4c93-8478-5562edf27e9f\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " Jul 17 15:41:27.189405 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189372 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bb1f50-a546-4c93-8478-5562edf27e9f-tls-certs\") pod \"d8bb1f50-a546-4c93-8478-5562edf27e9f\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " Jul 17 15:41:27.189583 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189418 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-dshm\") pod \"d8bb1f50-a546-4c93-8478-5562edf27e9f\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " Jul 17 15:41:27.189583 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189441 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-home\") pod \"d8bb1f50-a546-4c93-8478-5562edf27e9f\" (UID: \"d8bb1f50-a546-4c93-8478-5562edf27e9f\") " Jul 17 15:41:27.189583 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189544 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8bb1f50-a546-4c93-8478-5562edf27e9f" (UID: "d8bb1f50-a546-4c93-8478-5562edf27e9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.189583 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189562 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8bb1f50-a546-4c93-8478-5562edf27e9f" (UID: "d8bb1f50-a546-4c93-8478-5562edf27e9f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.189795 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189765 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-tmp-dir\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:27.190096 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189805 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-model-cache\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:27.190096 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.189768 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-home" (OuterVolumeSpecName: "home") pod "d8bb1f50-a546-4c93-8478-5562edf27e9f" (UID: "d8bb1f50-a546-4c93-8478-5562edf27e9f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.191681 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.191658 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-dshm" (OuterVolumeSpecName: "dshm") pod "d8bb1f50-a546-4c93-8478-5562edf27e9f" (UID: "d8bb1f50-a546-4c93-8478-5562edf27e9f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.191778 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.191682 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bb1f50-a546-4c93-8478-5562edf27e9f-kube-api-access-6bjmg" (OuterVolumeSpecName: "kube-api-access-6bjmg") pod "d8bb1f50-a546-4c93-8478-5562edf27e9f" (UID: "d8bb1f50-a546-4c93-8478-5562edf27e9f"). InnerVolumeSpecName "kube-api-access-6bjmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:41:27.191778 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.191723 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8bb1f50-a546-4c93-8478-5562edf27e9f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8bb1f50-a546-4c93-8478-5562edf27e9f" (UID: "d8bb1f50-a546-4c93-8478-5562edf27e9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:41:27.291186 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.291146 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bb1f50-a546-4c93-8478-5562edf27e9f-tls-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:27.291186 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.291178 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-dshm\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:27.291186 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.291187 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bb1f50-a546-4c93-8478-5562edf27e9f-home\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:27.291460 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.291225 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bjmg\" (UniqueName: \"kubernetes.io/projected/d8bb1f50-a546-4c93-8478-5562edf27e9f-kube-api-access-6bjmg\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:27.715891 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.715831 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" podUID="736f2268-f5f5-439b-8d44-a1b9f1aa0101" containerName="main" containerID="cri-o://acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e" gracePeriod=45 Jul 17 15:41:27.778994 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.778960 2574 generic.go:356] "Generic (PLEG): container finished" podID="d8bb1f50-a546-4c93-8478-5562edf27e9f" containerID="3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768" exitCode=0 Jul 17 15:41:27.779155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.779001 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" Jul 17 15:41:27.779155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.779046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" event={"ID":"d8bb1f50-a546-4c93-8478-5562edf27e9f","Type":"ContainerDied","Data":"3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768"} Jul 17 15:41:27.779155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.779095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk" event={"ID":"d8bb1f50-a546-4c93-8478-5562edf27e9f","Type":"ContainerDied","Data":"1fea4b2c11485fce1d2c3c3d639dfa3494836de8530fd08882965e14b1e94a98"} Jul 17 15:41:27.779155 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.779119 2574 scope.go:117] "RemoveContainer" containerID="3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768" Jul 17 15:41:27.801186 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.801152 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk"] Jul 17 15:41:27.805259 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.805225 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c4e0c6/sub-test-model-c4e0c6-kserve-f66959f69-qxxkk"] Jul 17 15:41:27.826493 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.826472 2574 scope.go:117] "RemoveContainer" containerID="3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768" Jul 17 15:41:27.826854 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:41:27.826835 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768\": container with ID starting with 3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768 not found: ID does not exist" containerID="3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768" Jul 17 15:41:27.826923 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.826867 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768"} err="failed to get container status \"3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768\": rpc error: code = NotFound desc = could not find container \"3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768\": container with ID starting with 3e68770c2af2b0813ee7929b23a2a9b254cd537dfe0b57504cfdaa4b511ba768 not found: ID does not exist" Jul 17 15:41:27.972558 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.972481 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:41:27.998010 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.997981 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-model-cache\") pod \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " Jul 17 15:41:27.998205 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998033 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-dshm\") pod \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " Jul 17 15:41:27.998205 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998075 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9wjz\" (UniqueName: \"kubernetes.io/projected/736f2268-f5f5-439b-8d44-a1b9f1aa0101-kube-api-access-t9wjz\") pod \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " Jul 17 15:41:27.998205 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998098 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-home\") pod \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " Jul 17 15:41:27.998205 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tmp-dir\") pod \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " Jul 17 15:41:27.998205 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998168 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tls-certs\") pod \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\" (UID: \"736f2268-f5f5-439b-8d44-a1b9f1aa0101\") " Jul 17 15:41:27.998489 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998250 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-model-cache" (OuterVolumeSpecName: "model-cache") pod "736f2268-f5f5-439b-8d44-a1b9f1aa0101" (UID: "736f2268-f5f5-439b-8d44-a1b9f1aa0101"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.998489 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998405 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-home" (OuterVolumeSpecName: "home") pod "736f2268-f5f5-439b-8d44-a1b9f1aa0101" (UID: "736f2268-f5f5-439b-8d44-a1b9f1aa0101"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.998489 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998417 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "736f2268-f5f5-439b-8d44-a1b9f1aa0101" (UID: "736f2268-f5f5-439b-8d44-a1b9f1aa0101"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:27.998489 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:27.998467 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-model-cache\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:28.000400 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.000372 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-dshm" (OuterVolumeSpecName: "dshm") pod "736f2268-f5f5-439b-8d44-a1b9f1aa0101" (UID: "736f2268-f5f5-439b-8d44-a1b9f1aa0101"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:41:28.000516 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.000468 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "736f2268-f5f5-439b-8d44-a1b9f1aa0101" (UID: "736f2268-f5f5-439b-8d44-a1b9f1aa0101"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:41:28.000516 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.000468 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736f2268-f5f5-439b-8d44-a1b9f1aa0101-kube-api-access-t9wjz" (OuterVolumeSpecName: "kube-api-access-t9wjz") pod "736f2268-f5f5-439b-8d44-a1b9f1aa0101" (UID: "736f2268-f5f5-439b-8d44-a1b9f1aa0101"). InnerVolumeSpecName "kube-api-access-t9wjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:41:28.099281 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.099243 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tmp-dir\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:28.099281 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.099274 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/736f2268-f5f5-439b-8d44-a1b9f1aa0101-tls-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:28.099281 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.099284 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-dshm\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:28.099281 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.099292 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9wjz\" (UniqueName: \"kubernetes.io/projected/736f2268-f5f5-439b-8d44-a1b9f1aa0101-kube-api-access-t9wjz\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:28.099553 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.099302 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/736f2268-f5f5-439b-8d44-a1b9f1aa0101-home\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:41:28.164944 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.164914 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8bb1f50-a546-4c93-8478-5562edf27e9f" path="/var/lib/kubelet/pods/d8bb1f50-a546-4c93-8478-5562edf27e9f/volumes" Jul 17 15:41:28.785956 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.785918 2574 generic.go:356] "Generic (PLEG): container finished" podID="736f2268-f5f5-439b-8d44-a1b9f1aa0101" containerID="acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e" exitCode=0 Jul 17 15:41:28.786132 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.785970 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" Jul 17 15:41:28.786132 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.785985 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" event={"ID":"736f2268-f5f5-439b-8d44-a1b9f1aa0101","Type":"ContainerDied","Data":"acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e"} Jul 17 15:41:28.786132 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.786022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m" event={"ID":"736f2268-f5f5-439b-8d44-a1b9f1aa0101","Type":"ContainerDied","Data":"d6dbfe667f37ce1f3e6c488514db6f7072521b937e930f89a88bf684c75a4f7c"} Jul 17 15:41:28.786132 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.786043 2574 scope.go:117] "RemoveContainer" containerID="acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e" Jul 17 15:41:28.794526 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.794505 2574 scope.go:117] "RemoveContainer" containerID="acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e" Jul 17 15:41:28.794788 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:41:28.794763 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e\": container with ID starting with acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e not found: ID does not exist" containerID="acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e" Jul 17 15:41:28.794845 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.794797 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e"} err="failed to get container status \"acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e\": rpc error: code = NotFound desc = could not find container \"acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e\": container with ID starting with acddf36bfc80a63cd44a9013b0cc119c60bf3add60191e0ac4275c774158ea3e not found: ID does not exist" Jul 17 15:41:28.804621 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.804594 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m"] Jul 17 15:41:28.809095 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:28.809071 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/sub-test-model-ae3cc1-kserve-65b8956cbc-rq24m"] Jul 17 15:41:30.164910 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:30.164873 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736f2268-f5f5-439b-8d44-a1b9f1aa0101" path="/var/lib/kubelet/pods/736f2268-f5f5-439b-8d44-a1b9f1aa0101/volumes" Jul 17 15:41:44.690288 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690173 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2"] Jul 17 15:41:44.690739 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690577 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bb1f50-a546-4c93-8478-5562edf27e9f" containerName="main" Jul 17 15:41:44.690739 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690589 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bb1f50-a546-4c93-8478-5562edf27e9f" containerName="main" Jul 17 15:41:44.690739 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690612 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736f2268-f5f5-439b-8d44-a1b9f1aa0101" containerName="main" Jul 17 15:41:44.690739 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690618 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="736f2268-f5f5-439b-8d44-a1b9f1aa0101" containerName="main" Jul 17 15:41:44.690739 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690678 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bb1f50-a546-4c93-8478-5562edf27e9f" containerName="main" Jul 17 15:41:44.690739 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.690689 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="736f2268-f5f5-439b-8d44-a1b9f1aa0101" containerName="main" Jul 17 15:41:44.695015 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.694999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.698933 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.698911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"kube-root-ca.crt\"" Jul 17 15:41:44.699095 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.698915 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"default-dockercfg-7th9q\"" Jul 17 15:41:44.699095 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.698945 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"openshift-service-ca.crt\"" Jul 17 15:41:44.699095 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.698918 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae3cc1\"/\"rate-test-model-ae3cc1-kserve-self-signed-certs\"" Jul 17 15:41:44.707633 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.707609 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2"] Jul 17 15:41:44.746718 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.746691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-dshm\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.746718 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.746719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tmp-dir\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.746927 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.746757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tls-certs\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.746927 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.746865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-model-cache\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.746927 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.746892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-home\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.746927 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.746914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp2f2\" (UniqueName: \"kubernetes.io/projected/4423bf37-8326-4ee3-a0dd-ef1f9c068186-kube-api-access-vp2f2\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.847662 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.847627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-dshm\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.847662 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.847659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tmp-dir\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.847907 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.847694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tls-certs\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.847907 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.847731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-model-cache\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.847907 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.847747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-home\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.847907 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.847762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp2f2\" (UniqueName: \"kubernetes.io/projected/4423bf37-8326-4ee3-a0dd-ef1f9c068186-kube-api-access-vp2f2\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.848172 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.848145 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tmp-dir\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.848172 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.848162 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-model-cache\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.848318 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.848212 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-home\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.849993 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.849974 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-dshm\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.850383 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.850362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tls-certs\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:44.858110 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:44.858051 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp2f2\" (UniqueName: \"kubernetes.io/projected/4423bf37-8326-4ee3-a0dd-ef1f9c068186-kube-api-access-vp2f2\") pod \"rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:45.004390 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:45.004288 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:45.142736 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:45.142710 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2"] Jul 17 15:41:45.144862 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:41:45.144831 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4423bf37_8326_4ee3_a0dd_ef1f9c068186.slice/crio-5b14d5da920420b57459aa963654f9dcccc1b056550779f6647c81774c0d6d65 WatchSource:0}: Error finding container 5b14d5da920420b57459aa963654f9dcccc1b056550779f6647c81774c0d6d65: Status 404 returned error can't find the container with id 5b14d5da920420b57459aa963654f9dcccc1b056550779f6647c81774c0d6d65 Jul 17 15:41:45.866781 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:45.866746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" event={"ID":"4423bf37-8326-4ee3-a0dd-ef1f9c068186","Type":"ContainerStarted","Data":"1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a"} Jul 17 15:41:45.867187 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:45.866789 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" event={"ID":"4423bf37-8326-4ee3-a0dd-ef1f9c068186","Type":"ContainerStarted","Data":"5b14d5da920420b57459aa963654f9dcccc1b056550779f6647c81774c0d6d65"} Jul 17 15:41:45.887643 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:45.887591 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" podStartSLOduration=1.887575516 podStartE2EDuration="1.887575516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:41:45.886365724 +0000 UTC m=+3152.238259356" watchObservedRunningTime="2026-07-17 15:41:45.887575516 +0000 UTC m=+3152.239469148" Jul 17 15:41:55.004887 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:55.004833 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:55.005504 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:55.004908 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:55.017738 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:55.017715 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:41:55.923589 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:41:55.923555 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:42:39.564445 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:39.564410 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2"] Jul 17 15:42:40.480280 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.480248 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7305-140694895956272"] Jul 17 15:42:40.483587 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.483570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:40.486339 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.486322 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-97hms\"" Jul 17 15:42:40.496409 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.496386 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694895956272"] Jul 17 15:42:40.556161 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.556127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzxfd\" (UniqueName: \"kubernetes.io/projected/b9990d00-f208-498d-aa2c-2fd2e122c077-kube-api-access-rzxfd\") pod \"test-curl-7305-140694895956272\" (UID: \"b9990d00-f208-498d-aa2c-2fd2e122c077\") " pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:40.657624 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.657590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzxfd\" (UniqueName: \"kubernetes.io/projected/b9990d00-f208-498d-aa2c-2fd2e122c077-kube-api-access-rzxfd\") pod \"test-curl-7305-140694895956272\" (UID: \"b9990d00-f208-498d-aa2c-2fd2e122c077\") " pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:40.667541 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.667508 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzxfd\" (UniqueName: \"kubernetes.io/projected/b9990d00-f208-498d-aa2c-2fd2e122c077-kube-api-access-rzxfd\") pod \"test-curl-7305-140694895956272\" (UID: \"b9990d00-f208-498d-aa2c-2fd2e122c077\") " pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:40.792441 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.792411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:40.935312 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.935288 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694895956272"] Jul 17 15:42:40.938157 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:42:40.938121 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9990d00_f208_498d_aa2c_2fd2e122c077.slice/crio-fb938d3e33ddb1a0c9fa1e5f13eb4287bc4eb0cf90554a0abfac08141f567876 WatchSource:0}: Error finding container fb938d3e33ddb1a0c9fa1e5f13eb4287bc4eb0cf90554a0abfac08141f567876: Status 404 returned error can't find the container with id fb938d3e33ddb1a0c9fa1e5f13eb4287bc4eb0cf90554a0abfac08141f567876 Jul 17 15:42:40.939796 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:40.939774 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 15:42:41.115851 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:41.115761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694895956272" event={"ID":"b9990d00-f208-498d-aa2c-2fd2e122c077","Type":"ContainerStarted","Data":"fb938d3e33ddb1a0c9fa1e5f13eb4287bc4eb0cf90554a0abfac08141f567876"} Jul 17 15:42:42.122460 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:42.122416 2574 generic.go:356] "Generic (PLEG): container finished" podID="b9990d00-f208-498d-aa2c-2fd2e122c077" containerID="124526f87c0d85b7b70e45e6c29b618f430ce7191d8896946c7a400d5b33a8a0" exitCode=0 Jul 17 15:42:42.122817 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:42.122503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694895956272" event={"ID":"b9990d00-f208-498d-aa2c-2fd2e122c077","Type":"ContainerDied","Data":"124526f87c0d85b7b70e45e6c29b618f430ce7191d8896946c7a400d5b33a8a0"} Jul 17 15:42:43.256241 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.256220 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:43.298851 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.298816 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7305-140694895956272_b9990d00-f208-498d-aa2c-2fd2e122c077/test-curl-7305-140694895956272/0.log" Jul 17 15:42:43.324125 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.324093 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7305-140694895956272"] Jul 17 15:42:43.331498 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.331475 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7305-140694895956272"] Jul 17 15:42:43.385544 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.385466 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzxfd\" (UniqueName: \"kubernetes.io/projected/b9990d00-f208-498d-aa2c-2fd2e122c077-kube-api-access-rzxfd\") pod \"b9990d00-f208-498d-aa2c-2fd2e122c077\" (UID: \"b9990d00-f208-498d-aa2c-2fd2e122c077\") " Jul 17 15:42:43.387755 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.387730 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9990d00-f208-498d-aa2c-2fd2e122c077-kube-api-access-rzxfd" (OuterVolumeSpecName: "kube-api-access-rzxfd") pod "b9990d00-f208-498d-aa2c-2fd2e122c077" (UID: "b9990d00-f208-498d-aa2c-2fd2e122c077"). InnerVolumeSpecName "kube-api-access-rzxfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:42:43.459774 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.459745 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7305-140694894445360"] Jul 17 15:42:43.460089 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.460078 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9990d00-f208-498d-aa2c-2fd2e122c077" containerName="test-curl-7305-140694895956272" Jul 17 15:42:43.460137 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.460091 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9990d00-f208-498d-aa2c-2fd2e122c077" containerName="test-curl-7305-140694895956272" Jul 17 15:42:43.460169 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.460165 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9990d00-f208-498d-aa2c-2fd2e122c077" containerName="test-curl-7305-140694895956272" Jul 17 15:42:43.463122 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.463107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:43.474325 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.474302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694894445360"] Jul 17 15:42:43.487101 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.487080 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzxfd\" (UniqueName: \"kubernetes.io/projected/b9990d00-f208-498d-aa2c-2fd2e122c077-kube-api-access-rzxfd\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:43.587912 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.587879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tgw4\" (UniqueName: \"kubernetes.io/projected/df5a1ac6-1459-4e26-ad3e-2eab7e545079-kube-api-access-5tgw4\") pod \"test-curl-7305-140694894445360\" (UID: \"df5a1ac6-1459-4e26-ad3e-2eab7e545079\") " pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:43.688799 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.688713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tgw4\" (UniqueName: \"kubernetes.io/projected/df5a1ac6-1459-4e26-ad3e-2eab7e545079-kube-api-access-5tgw4\") pod \"test-curl-7305-140694894445360\" (UID: \"df5a1ac6-1459-4e26-ad3e-2eab7e545079\") " pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:43.698819 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.698796 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tgw4\" (UniqueName: \"kubernetes.io/projected/df5a1ac6-1459-4e26-ad3e-2eab7e545079-kube-api-access-5tgw4\") pod \"test-curl-7305-140694894445360\" (UID: \"df5a1ac6-1459-4e26-ad3e-2eab7e545079\") " pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:43.771456 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.771407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:43.906186 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:43.906156 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694894445360"] Jul 17 15:42:43.907261 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:42:43.907236 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf5a1ac6_1459_4e26_ad3e_2eab7e545079.slice/crio-c76715350eed5f2f54f94d11325a0f6ad13f4a904614b7ff328b071642da95df WatchSource:0}: Error finding container c76715350eed5f2f54f94d11325a0f6ad13f4a904614b7ff328b071642da95df: Status 404 returned error can't find the container with id c76715350eed5f2f54f94d11325a0f6ad13f4a904614b7ff328b071642da95df Jul 17 15:42:44.132743 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:44.132715 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:44.132935 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:44.132766 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb938d3e33ddb1a0c9fa1e5f13eb4287bc4eb0cf90554a0abfac08141f567876" Jul 17 15:42:44.133897 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:44.133868 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694894445360" event={"ID":"df5a1ac6-1459-4e26-ad3e-2eab7e545079","Type":"ContainerStarted","Data":"c76715350eed5f2f54f94d11325a0f6ad13f4a904614b7ff328b071642da95df"} Jul 17 15:42:44.144895 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:44.144870 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7305-140694895956272\" is forbidden: User \"system:node:ip-10-0-139-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-74.ec2.internal' and this object" podUID="b9990d00-f208-498d-aa2c-2fd2e122c077" pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:44.164129 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:44.164102 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7305-140694895956272\" is forbidden: User \"system:node:ip-10-0-139-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-74.ec2.internal' and this object" podUID="b9990d00-f208-498d-aa2c-2fd2e122c077" pod="opendatahub/test-curl-7305-140694895956272" Jul 17 15:42:44.164646 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:44.164628 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9990d00-f208-498d-aa2c-2fd2e122c077" path="/var/lib/kubelet/pods/b9990d00-f208-498d-aa2c-2fd2e122c077/volumes" Jul 17 15:42:45.139617 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:45.139585 2574 generic.go:356] "Generic (PLEG): container finished" podID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" containerID="9f47df622ec110ae8160386f6a0641a92a59fb0a34f559d51d5f94e79c214d29" exitCode=0 Jul 17 15:42:45.139979 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:45.139625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694894445360" event={"ID":"df5a1ac6-1459-4e26-ad3e-2eab7e545079","Type":"ContainerDied","Data":"9f47df622ec110ae8160386f6a0641a92a59fb0a34f559d51d5f94e79c214d29"} Jul 17 15:42:46.278867 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.278840 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:46.307333 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.307310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7305-140694894445360_df5a1ac6-1459-4e26-ad3e-2eab7e545079/test-curl-7305-140694894445360/0.log" Jul 17 15:42:46.331756 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.331720 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7305-140694894445360"] Jul 17 15:42:46.337751 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.337729 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7305-140694894445360"] Jul 17 15:42:46.414222 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.414122 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tgw4\" (UniqueName: \"kubernetes.io/projected/df5a1ac6-1459-4e26-ad3e-2eab7e545079-kube-api-access-5tgw4\") pod \"df5a1ac6-1459-4e26-ad3e-2eab7e545079\" (UID: \"df5a1ac6-1459-4e26-ad3e-2eab7e545079\") " Jul 17 15:42:46.416424 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.416396 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df5a1ac6-1459-4e26-ad3e-2eab7e545079-kube-api-access-5tgw4" (OuterVolumeSpecName: "kube-api-access-5tgw4") pod "df5a1ac6-1459-4e26-ad3e-2eab7e545079" (UID: "df5a1ac6-1459-4e26-ad3e-2eab7e545079"). InnerVolumeSpecName "kube-api-access-5tgw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:42:46.489890 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.489859 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:46.490232 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.490218 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" containerName="test-curl-7305-140694894445360" Jul 17 15:42:46.490283 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.490233 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" containerName="test-curl-7305-140694894445360" Jul 17 15:42:46.490318 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.490299 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" containerName="test-curl-7305-140694894445360" Jul 17 15:42:46.493236 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.493218 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:46.504845 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.504820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:46.515495 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.515456 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tgw4\" (UniqueName: \"kubernetes.io/projected/df5a1ac6-1459-4e26-ad3e-2eab7e545079-kube-api-access-5tgw4\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:46.616164 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.616121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5mxz\" (UniqueName: \"kubernetes.io/projected/09f71e28-a3b0-417d-84e8-bf87a70dfcbb-kube-api-access-r5mxz\") pod \"test-curl-7305-140694898743024\" (UID: \"09f71e28-a3b0-417d-84e8-bf87a70dfcbb\") " pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:46.716921 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.716817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5mxz\" (UniqueName: \"kubernetes.io/projected/09f71e28-a3b0-417d-84e8-bf87a70dfcbb-kube-api-access-r5mxz\") pod \"test-curl-7305-140694898743024\" (UID: \"09f71e28-a3b0-417d-84e8-bf87a70dfcbb\") " pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:46.727887 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.727852 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5mxz\" (UniqueName: \"kubernetes.io/projected/09f71e28-a3b0-417d-84e8-bf87a70dfcbb-kube-api-access-r5mxz\") pod \"test-curl-7305-140694898743024\" (UID: \"09f71e28-a3b0-417d-84e8-bf87a70dfcbb\") " pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:46.801637 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.801600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:46.933460 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:46.933431 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:46.935695 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:42:46.935666 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09f71e28_a3b0_417d_84e8_bf87a70dfcbb.slice/crio-1b7869d07776c4e67e1412c1589dfd1e3c44fdd205e089aaa5918a8ec12a885a WatchSource:0}: Error finding container 1b7869d07776c4e67e1412c1589dfd1e3c44fdd205e089aaa5918a8ec12a885a: Status 404 returned error can't find the container with id 1b7869d07776c4e67e1412c1589dfd1e3c44fdd205e089aaa5918a8ec12a885a Jul 17 15:42:47.150018 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:47.149980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694898743024" event={"ID":"09f71e28-a3b0-417d-84e8-bf87a70dfcbb","Type":"ContainerStarted","Data":"1b7869d07776c4e67e1412c1589dfd1e3c44fdd205e089aaa5918a8ec12a885a"} Jul 17 15:42:47.151135 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:47.151116 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c76715350eed5f2f54f94d11325a0f6ad13f4a904614b7ff328b071642da95df" Jul 17 15:42:47.151263 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:47.151149 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:47.161990 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:47.161960 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7305-140694894445360\" is forbidden: User \"system:node:ip-10-0-139-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-74.ec2.internal' and this object" podUID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:48.158129 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:48.158093 2574 generic.go:356] "Generic (PLEG): container finished" podID="09f71e28-a3b0-417d-84e8-bf87a70dfcbb" containerID="2c72221e2f87481e30130622953382426945f1818092f5bd48ebdb40aca3ff98" exitCode=0 Jul 17 15:42:48.158531 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:48.158180 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694898743024" event={"ID":"09f71e28-a3b0-417d-84e8-bf87a70dfcbb","Type":"ContainerDied","Data":"2c72221e2f87481e30130622953382426945f1818092f5bd48ebdb40aca3ff98"} Jul 17 15:42:48.164526 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:48.164494 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" path="/var/lib/kubelet/pods/df5a1ac6-1459-4e26-ad3e-2eab7e545079/volumes" Jul 17 15:42:48.177661 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:48.177629 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7305-140694894445360\" is forbidden: User \"system:node:ip-10-0-139-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-74.ec2.internal' and this object" podUID="df5a1ac6-1459-4e26-ad3e-2eab7e545079" pod="opendatahub/test-curl-7305-140694894445360" Jul 17 15:42:49.296904 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.296883 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:49.321582 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.321556 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7305-140694898743024_09f71e28-a3b0-417d-84e8-bf87a70dfcbb/test-curl-7305-140694898743024/0.log" Jul 17 15:42:49.348345 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.348313 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:49.353361 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.353336 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:49.446066 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.445968 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5mxz\" (UniqueName: \"kubernetes.io/projected/09f71e28-a3b0-417d-84e8-bf87a70dfcbb-kube-api-access-r5mxz\") pod \"09f71e28-a3b0-417d-84e8-bf87a70dfcbb\" (UID: \"09f71e28-a3b0-417d-84e8-bf87a70dfcbb\") " Jul 17 15:42:49.448070 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.448051 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f71e28-a3b0-417d-84e8-bf87a70dfcbb-kube-api-access-r5mxz" (OuterVolumeSpecName: "kube-api-access-r5mxz") pod "09f71e28-a3b0-417d-84e8-bf87a70dfcbb" (UID: "09f71e28-a3b0-417d-84e8-bf87a70dfcbb"). InnerVolumeSpecName "kube-api-access-r5mxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:42:49.465100 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.465071 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:49.465479 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.465462 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f71e28-a3b0-417d-84e8-bf87a70dfcbb" containerName="test-curl-7305-140694898743024" Jul 17 15:42:49.465569 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.465481 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f71e28-a3b0-417d-84e8-bf87a70dfcbb" containerName="test-curl-7305-140694898743024" Jul 17 15:42:49.465630 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.465605 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f71e28-a3b0-417d-84e8-bf87a70dfcbb" containerName="test-curl-7305-140694898743024" Jul 17 15:42:49.468441 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.468421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:49.478616 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.478593 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:49.547623 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.547595 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5mxz\" (UniqueName: \"kubernetes.io/projected/09f71e28-a3b0-417d-84e8-bf87a70dfcbb-kube-api-access-r5mxz\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:49.649033 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.648994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gn5z\" (UniqueName: \"kubernetes.io/projected/3246a0d7-62f1-4560-abdd-154fa3c9af4a-kube-api-access-2gn5z\") pod \"test-curl-7305-140694898743024\" (UID: \"3246a0d7-62f1-4560-abdd-154fa3c9af4a\") " pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:49.749873 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.749787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gn5z\" (UniqueName: \"kubernetes.io/projected/3246a0d7-62f1-4560-abdd-154fa3c9af4a-kube-api-access-2gn5z\") pod \"test-curl-7305-140694898743024\" (UID: \"3246a0d7-62f1-4560-abdd-154fa3c9af4a\") " pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:49.760838 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.760812 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gn5z\" (UniqueName: \"kubernetes.io/projected/3246a0d7-62f1-4560-abdd-154fa3c9af4a-kube-api-access-2gn5z\") pod \"test-curl-7305-140694898743024\" (UID: \"3246a0d7-62f1-4560-abdd-154fa3c9af4a\") " pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:49.777534 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.777509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:49.909691 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:49.909660 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:49.910638 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:42:49.910610 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3246a0d7_62f1_4560_abdd_154fa3c9af4a.slice/crio-ff50d5845576378d80804bce6bb5066154aa6ffd39247663e03bd42ad2454820 WatchSource:0}: Error finding container ff50d5845576378d80804bce6bb5066154aa6ffd39247663e03bd42ad2454820: Status 404 returned error can't find the container with id ff50d5845576378d80804bce6bb5066154aa6ffd39247663e03bd42ad2454820 Jul 17 15:42:50.165547 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:50.165518 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09f71e28-a3b0-417d-84e8-bf87a70dfcbb" path="/var/lib/kubelet/pods/09f71e28-a3b0-417d-84e8-bf87a70dfcbb/volumes" Jul 17 15:42:50.174884 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:50.174851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694898743024" event={"ID":"3246a0d7-62f1-4560-abdd-154fa3c9af4a","Type":"ContainerStarted","Data":"ff50d5845576378d80804bce6bb5066154aa6ffd39247663e03bd42ad2454820"} Jul 17 15:42:50.176092 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:50.176069 2574 scope.go:117] "RemoveContainer" containerID="2c72221e2f87481e30130622953382426945f1818092f5bd48ebdb40aca3ff98" Jul 17 15:42:50.176265 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:50.176133 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:51.182783 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:51.182742 2574 generic.go:356] "Generic (PLEG): container finished" podID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" containerID="e3a51071dfa0a93f32229771370c5f926d9ae1c63cf22e027d4c01604e4aa9f4" exitCode=0 Jul 17 15:42:51.183183 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:51.182805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694898743024" event={"ID":"3246a0d7-62f1-4560-abdd-154fa3c9af4a","Type":"ContainerDied","Data":"e3a51071dfa0a93f32229771370c5f926d9ae1c63cf22e027d4c01604e4aa9f4"} Jul 17 15:42:52.317552 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.317527 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:52.338970 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.338946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7305-140694898743024_3246a0d7-62f1-4560-abdd-154fa3c9af4a/test-curl-7305-140694898743024/0.log" Jul 17 15:42:52.362713 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.362682 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:52.367133 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.367109 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7305-140694898743024"] Jul 17 15:42:52.373696 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.373681 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gn5z\" (UniqueName: \"kubernetes.io/projected/3246a0d7-62f1-4560-abdd-154fa3c9af4a-kube-api-access-2gn5z\") pod \"3246a0d7-62f1-4560-abdd-154fa3c9af4a\" (UID: \"3246a0d7-62f1-4560-abdd-154fa3c9af4a\") " Jul 17 15:42:52.375882 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.375850 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3246a0d7-62f1-4560-abdd-154fa3c9af4a-kube-api-access-2gn5z" (OuterVolumeSpecName: "kube-api-access-2gn5z") pod "3246a0d7-62f1-4560-abdd-154fa3c9af4a" (UID: "3246a0d7-62f1-4560-abdd-154fa3c9af4a"). InnerVolumeSpecName "kube-api-access-2gn5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:42:52.475083 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.474988 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gn5z\" (UniqueName: \"kubernetes.io/projected/3246a0d7-62f1-4560-abdd-154fa3c9af4a-kube-api-access-2gn5z\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:52.481372 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.481342 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7305-140694898902336"] Jul 17 15:42:52.481706 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.481693 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" containerName="test-curl-7305-140694898743024" Jul 17 15:42:52.481776 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.481707 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" containerName="test-curl-7305-140694898743024" Jul 17 15:42:52.481776 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.481763 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" containerName="test-curl-7305-140694898743024" Jul 17 15:42:52.484629 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.484613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:42:52.492266 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.492237 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694898902336"] Jul 17 15:42:52.576083 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.576046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9q2d\" (UniqueName: \"kubernetes.io/projected/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7-kube-api-access-j9q2d\") pod \"test-curl-7305-140694898902336\" (UID: \"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7\") " pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:42:52.677049 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.677015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9q2d\" (UniqueName: \"kubernetes.io/projected/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7-kube-api-access-j9q2d\") pod \"test-curl-7305-140694898902336\" (UID: \"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7\") " pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:42:52.686678 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.686653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9q2d\" (UniqueName: \"kubernetes.io/projected/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7-kube-api-access-j9q2d\") pod \"test-curl-7305-140694898902336\" (UID: \"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7\") " pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:42:52.794029 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.793998 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:42:52.928601 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:52.928577 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7305-140694898902336"] Jul 17 15:42:52.930616 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:42:52.930590 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeddfa6c7_cf1b_4dc7_b823_e6547e4f0ca7.slice/crio-2cf787eb9c5ae9b352c4cb7b2606b5e989d1e590ff98e4fdaadec4b2037d082e WatchSource:0}: Error finding container 2cf787eb9c5ae9b352c4cb7b2606b5e989d1e590ff98e4fdaadec4b2037d082e: Status 404 returned error can't find the container with id 2cf787eb9c5ae9b352c4cb7b2606b5e989d1e590ff98e4fdaadec4b2037d082e Jul 17 15:42:53.193695 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:53.193600 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694898902336" event={"ID":"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7","Type":"ContainerStarted","Data":"2cf787eb9c5ae9b352c4cb7b2606b5e989d1e590ff98e4fdaadec4b2037d082e"} Jul 17 15:42:53.194832 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:53.194812 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff50d5845576378d80804bce6bb5066154aa6ffd39247663e03bd42ad2454820" Jul 17 15:42:53.194953 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:53.194841 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:53.205862 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:53.205832 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7305-140694898743024\" is forbidden: User \"system:node:ip-10-0-139-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-74.ec2.internal' and this object" podUID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:54.164747 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.164715 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" path="/var/lib/kubelet/pods/3246a0d7-62f1-4560-abdd-154fa3c9af4a/volumes" Jul 17 15:42:54.165559 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:54.165530 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7305-140694898743024\" is forbidden: User \"system:node:ip-10-0-139-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-74.ec2.internal' and this object" podUID="3246a0d7-62f1-4560-abdd-154fa3c9af4a" pod="opendatahub/test-curl-7305-140694898743024" Jul 17 15:42:54.200535 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.200498 2574 generic.go:356] "Generic (PLEG): container finished" podID="eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7" containerID="2432f94730d8775f35e13c2f4447f6ce6c26a7ee093ae27b9f3a1bd2c743a598" exitCode=0 Jul 17 15:42:54.200673 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.200601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7305-140694898902336" event={"ID":"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7","Type":"ContainerDied","Data":"2432f94730d8775f35e13c2f4447f6ce6c26a7ee093ae27b9f3a1bd2c743a598"} Jul 17 15:42:54.584411 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.584366 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" podUID="4423bf37-8326-4ee3-a0dd-ef1f9c068186" containerName="main" containerID="cri-o://1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a" gracePeriod=45 Jul 17 15:42:54.858672 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.858643 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:42:54.893471 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893442 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-home\") pod \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " Jul 17 15:42:54.893642 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893478 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-model-cache\") pod \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " Jul 17 15:42:54.893642 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893522 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tls-certs\") pod \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " Jul 17 15:42:54.893642 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893540 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp2f2\" (UniqueName: \"kubernetes.io/projected/4423bf37-8326-4ee3-a0dd-ef1f9c068186-kube-api-access-vp2f2\") pod \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " Jul 17 15:42:54.893806 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893707 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tmp-dir\") pod \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " Jul 17 15:42:54.893806 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893723 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-home" (OuterVolumeSpecName: "home") pod "4423bf37-8326-4ee3-a0dd-ef1f9c068186" (UID: "4423bf37-8326-4ee3-a0dd-ef1f9c068186"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:42:54.893806 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893771 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-dshm\") pod \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\" (UID: \"4423bf37-8326-4ee3-a0dd-ef1f9c068186\") " Jul 17 15:42:54.893952 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893830 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-model-cache" (OuterVolumeSpecName: "model-cache") pod "4423bf37-8326-4ee3-a0dd-ef1f9c068186" (UID: "4423bf37-8326-4ee3-a0dd-ef1f9c068186"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:42:54.893952 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.893938 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4423bf37-8326-4ee3-a0dd-ef1f9c068186" (UID: "4423bf37-8326-4ee3-a0dd-ef1f9c068186"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:42:54.894076 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.894058 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-home\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:54.894130 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.894083 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-model-cache\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:54.894130 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.894098 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tmp-dir\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:54.896040 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.896020 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-dshm" (OuterVolumeSpecName: "dshm") pod "4423bf37-8326-4ee3-a0dd-ef1f9c068186" (UID: "4423bf37-8326-4ee3-a0dd-ef1f9c068186"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:42:54.896375 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.896346 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4423bf37-8326-4ee3-a0dd-ef1f9c068186" (UID: "4423bf37-8326-4ee3-a0dd-ef1f9c068186"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:42:54.896375 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.896366 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4423bf37-8326-4ee3-a0dd-ef1f9c068186-kube-api-access-vp2f2" (OuterVolumeSpecName: "kube-api-access-vp2f2") pod "4423bf37-8326-4ee3-a0dd-ef1f9c068186" (UID: "4423bf37-8326-4ee3-a0dd-ef1f9c068186"). InnerVolumeSpecName "kube-api-access-vp2f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:42:54.994656 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.994618 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4423bf37-8326-4ee3-a0dd-ef1f9c068186-tls-certs\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:54.994656 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.994649 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp2f2\" (UniqueName: \"kubernetes.io/projected/4423bf37-8326-4ee3-a0dd-ef1f9c068186-kube-api-access-vp2f2\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:54.994656 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:54.994662 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4423bf37-8326-4ee3-a0dd-ef1f9c068186-dshm\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:55.206464 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.206370 2574 generic.go:356] "Generic (PLEG): container finished" podID="4423bf37-8326-4ee3-a0dd-ef1f9c068186" containerID="1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a" exitCode=0 Jul 17 15:42:55.206464 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.206412 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" Jul 17 15:42:55.206996 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.206458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" event={"ID":"4423bf37-8326-4ee3-a0dd-ef1f9c068186","Type":"ContainerDied","Data":"1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a"} Jul 17 15:42:55.206996 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.206504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2" event={"ID":"4423bf37-8326-4ee3-a0dd-ef1f9c068186","Type":"ContainerDied","Data":"5b14d5da920420b57459aa963654f9dcccc1b056550779f6647c81774c0d6d65"} Jul 17 15:42:55.206996 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.206521 2574 scope.go:117] "RemoveContainer" containerID="1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a" Jul 17 15:42:55.222727 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.222701 2574 scope.go:117] "RemoveContainer" containerID="1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a" Jul 17 15:42:55.223182 ip-10-0-139-74 kubenswrapper[2574]: E0717 15:42:55.223157 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a\": container with ID starting with 1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a not found: ID does not exist" containerID="1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a" Jul 17 15:42:55.223293 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.223209 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a"} err="failed to get container status \"1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a\": rpc error: code = NotFound desc = could not find container \"1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a\": container with ID starting with 1f8b3e239a47e2e22349134f61cc72db24db52134be930ec4aa36623cb73019a not found: ID does not exist" Jul 17 15:42:55.237802 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.237766 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2"] Jul 17 15:42:55.243792 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.243760 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ae3cc1/rate-test-model-ae3cc1-kserve-5b4794b475-cmjj2"] Jul 17 15:42:55.336245 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.336217 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:42:55.361590 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.361537 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7305-140694898902336_eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7/test-curl-7305-140694898902336/0.log" Jul 17 15:42:55.384611 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.384574 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7305-140694898902336"] Jul 17 15:42:55.388907 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.388882 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7305-140694898902336"] Jul 17 15:42:55.397593 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.397568 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9q2d\" (UniqueName: \"kubernetes.io/projected/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7-kube-api-access-j9q2d\") pod \"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7\" (UID: \"eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7\") " Jul 17 15:42:55.399765 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.399737 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7-kube-api-access-j9q2d" (OuterVolumeSpecName: "kube-api-access-j9q2d") pod "eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7" (UID: "eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7"). InnerVolumeSpecName "kube-api-access-j9q2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:42:55.498441 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:55.498361 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9q2d\" (UniqueName: \"kubernetes.io/projected/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7-kube-api-access-j9q2d\") on node \"ip-10-0-139-74.ec2.internal\" DevicePath \"\"" Jul 17 15:42:56.165362 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:56.165328 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4423bf37-8326-4ee3-a0dd-ef1f9c068186" path="/var/lib/kubelet/pods/4423bf37-8326-4ee3-a0dd-ef1f9c068186/volumes" Jul 17 15:42:56.165679 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:56.165666 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7" path="/var/lib/kubelet/pods/eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7/volumes" Jul 17 15:42:56.212921 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:56.212884 2574 scope.go:117] "RemoveContainer" containerID="2432f94730d8775f35e13c2f4447f6ce6c26a7ee093ae27b9f3a1bd2c743a598" Jul 17 15:42:56.213402 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:42:56.212890 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7305-140694898902336" Jul 17 15:43:57.705313 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:43:57.705284 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-fbdjl_f3f973aa-9e22-4f9f-93f2-7e2271c257f8/copy-manifests/0.log" Jul 17 15:43:57.713067 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:43:57.713011 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-fbdjl_f3f973aa-9e22-4f9f-93f2-7e2271c257f8/manager/0.log" Jul 17 15:44:00.743992 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:00.743942 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6rd8z_02bd38f7-0e19-4e51-bacd-6e2f9088fc02/manager/0.log" Jul 17 15:44:01.746946 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:01.746913 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sldrv_04c202c1-2fe4-4ef0-8937-2b444d54db08/istio-proxy/0.log" Jul 17 15:44:01.971318 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:01.971282 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cdb8d648-2drgd_cca1bb56-a6ee-446c-be3b-dc3163e5ea6d/kube-auth-proxy/0.log" Jul 17 15:44:02.190462 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:02.190435 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/1.log" Jul 17 15:44:03.075672 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:03.075623 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zzsvk_d2b162c2-6ed3-46eb-9ff9-9ceb3c7dd5eb/main/0.log" Jul 17 15:44:03.180454 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:03.180426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdrh5s_b1ea15d2-6efe-47f8-a9cc-684e26ee4b13/main/0.log" Jul 17 15:44:03.398555 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:03.398482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qr55n_d77d787e-bd7c-4167-a734-ca6418c7dbff/main/0.log" Jul 17 15:44:08.584119 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584086 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8rfwj/must-gather-gq2sm"] Jul 17 15:44:08.584549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584438 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7" containerName="test-curl-7305-140694898902336" Jul 17 15:44:08.584549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584449 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7" containerName="test-curl-7305-140694898902336" Jul 17 15:44:08.584549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584459 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4423bf37-8326-4ee3-a0dd-ef1f9c068186" containerName="main" Jul 17 15:44:08.584549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584465 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4423bf37-8326-4ee3-a0dd-ef1f9c068186" containerName="main" Jul 17 15:44:08.584549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584535 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4423bf37-8326-4ee3-a0dd-ef1f9c068186" containerName="main" Jul 17 15:44:08.584549 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.584547 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="eddfa6c7-cf1b-4dc7-b823-e6547e4f0ca7" containerName="test-curl-7305-140694898902336" Jul 17 15:44:08.587543 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.587525 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.590169 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.590148 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rfwj\"/\"kube-root-ca.crt\"" Jul 17 15:44:08.591246 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.591227 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8rfwj\"/\"default-dockercfg-q4hr6\"" Jul 17 15:44:08.591347 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.591237 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rfwj\"/\"openshift-service-ca.crt\"" Jul 17 15:44:08.598929 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.598907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rfwj/must-gather-gq2sm"] Jul 17 15:44:08.661472 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.661436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8fe4747-bc91-4e86-8a80-cfff8573a0a8-must-gather-output\") pod \"must-gather-gq2sm\" (UID: \"f8fe4747-bc91-4e86-8a80-cfff8573a0a8\") " pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.661652 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.661481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmh9k\" (UniqueName: \"kubernetes.io/projected/f8fe4747-bc91-4e86-8a80-cfff8573a0a8-kube-api-access-mmh9k\") pod \"must-gather-gq2sm\" (UID: \"f8fe4747-bc91-4e86-8a80-cfff8573a0a8\") " pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.762812 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.762768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmh9k\" (UniqueName: \"kubernetes.io/projected/f8fe4747-bc91-4e86-8a80-cfff8573a0a8-kube-api-access-mmh9k\") pod \"must-gather-gq2sm\" (UID: \"f8fe4747-bc91-4e86-8a80-cfff8573a0a8\") " pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.762976 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.762911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8fe4747-bc91-4e86-8a80-cfff8573a0a8-must-gather-output\") pod \"must-gather-gq2sm\" (UID: \"f8fe4747-bc91-4e86-8a80-cfff8573a0a8\") " pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.763303 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.763285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8fe4747-bc91-4e86-8a80-cfff8573a0a8-must-gather-output\") pod \"must-gather-gq2sm\" (UID: \"f8fe4747-bc91-4e86-8a80-cfff8573a0a8\") " pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.773540 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.773517 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmh9k\" (UniqueName: \"kubernetes.io/projected/f8fe4747-bc91-4e86-8a80-cfff8573a0a8-kube-api-access-mmh9k\") pod \"must-gather-gq2sm\" (UID: \"f8fe4747-bc91-4e86-8a80-cfff8573a0a8\") " pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:08.896371 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:08.896284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rfwj/must-gather-gq2sm" Jul 17 15:44:09.031219 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:09.031171 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rfwj/must-gather-gq2sm"] Jul 17 15:44:09.033406 ip-10-0-139-74 kubenswrapper[2574]: W0717 15:44:09.033379 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8fe4747_bc91_4e86_8a80_cfff8573a0a8.slice/crio-5585a998b3b7a11569265ced3fc772b085718d6ae0b41c4fbef0e30f97171246 WatchSource:0}: Error finding container 5585a998b3b7a11569265ced3fc772b085718d6ae0b41c4fbef0e30f97171246: Status 404 returned error can't find the container with id 5585a998b3b7a11569265ced3fc772b085718d6ae0b41c4fbef0e30f97171246 Jul 17 15:44:09.559617 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:09.559543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/must-gather-gq2sm" event={"ID":"f8fe4747-bc91-4e86-8a80-cfff8573a0a8","Type":"ContainerStarted","Data":"5585a998b3b7a11569265ced3fc772b085718d6ae0b41c4fbef0e30f97171246"} Jul 17 15:44:10.567115 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:10.567074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/must-gather-gq2sm" event={"ID":"f8fe4747-bc91-4e86-8a80-cfff8573a0a8","Type":"ContainerStarted","Data":"c73b67289d1cc807c5b96c24227cf3ef106b7a1a221d727e6ae865bebb3c9e87"} Jul 17 15:44:10.567115 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:10.567122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/must-gather-gq2sm" event={"ID":"f8fe4747-bc91-4e86-8a80-cfff8573a0a8","Type":"ContainerStarted","Data":"7b732066ea78617a06fdaceb1e15a37c7e40b56185122d09e2e97b9a08d7ab67"} Jul 17 15:44:10.584943 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:10.584868 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8rfwj/must-gather-gq2sm" podStartSLOduration=1.925633489 podStartE2EDuration="2.58484416s" totalImagesPullingTime="659.210671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:44:10.584253196 +0000 UTC m=+3296.936146829" watchObservedRunningTime="2026-07-17 15:44:10.58484416 +0000 UTC m=+3296.936737795" Jul 17 15:44:11.318117 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:11.318033 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-42vbh_b66703c1-056c-48af-b986-c4dd73996a89/global-pull-secret-syncer/0.log" Jul 17 15:44:11.559458 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:11.559424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ppklf_5d743f1f-28ac-4c14-8e5d-949d98b5d67d/konnectivity-agent/0.log" Jul 17 15:44:11.613760 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:11.613661 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-74.ec2.internal_00d96d78880ade0ba958cafce4d1d6a2/haproxy/0.log" Jul 17 15:44:14.394311 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:14.393977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:44:14.402343 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:14.402016 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt5k4_ca21c9e7-c89a-43b6-8d7b-e5ef164a6c26/kube-multus/0.log" Jul 17 15:44:17.127080 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:17.126967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6rd8z_02bd38f7-0e19-4e51-bacd-6e2f9088fc02/manager/0.log" Jul 17 15:44:19.632412 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:19.632381 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-7pfg5_3a421ec8-d921-4adc-91c6-1d7c1ce3ef3b/monitoring-plugin/0.log" Jul 17 15:44:19.793273 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:19.793236 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m9mj9_657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9/node-exporter/0.log" Jul 17 15:44:19.824087 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:19.824056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m9mj9_657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9/kube-rbac-proxy/0.log" Jul 17 15:44:19.855122 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:19.855092 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m9mj9_657b4ea5-6eea-4ac2-9b94-1e69ce0c82a9/init-textfile/0.log" Jul 17 15:44:19.971258 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:19.971228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-lcnhj_0284b3d2-f480-48ef-8d51-d778d79da6f3/kube-rbac-proxy-main/0.log" Jul 17 15:44:19.998949 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:19.998911 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-lcnhj_0284b3d2-f480-48ef-8d51-d778d79da6f3/kube-rbac-proxy-self/0.log" Jul 17 15:44:20.026292 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.026254 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-lcnhj_0284b3d2-f480-48ef-8d51-d778d79da6f3/openshift-state-metrics/0.log" Jul 17 15:44:20.069760 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.069678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/prometheus/0.log" Jul 17 15:44:20.099852 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.099807 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/config-reloader/0.log" Jul 17 15:44:20.127353 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.127322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/thanos-sidecar/0.log" Jul 17 15:44:20.154020 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.153974 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/kube-rbac-proxy-web/0.log" Jul 17 15:44:20.179902 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.179871 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/kube-rbac-proxy/0.log" Jul 17 15:44:20.207293 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.207264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/kube-rbac-proxy-thanos/0.log" Jul 17 15:44:20.233060 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.233029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a402912e-0470-426b-b9b6-cc3ece202a09/init-config-reloader/0.log" Jul 17 15:44:20.431873 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.431796 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fc4d8dc97-fbklv_4c12bde9-8747-4aab-9abe-c5a3322a4115/thanos-query/0.log" Jul 17 15:44:20.456211 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.456163 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fc4d8dc97-fbklv_4c12bde9-8747-4aab-9abe-c5a3322a4115/kube-rbac-proxy-web/0.log" Jul 17 15:44:20.485526 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.485499 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fc4d8dc97-fbklv_4c12bde9-8747-4aab-9abe-c5a3322a4115/kube-rbac-proxy/0.log" Jul 17 15:44:20.510284 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.510255 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fc4d8dc97-fbklv_4c12bde9-8747-4aab-9abe-c5a3322a4115/prom-label-proxy/0.log" Jul 17 15:44:20.534063 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.534028 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fc4d8dc97-fbklv_4c12bde9-8747-4aab-9abe-c5a3322a4115/kube-rbac-proxy-rules/0.log" Jul 17 15:44:20.560917 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:20.560893 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fc4d8dc97-fbklv_4c12bde9-8747-4aab-9abe-c5a3322a4115/kube-rbac-proxy-metrics/0.log" Jul 17 15:44:21.594169 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.594132 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n"] Jul 17 15:44:21.600995 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.600954 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.608226 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.608170 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n"] Jul 17 15:44:21.708885 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.708836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-podres\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.709090 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.708948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94n56\" (UniqueName: \"kubernetes.io/projected/b09af862-7d31-4948-9bf3-6adc25e597a1-kube-api-access-94n56\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.709090 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.709017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-sys\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.709090 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.709075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-proc\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.709298 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.709151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-lib-modules\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.810446 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.810412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-podres\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.810740 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.810697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-podres\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.810822 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.810733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94n56\" (UniqueName: \"kubernetes.io/projected/b09af862-7d31-4948-9bf3-6adc25e597a1-kube-api-access-94n56\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.810925 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.810913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-sys\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.811096 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.811084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-proc\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.811297 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.811283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-lib-modules\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.811537 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.811036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-sys\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.811626 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.811469 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-lib-modules\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.811694 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.811235 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b09af862-7d31-4948-9bf3-6adc25e597a1-proc\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.821471 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.821442 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94n56\" (UniqueName: \"kubernetes.io/projected/b09af862-7d31-4948-9bf3-6adc25e597a1-kube-api-access-94n56\") pod \"perf-node-gather-daemonset-5zx9n\" (UID: \"b09af862-7d31-4948-9bf3-6adc25e597a1\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:21.914550 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:21.914469 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:22.080440 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:22.079176 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n"] Jul 17 15:44:22.655861 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:22.655819 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" event={"ID":"b09af862-7d31-4948-9bf3-6adc25e597a1","Type":"ContainerStarted","Data":"55c0a707521847db017ad2e4cd5ee57a7f3b3ed9861ba975682ac76ae6ebcde8"} Jul 17 15:44:22.656506 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:22.656478 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:22.656658 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:22.656640 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" event={"ID":"b09af862-7d31-4948-9bf3-6adc25e597a1","Type":"ContainerStarted","Data":"5458305e21cc22f031e023fb485955a151730497df4367673d2942ccd5836070"} Jul 17 15:44:22.678829 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:22.678763 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" podStartSLOduration=1.6787238850000001 podStartE2EDuration="1.678723885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:44:22.674166279 +0000 UTC m=+3309.026067005" watchObservedRunningTime="2026-07-17 15:44:22.678723885 +0000 UTC m=+3309.030617519" Jul 17 15:44:22.890936 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:22.890898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-l72kz_d77fe87f-67d5-44f1-81e3-fdc89c53db6b/download-server/0.log" Jul 17 15:44:24.570272 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:24.570244 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s59sv_9a6b5e68-3510-479a-8a87-8d1032c7d098/dns/0.log" Jul 17 15:44:24.594868 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:24.594842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s59sv_9a6b5e68-3510-479a-8a87-8d1032c7d098/kube-rbac-proxy/0.log" Jul 17 15:44:24.784253 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:24.784225 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzcdh_51da87c7-aaad-458c-8095-362836c77817/dns-node-resolver/0.log" Jul 17 15:44:25.369974 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:25.369926 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55d89dc498-8r4pz_322fb337-9bf1-452f-bf0a-df72045d64d0/registry/0.log" Jul 17 15:44:25.394633 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:25.394609 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jnrx_7ece9582-f509-4f33-ad29-b52b0f78fdd1/node-ca/0.log" Jul 17 15:44:26.424511 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:26.424470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sldrv_04c202c1-2fe4-4ef0-8937-2b444d54db08/istio-proxy/0.log" Jul 17 15:44:26.670619 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:26.670580 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cdb8d648-2drgd_cca1bb56-a6ee-446c-be3b-dc3163e5ea6d/kube-auth-proxy/0.log" Jul 17 15:44:26.733574 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:26.733492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/0.log" Jul 17 15:44:26.771660 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:26.771620 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/1.log" Jul 17 15:44:27.586392 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:27.586366 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvgff_ad5aea99-3ae1-466e-9071-9544f678561a/serve-healthcheck-canary/0.log" Jul 17 15:44:28.175444 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:28.175416 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffl7m_835874ff-88cc-4a96-95b6-6caa0901e7b7/kube-rbac-proxy/0.log" Jul 17 15:44:28.200911 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:28.200884 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffl7m_835874ff-88cc-4a96-95b6-6caa0901e7b7/exporter/0.log" Jul 17 15:44:28.231315 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:28.231290 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffl7m_835874ff-88cc-4a96-95b6-6caa0901e7b7/extractor/0.log" Jul 17 15:44:29.675228 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:29.675173 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-5zx9n" Jul 17 15:44:31.276474 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:31.276441 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-fbdjl_f3f973aa-9e22-4f9f-93f2-7e2271c257f8/manager/0.log" Jul 17 15:44:31.305784 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:31.305756 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-fbdjl_f3f973aa-9e22-4f9f-93f2-7e2271c257f8/copy-manifests/0.log" Jul 17 15:44:32.408011 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:32.407984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sldrv_04c202c1-2fe4-4ef0-8937-2b444d54db08/istio-proxy/0.log" Jul 17 15:44:32.629439 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:32.629412 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cdb8d648-2drgd_cca1bb56-a6ee-446c-be3b-dc3163e5ea6d/kube-auth-proxy/0.log" Jul 17 15:44:32.653596 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:32.653570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9db68d568-lh7h7_d137105b-016e-435e-9ce0-70e716285ccb/manager/0.log" Jul 17 15:44:32.677304 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:32.677225 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/0.log" Jul 17 15:44:32.714823 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:32.714790 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/1.log" Jul 17 15:44:34.067571 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:34.067488 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sldrv_04c202c1-2fe4-4ef0-8937-2b444d54db08/istio-proxy/0.log" Jul 17 15:44:34.288583 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:34.288550 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cdb8d648-2drgd_cca1bb56-a6ee-446c-be3b-dc3163e5ea6d/kube-auth-proxy/0.log" Jul 17 15:44:34.329864 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:34.329783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/0.log" Jul 17 15:44:34.366636 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:34.366600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-75fdb_7b223b28-7819-4143-8068-810636109d8b/istio-proxy/1.log" Jul 17 15:44:37.974598 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:37.974528 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-885bt_ba826700-37f3-4480-a19e-00478139c545/migrator/0.log" Jul 17 15:44:38.003310 ip-10-0-139-74 kubenswrapper[2574]: I0717 15:44:38.003285 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-885bt_ba826700-37f3-4480-a19e-00478139c545/graceful-termination/0.log"