Jul 15 21:07:37.609998 ip-10-0-143-128 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 21:07:37.610009 ip-10-0-143-128 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 21:07:37.610016 ip-10-0-143-128 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 21:07:37.610289 ip-10-0-143-128 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 21:07:47.674449 ip-10-0-143-128 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 21:07:47.674464 ip-10-0-143-128 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3e61684f3d314c6fb56ac35424ea259f -- Jul 15 21:09:38.404192 ip-10-0-143-128 systemd[1]: Starting Kubernetes Kubelet... Jul 15 21:09:38.785477 ip-10-0-143-128 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:38.785477 ip-10-0-143-128 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 21:09:38.785477 ip-10-0-143-128 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:38.785477 ip-10-0-143-128 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 21:09:38.785477 ip-10-0-143-128 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:38.786512 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.786427 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 21:09:38.790977 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790962 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.790977 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790977 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790981 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790985 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790988 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790990 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790993 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.790998 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791000 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791003 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791005 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791008 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791011 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791014 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791017 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791019 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791022 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791024 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791027 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791035 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.791046 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791039 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791041 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791044 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791047 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791050 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791053 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791056 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791059 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791062 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791064 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791067 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791069 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791072 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791074 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791077 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791079 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791082 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791084 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791087 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791089 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.791464 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791091 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791094 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791096 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791098 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791101 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791103 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791106 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791108 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791111 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791114 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791116 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791119 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791121 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791123 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791127 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791132 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791136 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791139 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791141 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791144 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.791939 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791147 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791149 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791154 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791157 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791160 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791163 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791165 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791168 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791170 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791173 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791176 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791184 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791187 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791189 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791192 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791194 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791198 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791200 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791203 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.792428 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791206 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791209 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791211 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791213 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791215 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791218 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791220 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791224 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791227 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791229 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791233 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791237 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791240 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791243 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791245 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791248 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791251 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791254 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791257 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.792846 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.791259 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.794061 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794050 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.794061 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794060 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794066 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794070 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794073 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794077 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794080 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794083 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794085 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794088 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794091 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794094 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794096 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794099 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794101 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794104 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794106 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794109 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794111 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794114 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.794120 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794116 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794119 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794121 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794124 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794127 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794130 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794133 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794135 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794138 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794140 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794143 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794145 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794147 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794150 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794153 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794155 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794158 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794160 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794163 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794166 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.794597 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794168 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794171 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794173 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794176 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794178 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794180 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794183 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794185 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794187 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794190 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794193 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794195 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794197 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794200 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794203 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794206 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794209 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794212 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794215 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794217 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.795097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794226 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794228 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794231 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794235 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794238 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794240 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794244 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794248 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794250 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794253 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794255 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794260 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794262 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794265 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794267 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794270 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794272 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794276 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794279 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.795557 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794284 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794287 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794289 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794292 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794295 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794298 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794300 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794303 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794306 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794309 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794311 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794314 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794316 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794319 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794321 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794324 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794327 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794329 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794332 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794334 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.796014 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794687 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794691 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794694 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794697 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794700 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794702 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794705 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794708 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794711 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794714 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794716 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794719 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794722 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794725 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794727 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794730 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794732 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794735 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794738 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.796474 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794741 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794743 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794746 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794748 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794751 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794754 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794756 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794758 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794761 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794763 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794767 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794770 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794773 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794776 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794779 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794782 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794784 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794786 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794789 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.796926 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794792 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794794 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794797 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794799 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794802 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794804 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794807 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794810 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794813 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794815 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794818 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794820 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794823 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794825 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794827 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794830 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794832 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794835 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794837 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794839 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.797374 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794842 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794847 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794849 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794852 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794855 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794858 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794860 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794863 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794865 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794868 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794870 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794873 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794876 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794878 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794880 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794883 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794885 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794888 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794891 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794893 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.797835 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794896 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794898 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794901 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794903 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794906 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794908 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794911 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794913 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794935 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794938 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794941 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794944 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794947 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794951 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794954 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794956 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794959 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794961 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794964 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.798323 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794968 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.794972 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795038 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795045 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795051 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795056 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795060 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795063 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795068 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795072 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795075 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795078 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795081 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795084 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795087 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795090 2585 flags.go:64] FLAG: --cgroup-root="" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795093 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795096 2585 flags.go:64] FLAG: --client-ca-file="" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795099 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795102 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795106 2585 flags.go:64] FLAG: --cluster-domain="" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795109 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795112 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 21:09:38.798876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795115 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795118 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795122 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795126 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795129 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795132 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795135 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795138 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795141 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795144 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795147 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795151 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795155 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795157 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795160 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795164 2585 flags.go:64] FLAG: --enable-server="true" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795167 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795172 2585 flags.go:64] FLAG: --event-burst="100" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795175 2585 flags.go:64] FLAG: --event-qps="50" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795178 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795181 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795183 2585 flags.go:64] FLAG: --eviction-hard="" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795187 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795190 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795192 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 21:09:38.799414 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795195 2585 flags.go:64] FLAG: --eviction-soft="" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795198 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795201 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795204 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795207 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795210 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795212 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795215 2585 flags.go:64] FLAG: --feature-gates="" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795219 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795222 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795225 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795228 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795231 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795234 2585 flags.go:64] FLAG: --help="false" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795237 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-143-128.ec2.internal" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795240 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795243 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795246 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795249 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795252 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795255 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795258 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795260 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 21:09:38.799989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795266 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795270 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795273 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795276 2585 flags.go:64] FLAG: --kube-reserved="" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795279 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795282 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795285 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795288 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795290 2585 flags.go:64] FLAG: --lock-file="" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795293 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795296 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795299 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795304 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795306 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795309 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795312 2585 flags.go:64] FLAG: --logging-format="text" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795315 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795318 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795321 2585 flags.go:64] FLAG: --manifest-url="" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795324 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795328 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795331 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795334 2585 flags.go:64] FLAG: --max-pods="110" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795337 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795340 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 21:09:38.800581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795343 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795346 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795349 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795352 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795354 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795362 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795365 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795369 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795372 2585 flags.go:64] FLAG: --pod-cidr="" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795375 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795381 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795384 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795387 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795390 2585 flags.go:64] FLAG: --port="10250" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795393 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795396 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c58c820b12b3989" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795399 2585 flags.go:64] FLAG: --qos-reserved="" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795402 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795404 2585 flags.go:64] FLAG: --register-node="true" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795407 2585 flags.go:64] FLAG: --register-with-taints="" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795411 2585 flags.go:64] FLAG: --registry-burst="10" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795414 2585 flags.go:64] FLAG: --registry-qps="5" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795416 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795419 2585 flags.go:64] FLAG: --reserved-memory="" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795422 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 21:09:38.801174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795425 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795429 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795432 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795435 2585 flags.go:64] FLAG: --runonce="false" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795437 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795440 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795443 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795446 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795449 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795452 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795455 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795458 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795460 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795463 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795466 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795470 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795473 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795476 2585 flags.go:64] FLAG: --system-cgroups="" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795479 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795484 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795487 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795490 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795494 2585 flags.go:64] FLAG: --tls-min-version="" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795496 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795501 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 21:09:38.801731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795503 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795506 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795509 2585 flags.go:64] FLAG: --v="2" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795513 2585 flags.go:64] FLAG: --version="false" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795517 2585 flags.go:64] FLAG: --vmodule="" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795520 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.795524 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795642 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795646 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795649 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795652 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795655 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795657 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795659 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795662 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795665 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795667 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795669 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795672 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795674 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795677 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.802333 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795680 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795684 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795686 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795689 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795692 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795695 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795697 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795701 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795704 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795707 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795711 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795714 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795716 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795719 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795721 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795724 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795726 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795729 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795731 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.802820 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795733 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795736 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795738 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795741 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795744 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795746 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795749 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795751 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795753 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795756 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795758 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795761 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795763 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795766 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795770 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795773 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795775 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795778 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795781 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795784 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.803281 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795786 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795790 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795794 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795798 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795801 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795803 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795807 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795814 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795817 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795820 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795823 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795825 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795828 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795830 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795833 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795835 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795838 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795840 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795843 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.803818 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795845 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795848 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795850 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795852 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795855 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795857 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795860 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795863 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795866 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795868 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795871 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795874 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795877 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795879 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795882 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795884 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795889 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795892 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795894 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795897 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.804691 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795900 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795902 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795905 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795907 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795910 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795912 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.795927 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.796479 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.802826 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.802841 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.803447 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.803454 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803513 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803518 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.805192 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803521 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803525 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803528 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803531 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803533 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803536 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803539 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803542 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803545 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803547 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803551 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803555 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803558 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803560 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803563 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803566 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803568 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803571 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803574 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.805681 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803576 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803579 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803581 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803584 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803587 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803590 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803592 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803595 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803637 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803681 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803685 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803688 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803691 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803694 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803697 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803700 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803703 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803706 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803709 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.806184 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803714 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803718 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803721 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803727 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803729 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803732 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803735 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803738 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803741 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803744 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803746 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803749 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803752 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803755 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803757 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.803763 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805388 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805583 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805590 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805593 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.806630 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805596 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805600 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805604 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805608 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805611 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805614 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805617 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805619 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805623 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805626 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805628 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805631 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805634 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805636 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805639 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805642 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805644 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805649 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805653 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.807113 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805656 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805659 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805663 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805665 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805668 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805670 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805674 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805677 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805679 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805682 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805686 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805688 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805691 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805694 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805698 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805700 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805704 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805706 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805709 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.807538 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805712 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.805717 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805837 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805842 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805845 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805848 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805850 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805853 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805855 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805858 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805860 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805863 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805865 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805869 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.808003 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805873 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805876 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805878 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805881 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805884 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805887 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805889 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805891 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805894 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805897 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805900 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805903 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805905 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805908 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805910 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805913 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805931 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805935 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805937 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805940 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.808343 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805942 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805945 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805948 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805950 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805953 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805955 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805958 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805960 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805963 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805965 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805968 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805971 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805973 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805978 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805980 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805983 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805985 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805988 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805990 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805992 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.808824 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805995 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.805998 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806001 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806004 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806007 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806011 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806014 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806016 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806019 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806021 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806024 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806026 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806029 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806032 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806034 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806036 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806039 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806041 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806044 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806046 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.809415 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806048 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806051 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806053 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806056 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806058 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806062 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806067 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806070 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806073 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806075 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806078 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806080 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806084 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806086 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806089 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806091 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806094 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806096 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806099 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.809878 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806102 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806104 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806107 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806109 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806112 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806115 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806117 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:38.806120 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.806125 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.806252 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.808216 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 21:09:38.810355 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.810248 2585 server.go:1019] "Starting client certificate rotation" Jul 15 21:09:38.810621 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.810351 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:09:38.810621 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.810394 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:09:38.813350 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.813336 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:09:38.814519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.814489 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:09:38.822041 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.822024 2585 log.go:25] "Validated CRI v1 runtime API" Jul 15 21:09:38.824549 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.824534 2585 log.go:25] "Validated CRI v1 image API" Jul 15 21:09:38.825312 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.825299 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 21:09:38.828178 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.828158 2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8b177ab4-d9eb-4523-b008-3cf46310590e:/dev/nvme0n1p3 cda2b45c-81a2-46ae-9f12-f0a32ad592cd:/dev/nvme0n1p4] Jul 15 21:09:38.828255 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.828182 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 21:09:38.834693 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.834587 2585 manager.go:216] Machine: {Timestamp:2026-07-15 21:09:38.833464565 +0000 UTC m=+0.314449148 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199620 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c9556d98068201907c59af4f7062 SystemUUID:ec22c955-6d98-0682-0190-7c59af4f7062 BootID:3e61684f-3d31-4c6f-b56a-c35424ea259f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:16:3f:61:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:16:3f:61:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:af:a4:6a:13:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 21:09:38.834693 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.834688 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 21:09:38.834815 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.834771 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 21:09:38.837672 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.837647 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 21:09:38.837806 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.837674 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 21:09:38.838896 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.838883 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 21:09:38.838963 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.838898 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 21:09:38.838963 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.838906 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:09:38.839533 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.839522 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:09:38.840338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.840329 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 21:09:38.843767 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843755 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:09:38.843885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843875 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 21:09:38.843927 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843905 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 15 21:09:38.843954 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843928 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 21:09:38.843954 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843941 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 21:09:38.843954 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843950 2585 kubelet.go:398] "Adding apiserver pod source" Jul 15 21:09:38.844046 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.843958 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 21:09:38.846776 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.846747 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:09:38.846870 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.846814 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:09:38.846870 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.846852 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:09:38.850204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.850184 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 21:09:38.852298 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852284 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 21:09:38.852344 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852315 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 21:09:38.852869 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852859 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 21:09:38.852909 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852875 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 21:09:38.852909 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852881 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 21:09:38.852909 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852886 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 21:09:38.852909 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852895 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 21:09:38.852909 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852903 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 21:09:38.853052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852956 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 21:09:38.853052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852963 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 21:09:38.853052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852970 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 21:09:38.853052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852975 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 21:09:38.853052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852983 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 21:09:38.853052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.852990 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 21:09:38.853752 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.853743 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 21:09:38.853780 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.853752 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 21:09:38.857083 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.857070 2585 server.go:1268] "Started kubelet" Jul 15 21:09:38.857169 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.857140 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 21:09:38.857270 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.857225 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 21:09:38.857314 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.857295 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 21:09:38.858534 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.858511 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 21:09:38.858534 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.858518 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 21:09:38.858681 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.858645 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 21:09:38.858878 ip-10-0-143-128 systemd[1]: Started Kubernetes Kubelet. Jul 15 21:09:38.859876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.859820 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 15 21:09:38.861643 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.861629 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 21:09:38.862268 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.862240 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 21:09:38.864974 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.864018 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c562ddaca9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.857045161 +0000 UTC m=+0.338029742,LastTimestamp:2026-07-15 21:09:38.857045161 +0000 UTC m=+0.338029742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.866826 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.866812 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 21:09:38.866903 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.866824 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 21:09:38.866985 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.866941 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:38.867380 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867363 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 21:09:38.867380 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867365 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 21:09:38.867505 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867400 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 21:09:38.867555 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867506 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 15 21:09:38.867555 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867515 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 15 21:09:38.867624 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867616 2585 factory.go:55] Registering systemd factory Jul 15 21:09:38.867668 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867632 2585 factory.go:223] Registration of the systemd container factory successfully Jul 15 21:09:38.867873 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867846 2585 factory.go:153] Registering CRI-O factory Jul 15 21:09:38.867873 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867862 2585 factory.go:223] Registration of the crio container factory successfully Jul 15 21:09:38.868002 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867909 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 21:09:38.868002 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867954 2585 factory.go:103] Registering Raw factory Jul 15 21:09:38.868002 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.867965 2585 manager.go:1196] Started watching for new ooms in manager Jul 15 21:09:38.868322 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.868312 2585 manager.go:349] Starting recovery of all containers Jul 15 21:09:38.869097 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.869070 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 21:09:38.869206 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.869185 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 21:09:38.880245 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.880038 2585 manager.go:354] Recovery completed Jul 15 21:09:38.884686 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.884673 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.887400 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887385 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.887452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887414 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.887452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887424 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.887882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887869 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 21:09:38.887934 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887883 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 21:09:38.887934 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887900 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:09:38.887998 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.887940 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.888646 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.888628 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.888701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.888661 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.888701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.888674 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.889211 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.889198 2585 policy_none.go:49] "None policy: Start" Jul 15 21:09:38.889256 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.889214 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 21:09:38.889256 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.889223 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 21:09:38.890260 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.890249 2585 policy_none.go:47] "Start" Jul 15 21:09:38.896718 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.896653 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c564acde5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.887401052 +0000 UTC m=+0.368385634,LastTimestamp:2026-07-15 21:09:38.887401052 +0000 UTC m=+0.368385634,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.902009 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.901910 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c564ad22df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-128.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.887418591 +0000 UTC m=+0.368403173,LastTimestamp:2026-07-15 21:09:38.887418591 +0000 UTC m=+0.368403173,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.911244 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.911066 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c564ad46f2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-128.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.887427826 +0000 UTC m=+0.368412408,LastTimestamp:2026-07-15 21:09:38.887427826 +0000 UTC m=+0.368412408,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.911564 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.911551 2585 manager.go:337] "Starting Device Plugin manager" Jul 15 21:09:38.911629 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.911584 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 21:09:38.911629 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.911594 2585 server.go:87] "Starting device plugin registration server" Jul 15 21:09:38.911890 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.911879 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 21:09:38.911957 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.911893 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 21:09:38.912073 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.912056 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 21:09:38.912157 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.912147 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 21:09:38.912157 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.912156 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 21:09:38.912481 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.912463 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 21:09:38.912562 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.912508 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:38.917577 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.917515 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-128.ec2.internal.18c292c564acde5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c564acde5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.887401052 +0000 UTC m=+0.368385634,LastTimestamp:2026-07-15 21:09:38.888645948 +0000 UTC m=+0.369630530,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.921725 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.921666 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-128.ec2.internal.18c292c564ad22df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c564ad22df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-128.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.887418591 +0000 UTC m=+0.368403173,LastTimestamp:2026-07-15 21:09:38.888667191 +0000 UTC m=+0.369651773,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.929857 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.929792 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-128.ec2.internal.18c292c564ad46f2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c564ad46f2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-128.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.887427826 +0000 UTC m=+0.368412408,LastTimestamp:2026-07-15 21:09:38.88867773 +0000 UTC m=+0.369662312,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.936892 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.936876 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cz4lv" Jul 15 21:09:38.938312 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.938250 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-128.ec2.internal.18c292c5663ddbb4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-128.ec2.internal,UID:ip-10-0-143-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-128.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.913680308 +0000 UTC m=+0.394664877,LastTimestamp:2026-07-15 21:09:38.913680308 +0000 UTC m=+0.394664877,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-128.ec2.internal,}" Jul 15 21:09:38.943381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.943367 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cz4lv" Jul 15 21:09:38.966794 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.966766 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 21:09:38.968244 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.967987 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 21:09:38.968244 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.968022 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 21:09:38.968244 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.968042 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 21:09:38.968244 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:38.968080 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 21:09:38.979617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:38.979597 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:39.012617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.012588 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.013546 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.013527 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.013660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.013558 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.013660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.013569 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.013660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.013598 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.021565 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.021550 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.021628 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.021571 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-128.ec2.internal\": node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.051090 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.051031 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.068253 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.068230 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal"] Jul 15 21:09:39.068358 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.068294 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.069770 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.069756 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.069863 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.069783 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.069863 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.069795 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.071042 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071030 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.071152 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071139 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.071204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071164 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.071752 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071734 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.071815 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071762 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.071815 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071774 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.071815 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071733 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.071815 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071804 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.071941 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.071839 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.073179 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.073165 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.073245 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.073188 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.074050 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.074036 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.074131 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.074066 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.074131 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.074080 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.097817 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.097791 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-128.ec2.internal\" not found" node="ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.102413 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.102397 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-128.ec2.internal\" not found" node="ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.151376 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.151349 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.169037 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.169012 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d67cc09bca3a51fc2ee79da725a2e413-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal\" (UID: \"d67cc09bca3a51fc2ee79da725a2e413\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.169154 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.169058 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67cc09bca3a51fc2ee79da725a2e413-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal\" (UID: \"d67cc09bca3a51fc2ee79da725a2e413\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.169154 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.169079 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6ebf78244e31eb2ee166dc2b9cbb9a6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-128.ec2.internal\" (UID: \"d6ebf78244e31eb2ee166dc2b9cbb9a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.252708 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.252667 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.269899 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.269879 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d67cc09bca3a51fc2ee79da725a2e413-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal\" (UID: \"d67cc09bca3a51fc2ee79da725a2e413\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.270016 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.269905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67cc09bca3a51fc2ee79da725a2e413-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal\" (UID: \"d67cc09bca3a51fc2ee79da725a2e413\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.270016 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.269925 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6ebf78244e31eb2ee166dc2b9cbb9a6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-128.ec2.internal\" (UID: \"d6ebf78244e31eb2ee166dc2b9cbb9a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.270016 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.269976 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d67cc09bca3a51fc2ee79da725a2e413-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal\" (UID: \"d67cc09bca3a51fc2ee79da725a2e413\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.270016 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.269994 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67cc09bca3a51fc2ee79da725a2e413-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal\" (UID: \"d67cc09bca3a51fc2ee79da725a2e413\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.270016 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.269986 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6ebf78244e31eb2ee166dc2b9cbb9a6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-128.ec2.internal\" (UID: \"d6ebf78244e31eb2ee166dc2b9cbb9a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.353521 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.353456 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.400831 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.400786 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.405101 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.405079 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.453880 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.453853 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.556204 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.556163 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.661778 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.661697 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.763858 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.763817 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.810222 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.810170 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 21:09:39.810709 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.810357 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:09:39.864186 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:39.864156 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-128.ec2.internal\" not found" Jul 15 21:09:39.886935 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.886891 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:39.947598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.947544 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:04:39 +0000 UTC" deadline="2028-03-01 16:10:34.294973121 +0000 UTC" Jul 15 21:09:39.947598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.947595 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14275h0m54.34738201s" Jul 15 21:09:39.967219 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.967194 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.980460 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.980436 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:09:39.981869 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.981854 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" Jul 15 21:09:39.998291 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:39.998263 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:09:40.030686 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:40.030642 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ebf78244e31eb2ee166dc2b9cbb9a6.slice/crio-d67915c849d19577713b7830d4dbd2c45dae44f3fdf96085952ef84366bdcf5d WatchSource:0}: Error finding container d67915c849d19577713b7830d4dbd2c45dae44f3fdf96085952ef84366bdcf5d: Status 404 returned error can't find the container with id d67915c849d19577713b7830d4dbd2c45dae44f3fdf96085952ef84366bdcf5d Jul 15 21:09:40.036156 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.036132 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:09:40.055810 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:40.055785 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67cc09bca3a51fc2ee79da725a2e413.slice/crio-4405722be6e7a8ee43f88ea305491463c30e3de73b7533a766f93da2c464d633 WatchSource:0}: Error finding container 4405722be6e7a8ee43f88ea305491463c30e3de73b7533a766f93da2c464d633: Status 404 returned error can't find the container with id 4405722be6e7a8ee43f88ea305491463c30e3de73b7533a766f93da2c464d633 Jul 15 21:09:40.304252 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.304171 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.448668 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.448637 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.846851 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.846820 2585 apiserver.go:52] "Watching apiserver" Jul 15 21:09:40.855949 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.855923 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 21:09:40.858429 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.858283 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qhd58","openshift-multus/multus-zf82r","openshift-network-diagnostics/network-check-target-nw4qk","kube-system/konnectivity-agent-ls562","openshift-cluster-node-tuning-operator/tuned-chsgk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal","openshift-multus/multus-additional-cni-plugins-cblrj","openshift-multus/network-metrics-daemon-29vkv","openshift-network-operator/iptables-alerter-2l8n5","openshift-ovn-kubernetes/ovnkube-node-rj4gw","kube-system/global-pull-secret-syncer-p6dbj","kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5","openshift-dns/node-resolver-h2cc2"] Jul 15 21:09:40.860863 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.860803 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.862148 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.862128 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.864319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.863504 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:40.864319 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.863595 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:40.864319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.864286 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.864637 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.864586 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.864790 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.864977 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.865278 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rw9s\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.865491 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qkls\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.865667 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.865890 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.865951 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.866064 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.866174 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.867266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.866187 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.871106 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.870018 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 21:09:40.874310 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.874289 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 21:09:40.874968 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.874950 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.875353 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.875331 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ph6wg\"" Jul 15 21:09:40.875621 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.875601 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.875708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.875682 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zffpx\"" Jul 15 21:09:40.875891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.875873 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 21:09:40.875972 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.875947 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.877383 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.877325 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.878052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878009 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysctl-conf\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878162 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878063 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b522dab5-f255-453f-9046-df0f7289bfbd-tmp\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878162 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878102 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysctl-d\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878162 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878149 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-cnibin\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.878313 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878181 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04181f0e-be35-4d39-9bd3-e20917b0dced-hosts-file\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.878313 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.878408 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878326 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-modprobe-d\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878408 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-run\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878427 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-sys\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878455 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-iptables-alerter-script\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.878519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878471 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m4nw6\"" Jul 15 21:09:40.878665 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s87xl\" (UniqueName: \"kubernetes.io/projected/04181f0e-be35-4d39-9bd3-e20917b0dced-kube-api-access-s87xl\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.878665 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878573 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-kubernetes\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878665 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.878665 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878656 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.878858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878688 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-systemd\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878716 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-lib-modules\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-var-lib-kubelet\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878808 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b522dab5-f255-453f-9046-df0f7289bfbd-etc-tuned\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.878858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878838 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfllm\" (UniqueName: \"kubernetes.io/projected/b522dab5-f255-453f-9046-df0f7289bfbd-kube-api-access-rfllm\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878864 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-host-slash\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878892 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrqj\" (UniqueName: \"kubernetes.io/projected/23e73a80-0668-4672-a72e-9952c9bc54c7-kube-api-access-znrqj\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878922 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878953 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/408ef609-eb1d-4f43-8736-92e7b08d6232-agent-certs\") pod \"konnectivity-agent-ls562\" (UID: \"408ef609-eb1d-4f43-8736-92e7b08d6232\") " pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878974 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/408ef609-eb1d-4f43-8736-92e7b08d6232-konnectivity-ca\") pod \"konnectivity-agent-ls562\" (UID: \"408ef609-eb1d-4f43-8736-92e7b08d6232\") " pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.878984 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879018 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-host\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.879116 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879098 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysconfig\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04181f0e-be35-4d39-9bd3-e20917b0dced-tmp-dir\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879164 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-registration-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879191 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-device-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879222 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-etc-selinux\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879258 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbt4k\" (UniqueName: \"kubernetes.io/projected/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-kube-api-access-mbt4k\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879291 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-socket-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879324 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-system-cni-dir\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-os-release\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879384 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879420 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879455 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-sys-fs\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.879486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879484 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzp2w\" (UniqueName: \"kubernetes.io/projected/b5b13008-0555-4902-9685-52dfb9a96645-kube-api-access-kzp2w\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.880075 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879535 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.880075 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.879833 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.880225 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.880174 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:40.881032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.880323 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kx7c6\"" Jul 15 21:09:40.881032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.880502 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 21:09:40.881032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.880740 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.881032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.880951 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.885787 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885058 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.885787 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885272 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.885787 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885307 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7xmwc\"" Jul 15 21:09:40.885787 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885553 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 21:09:40.885787 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885577 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jxgr8\"" Jul 15 21:09:40.885787 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885787 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 21:09:40.886178 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.885833 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.887257 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.887069 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:09:40.887360 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.887327 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:40.887419 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.887399 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:40.888578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.888558 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.888811 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.888792 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:40.888889 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.888826 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9t7tk\"" Jul 15 21:09:40.888889 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.888858 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:40.889468 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.889393 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 21:09:40.889894 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.889637 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 21:09:40.889894 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.889663 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.889894 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.889782 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 21:09:40.890170 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.889971 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 21:09:40.908168 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.908147 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlf7h" Jul 15 21:09:40.917775 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.917275 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlf7h" Jul 15 21:09:40.968242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.968221 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 21:09:40.973124 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.973046 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" event={"ID":"d67cc09bca3a51fc2ee79da725a2e413","Type":"ContainerStarted","Data":"4405722be6e7a8ee43f88ea305491463c30e3de73b7533a766f93da2c464d633"} Jul 15 21:09:40.974419 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.974391 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" event={"ID":"d6ebf78244e31eb2ee166dc2b9cbb9a6","Type":"ContainerStarted","Data":"d67915c849d19577713b7830d4dbd2c45dae44f3fdf96085952ef84366bdcf5d"} Jul 15 21:09:40.980174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980143 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-cni-netd\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.980277 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980187 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c41e79-cec5-40d5-bbca-a17336584fd1-cni-binary-copy\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.980277 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980221 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-sys-fs\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.980277 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980255 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzp2w\" (UniqueName: \"kubernetes.io/projected/b5b13008-0555-4902-9685-52dfb9a96645-kube-api-access-kzp2w\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.980427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980287 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-kubelet\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.980427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980369 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-sys-fs\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.980427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980417 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6r8w\" (UniqueName: \"kubernetes.io/projected/42736aec-8772-4ff4-8842-a5bbda681d0d-kube-api-access-t6r8w\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.980570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980464 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59dcaa4d-edab-4b62-8d52-e77f680454fa-kubelet-config\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:40.980570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980490 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04181f0e-be35-4d39-9bd3-e20917b0dced-hosts-file\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.980570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980518 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-modprobe-d\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.980570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980542 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-run\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.980570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980567 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-cnibin\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-netns\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980594 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04181f0e-be35-4d39-9bd3-e20917b0dced-hosts-file\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980618 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-cni-multus\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980645 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980649 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-modprobe-d\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980671 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980695 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-systemd\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980720 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b522dab5-f255-453f-9046-df0f7289bfbd-etc-tuned\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfllm\" (UniqueName: \"kubernetes.io/projected/b522dab5-f255-453f-9046-df0f7289bfbd-kube-api-access-rfllm\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.980805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980752 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-run\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980815 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-system-cni-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980831 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-cni-bin\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980846 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-hostroot\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980875 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980891 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/408ef609-eb1d-4f43-8736-92e7b08d6232-konnectivity-ca\") pod \"konnectivity-agent-ls562\" (UID: \"408ef609-eb1d-4f43-8736-92e7b08d6232\") " pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-host\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980922 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-node-log\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980938 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.980982 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-ovnkube-script-lib\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981010 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-daemon-config\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysconfig\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981044 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-registration-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981063 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-device-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-serviceca\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981092 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-ovnkube-config\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981106 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-env-overrides\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.981319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981105 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gps\" (UniqueName: \"kubernetes.io/projected/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-kube-api-access-m7gps\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-host\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981213 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-run-netns\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-system-cni-dir\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981246 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-os-release\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff2n9\" (UniqueName: \"kubernetes.io/projected/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-kube-api-access-ff2n9\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981286 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-slash\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981300 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-systemd\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981317 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981390 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-registration-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981427 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysctl-conf\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b522dab5-f255-453f-9046-df0f7289bfbd-tmp\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981500 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-var-lib-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981528 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981559 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysctl-d\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-cnibin\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.982247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981650 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981675 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-sys\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981704 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-iptables-alerter-script\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981731 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42736aec-8772-4ff4-8842-a5bbda681d0d-ovn-node-metrics-cert\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981758 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-socket-dir-parent\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981772 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981777 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-conf-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981818 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s87xl\" (UniqueName: \"kubernetes.io/projected/04181f0e-be35-4d39-9bd3-e20917b0dced-kube-api-access-s87xl\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981937 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-kubernetes\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981949 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysconfig\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.981984 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-systemd-units\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982016 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-kubernetes\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982017 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysctl-conf\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982043 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-ovn\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982083 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-host\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982080 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.983158 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982154 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-sysctl-d\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982157 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-multus-certs\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982195 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-device-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982193 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkqwl\" (UniqueName: \"kubernetes.io/projected/98c41e79-cec5-40d5-bbca-a17336584fd1-kube-api-access-bkqwl\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982230 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-etc-systemd\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982277 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-system-cni-dir\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982289 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982375 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59dcaa4d-edab-4b62-8d52-e77f680454fa-dbus\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982413 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-lib-modules\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982446 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-var-lib-kubelet\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-host-slash\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982514 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-k8s-cni-cncf-io\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982547 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-etc-kubernetes\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982609 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982640 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znrqj\" (UniqueName: \"kubernetes.io/projected/23e73a80-0668-4672-a72e-9952c9bc54c7-kube-api-access-znrqj\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982668 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/408ef609-eb1d-4f43-8736-92e7b08d6232-agent-certs\") pod \"konnectivity-agent-ls562\" (UID: \"408ef609-eb1d-4f43-8736-92e7b08d6232\") " pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982694 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04181f0e-be35-4d39-9bd3-e20917b0dced-tmp-dir\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.983946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982719 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-etc-selinux\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982751 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbt4k\" (UniqueName: \"kubernetes.io/projected/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-kube-api-access-mbt4k\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982771 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-os-release\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982779 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-log-socket\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982831 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-cni-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982858 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-os-release\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/408ef609-eb1d-4f43-8736-92e7b08d6232-konnectivity-ca\") pod \"konnectivity-agent-ls562\" (UID: \"408ef609-eb1d-4f43-8736-92e7b08d6232\") " pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982887 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-sys\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982935 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-cnibin\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-var-lib-kubelet\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982967 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-kubelet\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.982981 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-host-slash\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983031 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-socket-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983067 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983107 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-etc-selinux\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983094 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-etc-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.984773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983609 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-cni-bin\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983731 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-iptables-alerter-script\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.983929 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5b13008-0555-4902-9685-52dfb9a96645-socket-dir\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.984076 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b522dab5-f255-453f-9046-df0f7289bfbd-lib-modules\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.984095 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23e73a80-0668-4672-a72e-9952c9bc54c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.984225 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23e73a80-0668-4672-a72e-9952c9bc54c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.985433 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b522dab5-f255-453f-9046-df0f7289bfbd-tmp\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.985550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.985525 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b522dab5-f255-453f-9046-df0f7289bfbd-etc-tuned\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.986009 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.985977 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04181f0e-be35-4d39-9bd3-e20917b0dced-tmp-dir\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.987033 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.986981 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:40.987125 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.987038 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:40.987125 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.987054 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.987223 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:40.987125 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.487103381 +0000 UTC m=+2.968087970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.992033 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.991607 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/408ef609-eb1d-4f43-8736-92e7b08d6232-agent-certs\") pod \"konnectivity-agent-ls562\" (UID: \"408ef609-eb1d-4f43-8736-92e7b08d6232\") " pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:40.992182 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.992158 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzp2w\" (UniqueName: \"kubernetes.io/projected/b5b13008-0555-4902-9685-52dfb9a96645-kube-api-access-kzp2w\") pod \"aws-ebs-csi-driver-node-plxf5\" (UID: \"b5b13008-0555-4902-9685-52dfb9a96645\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:40.993912 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.993315 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfllm\" (UniqueName: \"kubernetes.io/projected/b522dab5-f255-453f-9046-df0f7289bfbd-kube-api-access-rfllm\") pod \"tuned-chsgk\" (UID: \"b522dab5-f255-453f-9046-df0f7289bfbd\") " pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:40.994518 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.994475 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbt4k\" (UniqueName: \"kubernetes.io/projected/b7e4e2f2-d64d-47c4-b668-9db0dc59eef2-kube-api-access-mbt4k\") pod \"iptables-alerter-2l8n5\" (UID: \"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2\") " pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:40.994979 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.994959 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87xl\" (UniqueName: \"kubernetes.io/projected/04181f0e-be35-4d39-9bd3-e20917b0dced-kube-api-access-s87xl\") pod \"node-resolver-h2cc2\" (UID: \"04181f0e-be35-4d39-9bd3-e20917b0dced\") " pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:40.997352 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:40.997326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrqj\" (UniqueName: \"kubernetes.io/projected/23e73a80-0668-4672-a72e-9952c9bc54c7-kube-api-access-znrqj\") pod \"multus-additional-cni-plugins-cblrj\" (UID: \"23e73a80-0668-4672-a72e-9952c9bc54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:41.085021 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.084983 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-kubelet\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085021 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6r8w\" (UniqueName: \"kubernetes.io/projected/42736aec-8772-4ff4-8842-a5bbda681d0d-kube-api-access-t6r8w\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085058 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59dcaa4d-edab-4b62-8d52-e77f680454fa-kubelet-config\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085082 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-cnibin\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085101 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-netns\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085107 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-kubelet\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085118 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-cni-multus\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085154 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-system-cni-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085164 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-cni-multus\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085172 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-cni-bin\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085188 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-hostroot\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085228 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-node-log\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085246 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-ovnkube-script-lib\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-daemon-config\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085316 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-serviceca\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-ovnkube-config\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085348 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-env-overrides\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gps\" (UniqueName: \"kubernetes.io/projected/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-kube-api-access-m7gps\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085411 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59dcaa4d-edab-4b62-8d52-e77f680454fa-kubelet-config\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085438 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-host\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085457 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-run-netns\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2n9\" (UniqueName: \"kubernetes.io/projected/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-kube-api-access-ff2n9\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085504 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-slash\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-systemd\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085553 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-var-lib-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085570 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.085600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085599 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42736aec-8772-4ff4-8842-a5bbda681d0d-ovn-node-metrics-cert\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085615 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-system-cni-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-socket-dir-parent\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085655 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-conf-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085675 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-systemd-units\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085687 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-cnibin\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085695 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-ovn\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085725 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085755 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-multus-certs\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085763 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-var-lib-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085774 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-slash\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085804 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-cni-bin\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085873 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-host\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085942 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-run-netns\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086045 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-hostroot\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkqwl\" (UniqueName: \"kubernetes.io/projected/98c41e79-cec5-40d5-bbca-a17336584fd1-kube-api-access-bkqwl\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086103 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.086280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086111 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59dcaa4d-edab-4b62-8d52-e77f680454fa-dbus\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086145 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-k8s-cni-cncf-io\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086175 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-etc-kubernetes\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086204 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086236 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-log-socket\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085657 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-socket-dir-parent\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086078 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-node-log\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086338 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086421 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59dcaa4d-edab-4b62-8d52-e77f680454fa-dbus\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086465 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-k8s-cni-cncf-io\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086533 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-etc-kubernetes\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.086613 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.086712 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.586692286 +0000 UTC m=+3.067676863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086793 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-ovnkube-script-lib\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086803 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-serviceca\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.085729 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-systemd\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086881 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-multus-certs\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086900 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-systemd-units\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086920 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-log-socket\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086955 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-run-ovn\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086956 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-daemon-config\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086961 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-conf-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.086261 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.087058 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087073 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-cni-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.087103 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.587087169 +0000 UTC m=+3.068071742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087138 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-multus-cni-dir\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087144 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-os-release\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087175 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-kubelet\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087204 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-etc-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087207 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-os-release\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087231 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-cni-bin\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087255 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-cni-netd\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087258 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-var-lib-kubelet\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087272 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-etc-openvswitch\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.087840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087281 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c41e79-cec5-40d5-bbca-a17336584fd1-cni-binary-copy\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.088540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087300 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-cni-bin\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.088540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087314 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-ovnkube-config\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.088540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087363 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42736aec-8772-4ff4-8842-a5bbda681d0d-host-cni-netd\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.088540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087369 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42736aec-8772-4ff4-8842-a5bbda681d0d-env-overrides\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.088540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087422 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98c41e79-cec5-40d5-bbca-a17336584fd1-host-run-netns\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.088540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.087824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c41e79-cec5-40d5-bbca-a17336584fd1-cni-binary-copy\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.089082 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.089058 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42736aec-8772-4ff4-8842-a5bbda681d0d-ovn-node-metrics-cert\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.094859 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.094823 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6r8w\" (UniqueName: \"kubernetes.io/projected/42736aec-8772-4ff4-8842-a5bbda681d0d-kube-api-access-t6r8w\") pod \"ovnkube-node-rj4gw\" (UID: \"42736aec-8772-4ff4-8842-a5bbda681d0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.094997 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.094828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkqwl\" (UniqueName: \"kubernetes.io/projected/98c41e79-cec5-40d5-bbca-a17336584fd1-kube-api-access-bkqwl\") pod \"multus-zf82r\" (UID: \"98c41e79-cec5-40d5-bbca-a17336584fd1\") " pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.094997 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.094973 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gps\" (UniqueName: \"kubernetes.io/projected/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-kube-api-access-m7gps\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:41.096144 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.096113 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff2n9\" (UniqueName: \"kubernetes.io/projected/d2f49fea-779d-4c9a-9aa1-385ae3b5c812-kube-api-access-ff2n9\") pod \"node-ca-qhd58\" (UID: \"d2f49fea-779d-4c9a-9aa1-385ae3b5c812\") " pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.135678 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.135620 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:41.190212 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.190176 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cblrj" Jul 15 21:09:41.199093 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.199069 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" Jul 15 21:09:41.210171 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.210149 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ls562" Jul 15 21:09:41.216932 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.216911 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-chsgk" Jul 15 21:09:41.230766 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.230745 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h2cc2" Jul 15 21:09:41.238454 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.238434 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2l8n5" Jul 15 21:09:41.247344 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.247325 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zf82r" Jul 15 21:09:41.255005 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.254988 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qhd58" Jul 15 21:09:41.262920 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.262896 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:09:41.490886 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.490801 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:41.491063 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.490962 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:41.491063 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.490996 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:41.491063 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.491010 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:41.491183 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.491070 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:42.491054389 +0000 UTC m=+3.972038961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:41.591279 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.591242 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:41.591446 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.591286 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:41.591446 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.591398 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.591545 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.591459 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:09:42.591445059 +0000 UTC m=+4.072429630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.591545 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.591398 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.591545 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.591536 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:09:42.591522394 +0000 UTC m=+4.072506979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.919327 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.919244 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:04:41 +0000 UTC" deadline="2028-01-21 01:28:51.257544622 +0000 UTC" Jul 15 21:09:41.919327 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.919278 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13300h19m9.338269611s" Jul 15 21:09:41.968543 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:41.968513 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:41.968710 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:41.968655 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:42.081897 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.081845 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb522dab5_f255_453f_9046_df0f7289bfbd.slice/crio-9e6a043b618c71cdc6bd0dadcd059dbaa548bceaa98cf3f523f82e403f431edb WatchSource:0}: Error finding container 9e6a043b618c71cdc6bd0dadcd059dbaa548bceaa98cf3f523f82e403f431edb: Status 404 returned error can't find the container with id 9e6a043b618c71cdc6bd0dadcd059dbaa548bceaa98cf3f523f82e403f431edb Jul 15 21:09:42.082814 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.082755 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b13008_0555_4902_9685_52dfb9a96645.slice/crio-d91edd4b9a8bd68ea8615bd897237e23c89fe3dcb3a737aaf525dc36e23b2d2c WatchSource:0}: Error finding container d91edd4b9a8bd68ea8615bd897237e23c89fe3dcb3a737aaf525dc36e23b2d2c: Status 404 returned error can't find the container with id d91edd4b9a8bd68ea8615bd897237e23c89fe3dcb3a737aaf525dc36e23b2d2c Jul 15 21:09:42.084028 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.084005 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e73a80_0668_4672_a72e_9952c9bc54c7.slice/crio-d89c28390d32563fb6e04693a752d9888b8af72742981fc9bb58d981785a8a41 WatchSource:0}: Error finding container d89c28390d32563fb6e04693a752d9888b8af72742981fc9bb58d981785a8a41: Status 404 returned error can't find the container with id d89c28390d32563fb6e04693a752d9888b8af72742981fc9bb58d981785a8a41 Jul 15 21:09:42.084707 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.084667 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42736aec_8772_4ff4_8842_a5bbda681d0d.slice/crio-05a36102f9042c17e3e84772c742c715c2e6261a9f0824197800fafd16d3cb8f WatchSource:0}: Error finding container 05a36102f9042c17e3e84772c742c715c2e6261a9f0824197800fafd16d3cb8f: Status 404 returned error can't find the container with id 05a36102f9042c17e3e84772c742c715c2e6261a9f0824197800fafd16d3cb8f Jul 15 21:09:42.086380 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.086346 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e4e2f2_d64d_47c4_b668_9db0dc59eef2.slice/crio-e9cc6373e39e3703532dfab00a50a94c565e54054e0dcabcd6c0f645ac71018e WatchSource:0}: Error finding container e9cc6373e39e3703532dfab00a50a94c565e54054e0dcabcd6c0f645ac71018e: Status 404 returned error can't find the container with id e9cc6373e39e3703532dfab00a50a94c565e54054e0dcabcd6c0f645ac71018e Jul 15 21:09:42.087805 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.087779 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408ef609_eb1d_4f43_8736_92e7b08d6232.slice/crio-7c46f4978319fba8de4a5743fc87b15d7f6d3f9d63a4af9524fbdd18ef0b2954 WatchSource:0}: Error finding container 7c46f4978319fba8de4a5743fc87b15d7f6d3f9d63a4af9524fbdd18ef0b2954: Status 404 returned error can't find the container with id 7c46f4978319fba8de4a5743fc87b15d7f6d3f9d63a4af9524fbdd18ef0b2954 Jul 15 21:09:42.089251 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:09:42.089225 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c41e79_cec5_40d5_bbca_a17336584fd1.slice/crio-0212f3ad09f99aa32cd40b10344fa47f030feb49d0038caf5715bb0822f88fae WatchSource:0}: Error finding container 0212f3ad09f99aa32cd40b10344fa47f030feb49d0038caf5715bb0822f88fae: Status 404 returned error can't find the container with id 0212f3ad09f99aa32cd40b10344fa47f030feb49d0038caf5715bb0822f88fae Jul 15 21:09:42.499330 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.499123 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:42.499464 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.499294 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:42.499464 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.499421 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:42.499464 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.499433 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:42.499582 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.499482 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:44.499468127 +0000 UTC m=+5.980452698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:42.600920 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.600797 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:42.600920 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.600858 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:42.601149 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.601011 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:42.601149 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.601078 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:09:44.601057944 +0000 UTC m=+6.082042528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:42.601612 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.601495 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:42.601612 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.601554 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:09:44.601537279 +0000 UTC m=+6.082521852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:42.920487 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.920373 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:04:41 +0000 UTC" deadline="2028-04-07 08:42:29.138687352 +0000 UTC" Jul 15 21:09:42.920487 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.920438 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15155h32m46.218253335s" Jul 15 21:09:42.969649 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.969125 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:42.969649 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.969261 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:42.970111 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.969962 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:42.970111 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:42.970069 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:42.992882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:42.992806 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" event={"ID":"b5b13008-0555-4902-9685-52dfb9a96645","Type":"ContainerStarted","Data":"d91edd4b9a8bd68ea8615bd897237e23c89fe3dcb3a737aaf525dc36e23b2d2c"} Jul 15 21:09:43.014309 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.014275 2585 generic.go:356] "Generic (PLEG): container finished" podID="d67cc09bca3a51fc2ee79da725a2e413" containerID="aa6a9ecc1bfdf97e4947780109ef3042369f8a35e3109b092378cfff394971b1" exitCode=0 Jul 15 21:09:43.014482 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.014425 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" event={"ID":"d67cc09bca3a51fc2ee79da725a2e413","Type":"ContainerDied","Data":"aa6a9ecc1bfdf97e4947780109ef3042369f8a35e3109b092378cfff394971b1"} Jul 15 21:09:43.024331 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.024300 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"05a36102f9042c17e3e84772c742c715c2e6261a9f0824197800fafd16d3cb8f"} Jul 15 21:09:43.046541 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.046504 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerStarted","Data":"d89c28390d32563fb6e04693a752d9888b8af72742981fc9bb58d981785a8a41"} Jul 15 21:09:43.065177 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.065137 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2l8n5" event={"ID":"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2","Type":"ContainerStarted","Data":"e9cc6373e39e3703532dfab00a50a94c565e54054e0dcabcd6c0f645ac71018e"} Jul 15 21:09:43.073227 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.072899 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-chsgk" event={"ID":"b522dab5-f255-453f-9046-df0f7289bfbd","Type":"ContainerStarted","Data":"9e6a043b618c71cdc6bd0dadcd059dbaa548bceaa98cf3f523f82e403f431edb"} Jul 15 21:09:43.094702 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.094658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qhd58" event={"ID":"d2f49fea-779d-4c9a-9aa1-385ae3b5c812","Type":"ContainerStarted","Data":"54628bba42ba082754bddf4dc23c496680601c9dc25156f5bb70da565728d558"} Jul 15 21:09:43.104909 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.104852 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h2cc2" event={"ID":"04181f0e-be35-4d39-9bd3-e20917b0dced","Type":"ContainerStarted","Data":"991d1d4c43e9e6ab1a42a38a5a4a646c498a8db3a908e9cd3804e632e7f159d2"} Jul 15 21:09:43.137525 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.137453 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" event={"ID":"d6ebf78244e31eb2ee166dc2b9cbb9a6","Type":"ContainerStarted","Data":"25f80e0a994a33a1e873dd862ae44807be1d7484f11aacb6d2eae8f0631be163"} Jul 15 21:09:43.151519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.151453 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zf82r" event={"ID":"98c41e79-cec5-40d5-bbca-a17336584fd1","Type":"ContainerStarted","Data":"0212f3ad09f99aa32cd40b10344fa47f030feb49d0038caf5715bb0822f88fae"} Jul 15 21:09:43.156108 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.155656 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-128.ec2.internal" podStartSLOduration=3.155642527 podStartE2EDuration="3.155642527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:43.155109592 +0000 UTC m=+4.636094186" watchObservedRunningTime="2026-07-15 21:09:43.155642527 +0000 UTC m=+4.636627121" Jul 15 21:09:43.180242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.180206 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ls562" event={"ID":"408ef609-eb1d-4f43-8736-92e7b08d6232","Type":"ContainerStarted","Data":"7c46f4978319fba8de4a5743fc87b15d7f6d3f9d63a4af9524fbdd18ef0b2954"} Jul 15 21:09:43.969293 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:43.969247 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:43.969793 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:43.969398 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:44.204085 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:44.204009 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" event={"ID":"d67cc09bca3a51fc2ee79da725a2e413","Type":"ContainerStarted","Data":"2a434efcce57e9541a212d12e99115199e76215d99d8298e185856791ee8150b"} Jul 15 21:09:44.516369 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:44.516274 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:44.516594 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.516500 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:44.516594 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.516522 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:44.516594 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.516534 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:44.516761 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.516600 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:48.516578655 +0000 UTC m=+9.997563229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:44.617087 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:44.617043 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:44.617259 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:44.617107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:44.617328 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.617307 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:44.617392 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.617377 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:09:48.617356414 +0000 UTC m=+10.098341000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:44.617819 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.617796 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:44.617917 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.617857 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:09:48.617840609 +0000 UTC m=+10.098825185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:44.968587 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:44.968505 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:44.968824 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.968653 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:44.968824 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:44.968684 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:44.968824 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:44.968812 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:45.969267 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:45.969234 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:45.969752 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:45.969355 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:46.968896 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:46.968825 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:46.969070 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:46.968984 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:46.969356 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:46.969333 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:46.969717 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:46.969432 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:47.968325 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:47.968288 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:47.968489 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:47.968431 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:48.551984 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:48.551826 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:48.552443 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.552023 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:48.552443 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.552047 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:48.552443 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.552060 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:48.552443 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.552126 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:56.552106574 +0000 UTC m=+18.033091160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:48.652496 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:48.652454 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:48.652668 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:48.652505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:48.652668 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.652623 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:48.652795 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.652677 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:09:56.652663268 +0000 UTC m=+18.133647842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:48.652795 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.652623 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:48.652795 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.652716 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:09:56.652708034 +0000 UTC m=+18.133692607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:48.969901 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:48.969828 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:48.970061 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.969962 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:48.970389 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:48.970367 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:48.970478 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:48.970458 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:49.968581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:49.968542 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:49.969035 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:49.968687 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:50.969637 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:50.969007 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:50.969637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:50.969132 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:50.969637 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:50.969505 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:50.969637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:50.969591 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:51.968943 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:51.968900 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:51.969110 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:51.969033 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:52.968729 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:52.968697 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:52.969097 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:52.968818 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:52.969097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:52.968855 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:52.969097 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:52.968936 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:53.968690 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:53.968650 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:53.968879 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:53.968784 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:54.969000 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:54.968968 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:54.969437 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:54.969098 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:54.969437 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:54.969139 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:54.969437 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:54.969260 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:55.968513 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:55.968469 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:55.968727 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:55.968614 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:56.616495 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:56.616466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:56.616845 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.616620 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:56.616845 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.616638 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:56.616845 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.616648 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:56.616845 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.616694 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.616680265 +0000 UTC m=+34.097664834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:56.717717 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:56.717690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:56.717865 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:56.717724 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:56.717865 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.717856 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:56.717990 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.717913 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:56.717990 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.717942 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.717910389 +0000 UTC m=+34.198894973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:56.717990 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.717989 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.717971741 +0000 UTC m=+34.198956316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:56.968779 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:56.968703 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:56.968943 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:56.968688 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:56.968943 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.968830 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:56.969107 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:56.968960 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:57.968859 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:57.968828 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:57.969309 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:57.968978 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:09:58.969748 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:58.969715 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:09:58.970199 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:58.969816 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:09:58.970199 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:58.969912 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:09:58.970199 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:58.970039 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:09:59.968585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:09:59.968557 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:09:59.968770 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:09:59.968673 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:00.969500 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:00.969338 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:00.970002 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:00.969401 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:00.970002 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:00.969608 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:00.970002 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:00.969686 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:01.240263 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.239907 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zf82r" event={"ID":"98c41e79-cec5-40d5-bbca-a17336584fd1","Type":"ContainerStarted","Data":"46abde657c18e484a5b6426792681ec3cfbb6126cecf0a64ca87b4a24867c9be"} Jul 15 21:10:01.241258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.241233 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ls562" event={"ID":"408ef609-eb1d-4f43-8736-92e7b08d6232","Type":"ContainerStarted","Data":"fec7294b96a5371a4a6347400df4fa117295f18df369f6d0e8b9d2b3c746f138"} Jul 15 21:10:01.242516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.242492 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" event={"ID":"b5b13008-0555-4902-9685-52dfb9a96645","Type":"ContainerStarted","Data":"98b96949f00794295478d529ee32e3478b97610d792d43bf2940bad7bc3c108b"} Jul 15 21:10:01.244827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.244811 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:10:01.245309 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.245110 2585 generic.go:356] "Generic (PLEG): container finished" podID="42736aec-8772-4ff4-8842-a5bbda681d0d" containerID="6c707d74f1e6db1b3023c5b38f3e19ad6d21c6b35ad631c6686bbce03c7c6604" exitCode=1 Jul 15 21:10:01.245309 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.245172 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"607832feb827587bb31b1b9bb82f61bf20cf9e0a4b360207767304bc5225bbcb"} Jul 15 21:10:01.245309 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.245238 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"ef09d3500a0cd0f50f98d426cfafbea31d699e71bbdb9cc77bc128913ef31ac7"} Jul 15 21:10:01.245309 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.245287 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"dbf58944c7b8150d22b6c5c9d6a7ada168ac9194d99f3b07e82d0a646ee1d230"} Jul 15 21:10:01.245486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.245330 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerDied","Data":"6c707d74f1e6db1b3023c5b38f3e19ad6d21c6b35ad631c6686bbce03c7c6604"} Jul 15 21:10:01.245486 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.245380 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"0e5cff090e302892f1281e89d0f2d8747882f8a32943eb372dcabda27e874c88"} Jul 15 21:10:01.246568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.246548 2585 generic.go:356] "Generic (PLEG): container finished" podID="23e73a80-0668-4672-a72e-9952c9bc54c7" containerID="954d6dee2a5ca1c75f9796e28c5fd4760e03f3dff7ae1b1970e51d5ae03dc2df" exitCode=0 Jul 15 21:10:01.246649 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.246626 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerDied","Data":"954d6dee2a5ca1c75f9796e28c5fd4760e03f3dff7ae1b1970e51d5ae03dc2df"} Jul 15 21:10:01.248540 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.248511 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-chsgk" event={"ID":"b522dab5-f255-453f-9046-df0f7289bfbd","Type":"ContainerStarted","Data":"18a076e40dfa8602bc900f0b3ffb9ddeee36f81da407de31a2d9859cedb4608f"} Jul 15 21:10:01.252453 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.252432 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qhd58" event={"ID":"d2f49fea-779d-4c9a-9aa1-385ae3b5c812","Type":"ContainerStarted","Data":"81b8ba4952012233ebcc727f8d4514215954e2fdd2a90329cfb3aa62228e5ab2"} Jul 15 21:10:01.253691 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.253674 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h2cc2" event={"ID":"04181f0e-be35-4d39-9bd3-e20917b0dced","Type":"ContainerStarted","Data":"af7ba7a151c7ea7a06c5496a989f341e6c011627ace0a574bfb8e2f367c495af"} Jul 15 21:10:01.262526 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.262491 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-128.ec2.internal" podStartSLOduration=21.262480603 podStartE2EDuration="21.262480603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:44.226362583 +0000 UTC m=+5.707347178" watchObservedRunningTime="2026-07-15 21:10:01.262480603 +0000 UTC m=+22.743465192" Jul 15 21:10:01.262945 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.262909 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zf82r" podStartSLOduration=3.644118143 podStartE2EDuration="22.262902945s" totalImagesPullingTime="18.618784802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.262645271 +0000 UTC m=+22.743629861" watchObservedRunningTime="2026-07-15 21:10:01.262902945 +0000 UTC m=+22.743887535" Jul 15 21:10:01.307527 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.307484 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h2cc2" podStartSLOduration=3.72770913 podStartE2EDuration="22.307469519s" totalImagesPullingTime="18.579760389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.307315972 +0000 UTC m=+22.788300562" watchObservedRunningTime="2026-07-15 21:10:01.307469519 +0000 UTC m=+22.788454109" Jul 15 21:10:01.329848 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.329791 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ls562" podStartSLOduration=3.767426895 podStartE2EDuration="22.329771572s" totalImagesPullingTime="18.562344677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.329448526 +0000 UTC m=+22.810433118" watchObservedRunningTime="2026-07-15 21:10:01.329771572 +0000 UTC m=+22.810756164" Jul 15 21:10:01.360287 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.360235 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-chsgk" podStartSLOduration=3.791511119 podStartE2EDuration="22.360220271s" totalImagesPullingTime="18.568709152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.359507519 +0000 UTC m=+22.840492122" watchObservedRunningTime="2026-07-15 21:10:01.360220271 +0000 UTC m=+22.841204862" Jul 15 21:10:01.382609 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.382560 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qhd58" podStartSLOduration=3.805883978 podStartE2EDuration="22.382541146s" totalImagesPullingTime="18.576657168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.382084574 +0000 UTC m=+22.863069166" watchObservedRunningTime="2026-07-15 21:10:01.382541146 +0000 UTC m=+22.863525737" Jul 15 21:10:01.968972 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:01.968885 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:01.969219 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:01.969054 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:02.121104 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.121069 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 21:10:02.259629 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.259555 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:10:02.260111 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.260084 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"3d48aafdda64a7b8f834a14aafbb6acb5d113ecf8f7005e5e7889bc5572ea86f"} Jul 15 21:10:02.261801 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.261775 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2l8n5" event={"ID":"b7e4e2f2-d64d-47c4-b668-9db0dc59eef2","Type":"ContainerStarted","Data":"ba0a1676b965d2033b3d3029478f22a3cf1b1cbb84f07b94620fe577f3dc0b93"} Jul 15 21:10:02.263597 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.263559 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" event={"ID":"b5b13008-0555-4902-9685-52dfb9a96645","Type":"ContainerStarted","Data":"c644370c427047095bc0556cc2d664336ef66f41d17e6a2de85f4ca6f0ac0db1"} Jul 15 21:10:02.278328 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.278273 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2l8n5" podStartSLOduration=4.703503789 podStartE2EDuration="23.278252829s" totalImagesPullingTime="18.57474904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:02.278103923 +0000 UTC m=+23.759088514" watchObservedRunningTime="2026-07-15 21:10:02.278252829 +0000 UTC m=+23.759237420" Jul 15 21:10:02.923163 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.923067 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:10:02.121116114Z","UUID":"4c93304d-5244-4f3e-a5b8-9b4f10127344","Handler":null,"Name":"","Endpoint":""} Jul 15 21:10:02.924808 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.924785 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 21:10:02.924957 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.924827 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 21:10:02.969052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.969020 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:02.969297 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:02.969020 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:02.969297 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:02.969155 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:02.969297 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:02.969231 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:03.195175 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:03.195093 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ls562" Jul 15 21:10:03.195796 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:03.195777 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ls562" Jul 15 21:10:03.265991 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:03.265961 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ls562" Jul 15 21:10:03.266462 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:03.266438 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ls562" Jul 15 21:10:03.968392 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:03.968194 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:03.968524 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:03.968433 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:04.271032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:04.270959 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:10:04.271438 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:04.271399 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"b3b946bde604160aee54e60f37d9eea4ce5dc4b9e3bc4f5d0d4cb055b560b871"} Jul 15 21:10:04.968857 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:04.968826 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:04.969061 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:04.968971 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:04.969061 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:04.969030 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:04.969178 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:04.969140 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:05.969105 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:05.968951 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:05.969631 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:05.969185 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:06.278407 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.278334 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" event={"ID":"b5b13008-0555-4902-9685-52dfb9a96645","Type":"ContainerStarted","Data":"4e3c4fd8a71eaa8777a05984181fe12ea9b28a8aa8f5f09df011d99c1f9e4842"} Jul 15 21:10:06.284052 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.284031 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:10:06.284406 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.284376 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"dfb7b3ddde5c214ef834fcf49e7c087eea509852d02d9583ce3f057c09e394e8"} Jul 15 21:10:06.284572 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.284553 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:10:06.284689 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.284609 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:10:06.284805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.284787 2585 scope.go:117] "RemoveContainer" containerID="6c707d74f1e6db1b3023c5b38f3e19ad6d21c6b35ad631c6686bbce03c7c6604" Jul 15 21:10:06.286205 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.286185 2585 generic.go:356] "Generic (PLEG): container finished" podID="23e73a80-0668-4672-a72e-9952c9bc54c7" containerID="70f18de2a9293c223e9be4aa432d2da7e62ccf29058d2f8be8419be8ee72e3ef" exitCode=0 Jul 15 21:10:06.286298 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.286220 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerDied","Data":"70f18de2a9293c223e9be4aa432d2da7e62ccf29058d2f8be8419be8ee72e3ef"} Jul 15 21:10:06.300065 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.300043 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:10:06.340274 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.340235 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plxf5" podStartSLOduration=4.213744752 podStartE2EDuration="27.34022035s" totalImagesPullingTime="23.126475598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:06.31009985 +0000 UTC m=+27.791084440" watchObservedRunningTime="2026-07-15 21:10:06.34022035 +0000 UTC m=+27.821204940" Jul 15 21:10:06.968305 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.968242 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:06.968458 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:06.968365 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:06.968458 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:06.968406 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:06.968533 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:06.968487 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:07.292249 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.292182 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:10:07.292739 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.292549 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" event={"ID":"42736aec-8772-4ff4-8842-a5bbda681d0d","Type":"ContainerStarted","Data":"228366e1a8474dfaa70cd59968044dbc35c5b18d66d0aef70d62b507ed3e5f5f"} Jul 15 21:10:07.292983 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.292960 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:10:07.307481 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.307455 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:10:07.324211 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.324172 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" podStartSLOduration=9.695928188 podStartE2EDuration="28.324157361s" totalImagesPullingTime="18.628229173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:07.323780218 +0000 UTC m=+28.804764809" watchObservedRunningTime="2026-07-15 21:10:07.324157361 +0000 UTC m=+28.805141951" Jul 15 21:10:07.696596 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.696423 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nw4qk"] Jul 15 21:10:07.696718 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.696697 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:07.696794 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:07.696774 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:07.700129 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.700090 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p6dbj"] Jul 15 21:10:07.700360 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.700335 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:07.700449 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:07.700433 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:07.701596 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.701576 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29vkv"] Jul 15 21:10:07.701677 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:07.701664 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:07.701750 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:07.701731 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:08.296890 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:08.296855 2585 generic.go:356] "Generic (PLEG): container finished" podID="23e73a80-0668-4672-a72e-9952c9bc54c7" containerID="4309293b7f451f9ac8f0d7be45ac752010cdf6605bba432c55e741b52147845c" exitCode=0 Jul 15 21:10:08.297311 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:08.296946 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerDied","Data":"4309293b7f451f9ac8f0d7be45ac752010cdf6605bba432c55e741b52147845c"} Jul 15 21:10:08.970019 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:08.969992 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:08.970226 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:08.970095 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:08.970226 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:08.970174 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:08.970338 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:08.970288 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:08.970338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:08.970327 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:08.970433 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:08.970393 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:10.307109 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:10.306971 2585 generic.go:356] "Generic (PLEG): container finished" podID="23e73a80-0668-4672-a72e-9952c9bc54c7" containerID="a9c7fd811b7baa29ee5d544bc3b1015b67523d4bf1ff239949180d6b89e6e549" exitCode=0 Jul 15 21:10:10.307109 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:10.307026 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerDied","Data":"a9c7fd811b7baa29ee5d544bc3b1015b67523d4bf1ff239949180d6b89e6e549"} Jul 15 21:10:10.968377 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:10.968342 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:10.968538 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:10.968382 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:10.968538 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:10.968460 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:10.968538 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:10.968497 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:10.968653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:10.968544 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:10.968653 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:10.968611 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:12.637219 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:12.637178 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:12.637882 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.637365 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:12.637882 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.637388 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:12.637882 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.637400 2585 projected.go:196] Error preparing data for projected volume kube-api-access-k5b92 for pod openshift-network-diagnostics/network-check-target-nw4qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:12.637882 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.637465 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92 podName:edf5334e-28c6-4b10-8518-53e51ee345a4 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.637446229 +0000 UTC m=+66.118430798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5b92" (UniqueName: "kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92") pod "network-check-target-nw4qk" (UID: "edf5334e-28c6-4b10-8518-53e51ee345a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:12.738537 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:12.738505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:12.738702 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:12.738552 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:12.738702 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.738659 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:12.738813 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.738721 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs podName:5a692c81-d4d5-4032-ba6f-aa0a44dfad0e nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.738702439 +0000 UTC m=+66.219687142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs") pod "network-metrics-daemon-29vkv" (UID: "5a692c81-d4d5-4032-ba6f-aa0a44dfad0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:12.738813 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.738659 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:12.738813 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.738808 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret podName:59dcaa4d-edab-4b62-8d52-e77f680454fa nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.738795851 +0000 UTC m=+66.219780420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret") pod "global-pull-secret-syncer-p6dbj" (UID: "59dcaa4d-edab-4b62-8d52-e77f680454fa") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:12.975622 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:12.975528 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:12.975772 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.975682 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw4qk" podUID="edf5334e-28c6-4b10-8518-53e51ee345a4" Jul 15 21:10:12.975772 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:12.975714 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:12.975772 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:12.975720 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:12.976016 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.975988 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6dbj" podUID="59dcaa4d-edab-4b62-8d52-e77f680454fa" Jul 15 21:10:12.976155 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:12.976119 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29vkv" podUID="5a692c81-d4d5-4032-ba6f-aa0a44dfad0e" Jul 15 21:10:13.357882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.357815 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-128.ec2.internal" event="NodeReady" Jul 15 21:10:13.358049 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.357963 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 21:10:13.409155 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.409127 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s6wjx"] Jul 15 21:10:13.410969 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.410952 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.412264 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.412244 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qmdx8"] Jul 15 21:10:13.413765 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.413749 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-87f885ffc-s7bwv"] Jul 15 21:10:13.413891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.413872 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.414700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.414682 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 21:10:13.414773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.414720 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xcfql\"" Jul 15 21:10:13.415015 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.415003 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 21:10:13.415220 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.415207 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.416452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.416427 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9kxvh\"" Jul 15 21:10:13.416452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.416421 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 21:10:13.416452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.416427 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 21:10:13.416771 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.416753 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 21:10:13.417134 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.417101 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 21:10:13.417408 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.417367 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9mpjn\"" Jul 15 21:10:13.417735 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.417714 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 21:10:13.418076 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.418060 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 21:10:13.423573 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.423556 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 21:10:13.426742 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.426562 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s6wjx"] Jul 15 21:10:13.430560 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.430510 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qmdx8"] Jul 15 21:10:13.447164 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.447143 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-87f885ffc-s7bwv"] Jul 15 21:10:13.546315 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546275 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslsm\" (UniqueName: \"kubernetes.io/projected/24803bab-119c-4c99-be9d-1625cdf6ae94-kube-api-access-zslsm\") pod \"ingress-canary-qmdx8\" (UID: \"24803bab-119c-4c99-be9d-1625cdf6ae94\") " pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.546472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546323 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-image-registry-private-configuration\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546370 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-ca-trust-extracted\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546454 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d75077a-4b89-453d-947f-cfb436fce76c-tmp-dir\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.546600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546488 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d75077a-4b89-453d-947f-cfb436fce76c-config-volume\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.546600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546510 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-trusted-ca\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546535 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546558 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpv6\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-kube-api-access-sxpv6\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546753 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-installation-pull-secrets\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546753 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546683 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-bound-sa-token\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546753 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546700 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.546753 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546715 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-certificates\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.546753 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546740 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbr8\" (UniqueName: \"kubernetes.io/projected/4d75077a-4b89-453d-947f-cfb436fce76c-kube-api-access-qrbr8\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.546753 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.546753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24803bab-119c-4c99-be9d-1625cdf6ae94-cert\") pod \"ingress-canary-qmdx8\" (UID: \"24803bab-119c-4c99-be9d-1625cdf6ae94\") " pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.648058 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648025 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d75077a-4b89-453d-947f-cfb436fce76c-config-volume\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.648479 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-trusted-ca\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.648479 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648097 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.648479 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648119 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpv6\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-kube-api-access-sxpv6\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.648611 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648179 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-installation-pull-secrets\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.648676 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:13.648649 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:13.648717 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:13.648679 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87f885ffc-s7bwv: secret "image-registry-tls" not found Jul 15 21:10:13.648717 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648678 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-bound-sa-token\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.648717 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648699 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d75077a-4b89-453d-947f-cfb436fce76c-config-volume\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.648845 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648714 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.648845 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:13.648738 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls podName:d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.148719841 +0000 UTC m=+35.629704412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls") pod "image-registry-87f885ffc-s7bwv" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d") : secret "image-registry-tls" not found Jul 15 21:10:13.648845 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:13.648784 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:13.648997 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:13.648857 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls podName:4d75077a-4b89-453d-947f-cfb436fce76c nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.148840578 +0000 UTC m=+35.629825148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls") pod "dns-default-s6wjx" (UID: "4d75077a-4b89-453d-947f-cfb436fce76c") : secret "dns-default-metrics-tls" not found Jul 15 21:10:13.648997 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648875 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-certificates\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.648997 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648939 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbr8\" (UniqueName: \"kubernetes.io/projected/4d75077a-4b89-453d-947f-cfb436fce76c-kube-api-access-qrbr8\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.648997 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648964 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24803bab-119c-4c99-be9d-1625cdf6ae94-cert\") pod \"ingress-canary-qmdx8\" (UID: \"24803bab-119c-4c99-be9d-1625cdf6ae94\") " pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.649174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.648999 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zslsm\" (UniqueName: \"kubernetes.io/projected/24803bab-119c-4c99-be9d-1625cdf6ae94-kube-api-access-zslsm\") pod \"ingress-canary-qmdx8\" (UID: \"24803bab-119c-4c99-be9d-1625cdf6ae94\") " pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.649174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649049 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-image-registry-private-configuration\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.649174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-ca-trust-extracted\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.649174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649098 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-trusted-ca\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.649352 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649239 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d75077a-4b89-453d-947f-cfb436fce76c-tmp-dir\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.649400 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649378 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-certificates\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.649701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649456 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-ca-trust-extracted\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.649701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.649520 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d75077a-4b89-453d-947f-cfb436fce76c-tmp-dir\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.653054 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.653032 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-image-registry-private-configuration\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.653054 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.653048 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-installation-pull-secrets\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.653200 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.653097 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24803bab-119c-4c99-be9d-1625cdf6ae94-cert\") pod \"ingress-canary-qmdx8\" (UID: \"24803bab-119c-4c99-be9d-1625cdf6ae94\") " pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.657980 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.657958 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbr8\" (UniqueName: \"kubernetes.io/projected/4d75077a-4b89-453d-947f-cfb436fce76c-kube-api-access-qrbr8\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:13.658217 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.658175 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpv6\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-kube-api-access-sxpv6\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.658592 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.658570 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslsm\" (UniqueName: \"kubernetes.io/projected/24803bab-119c-4c99-be9d-1625cdf6ae94-kube-api-access-zslsm\") pod \"ingress-canary-qmdx8\" (UID: \"24803bab-119c-4c99-be9d-1625cdf6ae94\") " pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:13.659704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.659685 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-bound-sa-token\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:13.731124 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:13.731097 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qmdx8" Jul 15 21:10:14.153861 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.153828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:14.154051 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.153942 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:14.154051 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:14.154016 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:14.154051 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:14.154043 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:14.154188 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:14.154057 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87f885ffc-s7bwv: secret "image-registry-tls" not found Jul 15 21:10:14.154188 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:14.154101 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls podName:4d75077a-4b89-453d-947f-cfb436fce76c nodeName:}" failed. No retries permitted until 2026-07-15 21:10:15.154082893 +0000 UTC m=+36.635067462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls") pod "dns-default-s6wjx" (UID: "4d75077a-4b89-453d-947f-cfb436fce76c") : secret "dns-default-metrics-tls" not found Jul 15 21:10:14.154188 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:14.154123 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls podName:d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d nodeName:}" failed. No retries permitted until 2026-07-15 21:10:15.154113256 +0000 UTC m=+36.635097825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls") pod "image-registry-87f885ffc-s7bwv" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d") : secret "image-registry-tls" not found Jul 15 21:10:14.968907 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.968885 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:14.969282 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.968887 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:14.969282 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.969135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:14.972202 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.972179 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:10:14.972317 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.972210 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2pnr\"" Jul 15 21:10:14.972317 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.972254 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:10:14.972317 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.972289 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:10:14.972317 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.972263 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s56kw\"" Jul 15 21:10:14.972490 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.972396 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:14.991343 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:14.991320 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qmdx8"] Jul 15 21:10:14.997583 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:14.997553 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24803bab_119c_4c99_be9d_1625cdf6ae94.slice/crio-89234b6f45a4ed62359a24299c0a0d9c5e2fad49884e338ee2cd4f207b824d1e WatchSource:0}: Error finding container 89234b6f45a4ed62359a24299c0a0d9c5e2fad49884e338ee2cd4f207b824d1e: Status 404 returned error can't find the container with id 89234b6f45a4ed62359a24299c0a0d9c5e2fad49884e338ee2cd4f207b824d1e Jul 15 21:10:15.160559 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:15.160533 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:15.160660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:15.160583 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:15.160694 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:15.160675 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:15.160694 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:15.160689 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87f885ffc-s7bwv: secret "image-registry-tls" not found Jul 15 21:10:15.160752 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:15.160733 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls podName:d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d nodeName:}" failed. No retries permitted until 2026-07-15 21:10:17.16072022 +0000 UTC m=+38.641704793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls") pod "image-registry-87f885ffc-s7bwv" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d") : secret "image-registry-tls" not found Jul 15 21:10:15.160791 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:15.160677 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:15.160821 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:15.160811 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls podName:4d75077a-4b89-453d-947f-cfb436fce76c nodeName:}" failed. No retries permitted until 2026-07-15 21:10:17.160795995 +0000 UTC m=+38.641780567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls") pod "dns-default-s6wjx" (UID: "4d75077a-4b89-453d-947f-cfb436fce76c") : secret "dns-default-metrics-tls" not found Jul 15 21:10:15.319589 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:15.319558 2585 generic.go:356] "Generic (PLEG): container finished" podID="23e73a80-0668-4672-a72e-9952c9bc54c7" containerID="ada68af1cb2ea854256f30a1e4d260979238a56f8a8efc2eec1d7060c80a19a7" exitCode=0 Jul 15 21:10:15.319711 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:15.319631 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerDied","Data":"ada68af1cb2ea854256f30a1e4d260979238a56f8a8efc2eec1d7060c80a19a7"} Jul 15 21:10:15.320721 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:15.320701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qmdx8" event={"ID":"24803bab-119c-4c99-be9d-1625cdf6ae94","Type":"ContainerStarted","Data":"89234b6f45a4ed62359a24299c0a0d9c5e2fad49884e338ee2cd4f207b824d1e"} Jul 15 21:10:16.326499 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:16.326329 2585 generic.go:356] "Generic (PLEG): container finished" podID="23e73a80-0668-4672-a72e-9952c9bc54c7" containerID="70d7c6f5ec664a0c1395effb4882dcf5b3d1caa0fa41786ad61e12dc61b9e9b2" exitCode=0 Jul 15 21:10:16.326499 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:16.326393 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerDied","Data":"70d7c6f5ec664a0c1395effb4882dcf5b3d1caa0fa41786ad61e12dc61b9e9b2"} Jul 15 21:10:17.176045 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:17.176014 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:17.176200 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:17.176086 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:17.176200 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:17.176163 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:17.176200 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:17.176180 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:17.176200 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:17.176189 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87f885ffc-s7bwv: secret "image-registry-tls" not found Jul 15 21:10:17.176321 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:17.176226 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls podName:4d75077a-4b89-453d-947f-cfb436fce76c nodeName:}" failed. No retries permitted until 2026-07-15 21:10:21.1762126 +0000 UTC m=+42.657197169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls") pod "dns-default-s6wjx" (UID: "4d75077a-4b89-453d-947f-cfb436fce76c") : secret "dns-default-metrics-tls" not found Jul 15 21:10:17.176321 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:17.176240 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls podName:d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d nodeName:}" failed. No retries permitted until 2026-07-15 21:10:21.176234209 +0000 UTC m=+42.657218778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls") pod "image-registry-87f885ffc-s7bwv" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d") : secret "image-registry-tls" not found Jul 15 21:10:17.332203 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:17.332165 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cblrj" event={"ID":"23e73a80-0668-4672-a72e-9952c9bc54c7","Type":"ContainerStarted","Data":"3b7688195d80eb5e3625f4effa0de1bee7baa28ba37fdc2da9d35731244ae514"} Jul 15 21:10:17.356886 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:17.356839 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cblrj" podStartSLOduration=8.583430998 podStartE2EDuration="38.356824508s" totalImagesPullingTime="29.77339351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:17.355440856 +0000 UTC m=+38.836425448" watchObservedRunningTime="2026-07-15 21:10:17.356824508 +0000 UTC m=+38.837809097" Jul 15 21:10:18.335962 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:18.335909 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qmdx8" event={"ID":"24803bab-119c-4c99-be9d-1625cdf6ae94","Type":"ContainerStarted","Data":"c7ad5e74c4205e2b58a0b9c5bf8a8ef0dfbddf6cdafb04864fed8b746c46c4d6"} Jul 15 21:10:18.353440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:18.353396 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qmdx8" podStartSLOduration=2.804129888 podStartE2EDuration="5.353382204s" totalImagesPullingTime="2.549252316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:18.353165266 +0000 UTC m=+39.834149859" watchObservedRunningTime="2026-07-15 21:10:18.353382204 +0000 UTC m=+39.834366773" Jul 15 21:10:21.201279 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:21.201233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:21.201637 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:21.201291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:21.201637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:21.201386 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:21.201637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:21.201391 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:21.201637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:21.201411 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87f885ffc-s7bwv: secret "image-registry-tls" not found Jul 15 21:10:21.201637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:21.201434 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls podName:4d75077a-4b89-453d-947f-cfb436fce76c nodeName:}" failed. No retries permitted until 2026-07-15 21:10:29.20142194 +0000 UTC m=+50.682406509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls") pod "dns-default-s6wjx" (UID: "4d75077a-4b89-453d-947f-cfb436fce76c") : secret "dns-default-metrics-tls" not found Jul 15 21:10:21.201637 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:21.201454 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls podName:d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d nodeName:}" failed. No retries permitted until 2026-07-15 21:10:29.201440966 +0000 UTC m=+50.682425538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls") pod "image-registry-87f885ffc-s7bwv" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d") : secret "image-registry-tls" not found Jul 15 21:10:22.961768 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:22.961735 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-znp6n"] Jul 15 21:10:22.992766 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:22.992728 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-znp6n"] Jul 15 21:10:22.992908 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:22.992848 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.000154 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.000134 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nj8l9\"" Jul 15 21:10:23.000767 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.000748 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 21:10:23.000864 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.000799 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 21:10:23.001079 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.000970 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 21:10:23.001448 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.001435 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 21:10:23.016173 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.016152 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdb7f91b-dfa0-4608-9a6a-75a385388b06-crio-socket\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.016263 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.016195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb7f91b-dfa0-4608-9a6a-75a385388b06-data-volume\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.016263 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.016211 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n875r\" (UniqueName: \"kubernetes.io/projected/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-api-access-n875r\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.016358 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.016294 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.016358 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.016333 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117316 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdb7f91b-dfa0-4608-9a6a-75a385388b06-crio-socket\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb7f91b-dfa0-4608-9a6a-75a385388b06-data-volume\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117362 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n875r\" (UniqueName: \"kubernetes.io/projected/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-api-access-n875r\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117568 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.117388 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.117568 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.117425 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:23.117568 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.117465 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:23.61744487 +0000 UTC m=+45.098429443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.117568 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.117486 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:23.617475411 +0000 UTC m=+45.098459986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : configmap "kube-rbac-proxy" not found Jul 15 21:10:23.117568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117501 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdb7f91b-dfa0-4608-9a6a-75a385388b06-crio-socket\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.117714 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.117638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb7f91b-dfa0-4608-9a6a-75a385388b06-data-volume\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.127507 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.127488 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n875r\" (UniqueName: \"kubernetes.io/projected/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-api-access-n875r\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.620033 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.619999 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.620033 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:23.620038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:23.620266 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.620150 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.620266 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.620173 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:23.620266 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.620225 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:24.620211578 +0000 UTC m=+46.101196147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : configmap "kube-rbac-proxy" not found Jul 15 21:10:23.620359 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:23.620307 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:24.620295929 +0000 UTC m=+46.101280499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:24.625578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:24.625541 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:24.625578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:24.625578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:24.626193 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:24.625710 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:24.626193 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:24.625782 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:26.62576382 +0000 UTC m=+48.106748391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:24.626193 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:24.625799 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:24.626193 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:24.625852 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:26.625840248 +0000 UTC m=+48.106824818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : configmap "kube-rbac-proxy" not found Jul 15 21:10:24.748323 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:24.748293 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h2cc2_04181f0e-be35-4d39-9bd3-e20917b0dced/dns-node-resolver/0.log" Jul 15 21:10:26.148987 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:26.148958 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qhd58_d2f49fea-779d-4c9a-9aa1-385ae3b5c812/node-ca/0.log" Jul 15 21:10:26.637777 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:26.637745 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:26.637936 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:26.637784 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:26.637936 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:26.637858 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:26.637936 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:26.637886 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:26.637936 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:26.637912 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.637899628 +0000 UTC m=+52.118884198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : configmap "kube-rbac-proxy" not found Jul 15 21:10:26.638078 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:26.637950 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.637934248 +0000 UTC m=+52.118918817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:26.949699 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:26.949635 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qmdx8_24803bab-119c-4c99-be9d-1625cdf6ae94/serve-healthcheck-canary/0.log" Jul 15 21:10:29.258417 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:29.258378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:29.258780 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:29.258429 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:29.258780 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:29.258520 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:29.258780 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:29.258539 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87f885ffc-s7bwv: secret "image-registry-tls" not found Jul 15 21:10:29.258780 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:29.258549 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:29.258780 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:29.258592 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls podName:d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d nodeName:}" failed. No retries permitted until 2026-07-15 21:10:45.258577851 +0000 UTC m=+66.739562423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls") pod "image-registry-87f885ffc-s7bwv" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d") : secret "image-registry-tls" not found Jul 15 21:10:29.258780 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:29.258604 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls podName:4d75077a-4b89-453d-947f-cfb436fce76c nodeName:}" failed. No retries permitted until 2026-07-15 21:10:45.258598461 +0000 UTC m=+66.739583030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls") pod "dns-default-s6wjx" (UID: "4d75077a-4b89-453d-947f-cfb436fce76c") : secret "dns-default-metrics-tls" not found Jul 15 21:10:30.669633 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:30.669595 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:30.670129 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:30.669705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:30.670129 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:30.669803 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:30.670129 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:10:30.669853 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls podName:fdb7f91b-dfa0-4608-9a6a-75a385388b06 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:38.6698411 +0000 UTC m=+60.150825673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp6n" (UID: "fdb7f91b-dfa0-4608-9a6a-75a385388b06") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:30.670328 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:30.670304 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdb7f91b-dfa0-4608-9a6a-75a385388b06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:38.726662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:38.726626 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:38.729067 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:38.729037 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdb7f91b-dfa0-4608-9a6a-75a385388b06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp6n\" (UID: \"fdb7f91b-dfa0-4608-9a6a-75a385388b06\") " pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:38.903679 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:38.903651 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nj8l9\"" Jul 15 21:10:38.911728 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:38.911711 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-znp6n" Jul 15 21:10:39.079526 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:39.079491 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-znp6n"] Jul 15 21:10:39.083116 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:39.083085 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb7f91b_dfa0_4608_9a6a_75a385388b06.slice/crio-8f98a4f89ece13def5bd323f9234388f57e6bdbc176dea24471e1b2c954f9bc9 WatchSource:0}: Error finding container 8f98a4f89ece13def5bd323f9234388f57e6bdbc176dea24471e1b2c954f9bc9: Status 404 returned error can't find the container with id 8f98a4f89ece13def5bd323f9234388f57e6bdbc176dea24471e1b2c954f9bc9 Jul 15 21:10:39.316445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:39.316376 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj4gw" Jul 15 21:10:39.383890 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:39.383856 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp6n" event={"ID":"fdb7f91b-dfa0-4608-9a6a-75a385388b06","Type":"ContainerStarted","Data":"8f98a4f89ece13def5bd323f9234388f57e6bdbc176dea24471e1b2c954f9bc9"} Jul 15 21:10:44.399391 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.399351 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp6n" event={"ID":"fdb7f91b-dfa0-4608-9a6a-75a385388b06","Type":"ContainerStarted","Data":"2e8e63c89116391acf83d5c29ebf511fc188226a59f81db0c5e65675491287b2"} Jul 15 21:10:44.677783 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.677683 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:44.680448 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.680417 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:10:44.692564 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.692540 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:10:44.702759 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.702709 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5b92\" (UniqueName: \"kubernetes.io/projected/edf5334e-28c6-4b10-8518-53e51ee345a4-kube-api-access-k5b92\") pod \"network-check-target-nw4qk\" (UID: \"edf5334e-28c6-4b10-8518-53e51ee345a4\") " pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:44.779022 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.778986 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:44.779168 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.779048 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:44.782508 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.782485 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:10:44.782725 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.782708 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:44.792504 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.792480 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a692c81-d4d5-4032-ba6f-aa0a44dfad0e-metrics-certs\") pod \"network-metrics-daemon-29vkv\" (UID: \"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e\") " pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:44.792649 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.792636 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59dcaa4d-edab-4b62-8d52-e77f680454fa-original-pull-secret\") pod \"global-pull-secret-syncer-p6dbj\" (UID: \"59dcaa4d-edab-4b62-8d52-e77f680454fa\") " pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:44.983471 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.983405 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6dbj" Jul 15 21:10:44.993370 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.993344 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s56kw\"" Jul 15 21:10:44.998621 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:44.998600 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2pnr\"" Jul 15 21:10:45.000455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.000433 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:45.007244 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.007221 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29vkv" Jul 15 21:10:45.157478 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.157447 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p6dbj"] Jul 15 21:10:45.162509 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:45.162482 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dcaa4d_edab_4b62_8d52_e77f680454fa.slice/crio-5be558460e3143f3f9fda4711f58dbf4df7605934acfa2943fee74297b74777f WatchSource:0}: Error finding container 5be558460e3143f3f9fda4711f58dbf4df7605934acfa2943fee74297b74777f: Status 404 returned error can't find the container with id 5be558460e3143f3f9fda4711f58dbf4df7605934acfa2943fee74297b74777f Jul 15 21:10:45.170026 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.170002 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nw4qk"] Jul 15 21:10:45.173307 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:45.173280 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf5334e_28c6_4b10_8518_53e51ee345a4.slice/crio-eea29f590a9573a8df231b1b5d9049be32815ccd2575dfd8169de85aede71942 WatchSource:0}: Error finding container eea29f590a9573a8df231b1b5d9049be32815ccd2575dfd8169de85aede71942: Status 404 returned error can't find the container with id eea29f590a9573a8df231b1b5d9049be32815ccd2575dfd8169de85aede71942 Jul 15 21:10:45.199578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.199510 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29vkv"] Jul 15 21:10:45.203813 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:45.203792 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a692c81_d4d5_4032_ba6f_aa0a44dfad0e.slice/crio-e8c5648556abdef6edb2c81c678096acfe039f23c5348ab816d5fb2c9dfbbf86 WatchSource:0}: Error finding container e8c5648556abdef6edb2c81c678096acfe039f23c5348ab816d5fb2c9dfbbf86: Status 404 returned error can't find the container with id e8c5648556abdef6edb2c81c678096acfe039f23c5348ab816d5fb2c9dfbbf86 Jul 15 21:10:45.283721 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.283654 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:45.283721 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.283697 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:45.285939 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.285893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"image-registry-87f885ffc-s7bwv\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:45.285939 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.285929 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d75077a-4b89-453d-947f-cfb436fce76c-metrics-tls\") pod \"dns-default-s6wjx\" (UID: \"4d75077a-4b89-453d-947f-cfb436fce76c\") " pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:45.403939 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.403881 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nw4qk" event={"ID":"edf5334e-28c6-4b10-8518-53e51ee345a4","Type":"ContainerStarted","Data":"eea29f590a9573a8df231b1b5d9049be32815ccd2575dfd8169de85aede71942"} Jul 15 21:10:45.405214 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.405182 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29vkv" event={"ID":"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e","Type":"ContainerStarted","Data":"e8c5648556abdef6edb2c81c678096acfe039f23c5348ab816d5fb2c9dfbbf86"} Jul 15 21:10:45.406457 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.406430 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p6dbj" event={"ID":"59dcaa4d-edab-4b62-8d52-e77f680454fa","Type":"ContainerStarted","Data":"5be558460e3143f3f9fda4711f58dbf4df7605934acfa2943fee74297b74777f"} Jul 15 21:10:45.526650 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.526615 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xcfql\"" Jul 15 21:10:45.534775 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.534710 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:45.539612 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.539593 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9mpjn\"" Jul 15 21:10:45.547869 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:45.547845 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:46.073079 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.073047 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8"] Jul 15 21:10:46.158746 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.158708 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t"] Jul 15 21:10:46.158910 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.158864 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.163848 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.163824 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 21:10:46.164148 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.164089 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 21:10:46.164148 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.164110 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sm2vb\"" Jul 15 21:10:46.164608 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.164590 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 21:10:46.164711 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.164627 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 21:10:46.190530 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.190499 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccf5bb8c-b466-4ba1-932d-28205d27a893-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8\" (UID: \"ccf5bb8c-b466-4ba1-932d-28205d27a893\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.190658 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.190555 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs8q2\" (UniqueName: \"kubernetes.io/projected/ccf5bb8c-b466-4ba1-932d-28205d27a893-kube-api-access-bs8q2\") pod \"managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8\" (UID: \"ccf5bb8c-b466-4ba1-932d-28205d27a893\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.193126 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.193099 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87f885ffc-s7bwv"] Jul 15 21:10:46.193242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.193148 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t"] Jul 15 21:10:46.193242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.193173 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8"] Jul 15 21:10:46.193242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.193194 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-6p6fn"] Jul 15 21:10:46.193399 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.193272 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.196174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.196148 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 21:10:46.226851 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.226808 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-6p6fn"] Jul 15 21:10:46.227046 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.226945 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:10:46.229341 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.229317 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-74t5k\"" Jul 15 21:10:46.229480 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.229329 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 21:10:46.229907 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.229886 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 21:10:46.274415 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.274381 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bbb6dd94b-9npwb"] Jul 15 21:10:46.291481 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.291457 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccf5bb8c-b466-4ba1-932d-28205d27a893-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8\" (UID: \"ccf5bb8c-b466-4ba1-932d-28205d27a893\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.291610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.291489 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a0b117b-ac33-4ea1-8e69-8b36476617a5-tmp\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.291610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.291513 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8a0b117b-ac33-4ea1-8e69-8b36476617a5-klusterlet-config\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.291610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.291536 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5scqv\" (UniqueName: \"kubernetes.io/projected/63cc2993-22c5-4164-a4bd-71a717184cbc-kube-api-access-5scqv\") pod \"downloads-68c9cbb497-6p6fn\" (UID: \"63cc2993-22c5-4164-a4bd-71a717184cbc\") " pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:10:46.291610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.291561 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs8q2\" (UniqueName: \"kubernetes.io/projected/ccf5bb8c-b466-4ba1-932d-28205d27a893-kube-api-access-bs8q2\") pod \"managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8\" (UID: \"ccf5bb8c-b466-4ba1-932d-28205d27a893\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.291809 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.291672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnp9z\" (UniqueName: \"kubernetes.io/projected/8a0b117b-ac33-4ea1-8e69-8b36476617a5-kube-api-access-hnp9z\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.294286 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.294187 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccf5bb8c-b466-4ba1-932d-28205d27a893-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8\" (UID: \"ccf5bb8c-b466-4ba1-932d-28205d27a893\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.310272 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.310238 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs8q2\" (UniqueName: \"kubernetes.io/projected/ccf5bb8c-b466-4ba1-932d-28205d27a893-kube-api-access-bs8q2\") pod \"managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8\" (UID: \"ccf5bb8c-b466-4ba1-932d-28205d27a893\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.315217 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.315191 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbb6dd94b-9npwb"] Jul 15 21:10:46.315334 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.315294 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.392656 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392623 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36fa18b3-8eb4-43e3-b407-cb5f7191534b-installation-pull-secrets\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.392809 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392676 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a0b117b-ac33-4ea1-8e69-8b36476617a5-tmp\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.392809 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392718 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5scqv\" (UniqueName: \"kubernetes.io/projected/63cc2993-22c5-4164-a4bd-71a717184cbc-kube-api-access-5scqv\") pod \"downloads-68c9cbb497-6p6fn\" (UID: \"63cc2993-22c5-4164-a4bd-71a717184cbc\") " pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:10:46.392809 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392774 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36fa18b3-8eb4-43e3-b407-cb5f7191534b-registry-certificates\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.392809 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-registry-tls\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392838 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vpdz\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-kube-api-access-7vpdz\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392869 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36fa18b3-8eb4-43e3-b407-cb5f7191534b-image-registry-private-configuration\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392932 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-bound-sa-token\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.392979 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8a0b117b-ac33-4ea1-8e69-8b36476617a5-klusterlet-config\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.393008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnp9z\" (UniqueName: \"kubernetes.io/projected/8a0b117b-ac33-4ea1-8e69-8b36476617a5-kube-api-access-hnp9z\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.393035 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36fa18b3-8eb4-43e3-b407-cb5f7191534b-ca-trust-extracted\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.393052 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a0b117b-ac33-4ea1-8e69-8b36476617a5-tmp\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.393097 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.393082 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36fa18b3-8eb4-43e3-b407-cb5f7191534b-trusted-ca\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.395761 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.395740 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8a0b117b-ac33-4ea1-8e69-8b36476617a5-klusterlet-config\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.405276 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.405257 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnp9z\" (UniqueName: \"kubernetes.io/projected/8a0b117b-ac33-4ea1-8e69-8b36476617a5-kube-api-access-hnp9z\") pod \"klusterlet-addon-workmgr-86cc4ddf95-b7h2t\" (UID: \"8a0b117b-ac33-4ea1-8e69-8b36476617a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.405627 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.405438 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5scqv\" (UniqueName: \"kubernetes.io/projected/63cc2993-22c5-4164-a4bd-71a717184cbc-kube-api-access-5scqv\") pod \"downloads-68c9cbb497-6p6fn\" (UID: \"63cc2993-22c5-4164-a4bd-71a717184cbc\") " pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:10:46.478880 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.478849 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" Jul 15 21:10:46.494189 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494166 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-registry-tls\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494286 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494200 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vpdz\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-kube-api-access-7vpdz\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494286 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494221 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36fa18b3-8eb4-43e3-b407-cb5f7191534b-image-registry-private-configuration\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494286 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494251 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-bound-sa-token\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494286 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36fa18b3-8eb4-43e3-b407-cb5f7191534b-ca-trust-extracted\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494467 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36fa18b3-8eb4-43e3-b407-cb5f7191534b-trusted-ca\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494467 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494314 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36fa18b3-8eb4-43e3-b407-cb5f7191534b-installation-pull-secrets\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494467 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494345 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36fa18b3-8eb4-43e3-b407-cb5f7191534b-registry-certificates\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.494791 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.494762 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36fa18b3-8eb4-43e3-b407-cb5f7191534b-ca-trust-extracted\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.495323 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.495300 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36fa18b3-8eb4-43e3-b407-cb5f7191534b-registry-certificates\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.495393 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.495306 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36fa18b3-8eb4-43e3-b407-cb5f7191534b-trusted-ca\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.496662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.496636 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36fa18b3-8eb4-43e3-b407-cb5f7191534b-image-registry-private-configuration\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.496913 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.496893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36fa18b3-8eb4-43e3-b407-cb5f7191534b-installation-pull-secrets\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.497067 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.497050 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-registry-tls\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.502790 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.502774 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:46.505829 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.505805 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-bound-sa-token\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.506036 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.506019 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vpdz\" (UniqueName: \"kubernetes.io/projected/36fa18b3-8eb4-43e3-b407-cb5f7191534b-kube-api-access-7vpdz\") pod \"image-registry-5bbb6dd94b-9npwb\" (UID: \"36fa18b3-8eb4-43e3-b407-cb5f7191534b\") " pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:46.537549 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.537529 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:10:46.624703 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:46.624683 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:47.878609 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:47.878009 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87f885ffc-s7bwv"] Jul 15 21:10:47.901854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:47.901773 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t"] Jul 15 21:10:47.995344 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:47.995269 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e4b7b9_30ab_4ba9_a81a_6562b96cfb1d.slice/crio-4cd350062010d6c43725d76f483511551f0178d5923af75039169e26ff6d8899 WatchSource:0}: Error finding container 4cd350062010d6c43725d76f483511551f0178d5923af75039169e26ff6d8899: Status 404 returned error can't find the container with id 4cd350062010d6c43725d76f483511551f0178d5923af75039169e26ff6d8899 Jul 15 21:10:47.996348 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:47.996321 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0b117b_ac33_4ea1_8e69_8b36476617a5.slice/crio-eba3b96cd8c1e5ca7be9ea8ac0526198f0c6c9754e190d98a855fd819a42cfd7 WatchSource:0}: Error finding container eba3b96cd8c1e5ca7be9ea8ac0526198f0c6c9754e190d98a855fd819a42cfd7: Status 404 returned error can't find the container with id eba3b96cd8c1e5ca7be9ea8ac0526198f0c6c9754e190d98a855fd819a42cfd7 Jul 15 21:10:48.134707 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.134672 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8"] Jul 15 21:10:48.140465 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.140398 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s6wjx"] Jul 15 21:10:48.143287 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.143253 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-6p6fn"] Jul 15 21:10:48.147216 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.147163 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbb6dd94b-9npwb"] Jul 15 21:10:48.350991 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:48.350937 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d75077a_4b89_453d_947f_cfb436fce76c.slice/crio-88624ee3e03c75cfddcc1b643dd323c3450c2d45baece1f7bf0bf9be0d0f6857 WatchSource:0}: Error finding container 88624ee3e03c75cfddcc1b643dd323c3450c2d45baece1f7bf0bf9be0d0f6857: Status 404 returned error can't find the container with id 88624ee3e03c75cfddcc1b643dd323c3450c2d45baece1f7bf0bf9be0d0f6857 Jul 15 21:10:48.352153 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:48.352129 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fa18b3_8eb4_43e3_b407_cb5f7191534b.slice/crio-35ae0025497c98d7b94470e1771185e5f8bd28c1bbbce5ede01027cdd320382b WatchSource:0}: Error finding container 35ae0025497c98d7b94470e1771185e5f8bd28c1bbbce5ede01027cdd320382b: Status 404 returned error can't find the container with id 35ae0025497c98d7b94470e1771185e5f8bd28c1bbbce5ede01027cdd320382b Jul 15 21:10:48.353205 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:48.353185 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccf5bb8c_b466_4ba1_932d_28205d27a893.slice/crio-131fd6346e18013cf71cf051501f1734ece26cd3d8aa924d9418b82eb287b927 WatchSource:0}: Error finding container 131fd6346e18013cf71cf051501f1734ece26cd3d8aa924d9418b82eb287b927: Status 404 returned error can't find the container with id 131fd6346e18013cf71cf051501f1734ece26cd3d8aa924d9418b82eb287b927 Jul 15 21:10:48.354266 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:48.354242 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cc2993_22c5_4164_a4bd_71a717184cbc.slice/crio-1ac033a93ac624d684d95ace7015d998d905e2776b239e9672bdc71e8ef03c2f WatchSource:0}: Error finding container 1ac033a93ac624d684d95ace7015d998d905e2776b239e9672bdc71e8ef03c2f: Status 404 returned error can't find the container with id 1ac033a93ac624d684d95ace7015d998d905e2776b239e9672bdc71e8ef03c2f Jul 15 21:10:48.417367 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.417305 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" event={"ID":"36fa18b3-8eb4-43e3-b407-cb5f7191534b","Type":"ContainerStarted","Data":"35ae0025497c98d7b94470e1771185e5f8bd28c1bbbce5ede01027cdd320382b"} Jul 15 21:10:48.419558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.419534 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" event={"ID":"8a0b117b-ac33-4ea1-8e69-8b36476617a5","Type":"ContainerStarted","Data":"eba3b96cd8c1e5ca7be9ea8ac0526198f0c6c9754e190d98a855fd819a42cfd7"} Jul 15 21:10:48.420766 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.420740 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" event={"ID":"ccf5bb8c-b466-4ba1-932d-28205d27a893","Type":"ContainerStarted","Data":"131fd6346e18013cf71cf051501f1734ece26cd3d8aa924d9418b82eb287b927"} Jul 15 21:10:48.422670 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.422642 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-6p6fn" event={"ID":"63cc2993-22c5-4164-a4bd-71a717184cbc","Type":"ContainerStarted","Data":"1ac033a93ac624d684d95ace7015d998d905e2776b239e9672bdc71e8ef03c2f"} Jul 15 21:10:48.424062 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.424003 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" event={"ID":"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d","Type":"ContainerStarted","Data":"4cd350062010d6c43725d76f483511551f0178d5923af75039169e26ff6d8899"} Jul 15 21:10:48.425444 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:48.425417 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6wjx" event={"ID":"4d75077a-4b89-453d-947f-cfb436fce76c","Type":"ContainerStarted","Data":"88624ee3e03c75cfddcc1b643dd323c3450c2d45baece1f7bf0bf9be0d0f6857"} Jul 15 21:10:49.442614 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.442477 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp6n" event={"ID":"fdb7f91b-dfa0-4608-9a6a-75a385388b06","Type":"ContainerStarted","Data":"2c6cdc23b68429acf60508e8a173d852e01576b2f88cd5090138c6b5077f5f49"} Jul 15 21:10:49.446550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.445730 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" event={"ID":"36fa18b3-8eb4-43e3-b407-cb5f7191534b","Type":"ContainerStarted","Data":"eb8eb5f44150e6c732db2c9dea8d471e3105ef3acb3385274d7c30c2b8d7d4b0"} Jul 15 21:10:49.446550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.446489 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:10:49.451496 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.451421 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29vkv" event={"ID":"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e","Type":"ContainerStarted","Data":"4bb192c925a08c3fc2d20d32b37e264d2bedc564ac1ff68d44d2d64ecef20197"} Jul 15 21:10:49.455105 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.454574 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" event={"ID":"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d","Type":"ContainerStarted","Data":"b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4"} Jul 15 21:10:49.455105 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.454824 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:10:49.468187 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.467981 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" podStartSLOduration=3.4679623299999998 podStartE2EDuration="3.46796233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:49.466322015 +0000 UTC m=+70.947306607" watchObservedRunningTime="2026-07-15 21:10:49.46796233 +0000 UTC m=+70.948946922" Jul 15 21:10:49.490877 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:49.490005 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" podStartSLOduration=61.48998827 podStartE2EDuration="1m1.48998827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:49.489328378 +0000 UTC m=+70.970312970" watchObservedRunningTime="2026-07-15 21:10:49.48998827 +0000 UTC m=+70.970972862" Jul 15 21:10:52.474859 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.474521 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh"] Jul 15 21:10:52.480643 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.480589 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:52.483513 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.483128 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 21:10:52.483513 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.483375 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kvq2d\"" Jul 15 21:10:52.486283 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.486261 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh"] Jul 15 21:10:52.553406 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.553378 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40274878-f0a4-47d7-a27e-f9304422ed22-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-md5gh\" (UID: \"40274878-f0a4-47d7-a27e-f9304422ed22\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:52.654764 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.654663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40274878-f0a4-47d7-a27e-f9304422ed22-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-md5gh\" (UID: \"40274878-f0a4-47d7-a27e-f9304422ed22\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:52.658821 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.658770 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40274878-f0a4-47d7-a27e-f9304422ed22-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-md5gh\" (UID: \"40274878-f0a4-47d7-a27e-f9304422ed22\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:52.793880 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:52.793802 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:57.767973 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:57.765910 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh"] Jul 15 21:10:57.772409 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:10:57.772345 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40274878_f0a4_47d7_a27e_f9304422ed22.slice/crio-f2649908c3b433ba6bbc5d9d16ed14bd9aab2dcbf44d6aec5cda2cd58e85245b WatchSource:0}: Error finding container f2649908c3b433ba6bbc5d9d16ed14bd9aab2dcbf44d6aec5cda2cd58e85245b: Status 404 returned error can't find the container with id f2649908c3b433ba6bbc5d9d16ed14bd9aab2dcbf44d6aec5cda2cd58e85245b Jul 15 21:10:58.496483 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.496440 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" event={"ID":"40274878-f0a4-47d7-a27e-f9304422ed22","Type":"ContainerStarted","Data":"f2649908c3b433ba6bbc5d9d16ed14bd9aab2dcbf44d6aec5cda2cd58e85245b"} Jul 15 21:10:58.498905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.498863 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp6n" event={"ID":"fdb7f91b-dfa0-4608-9a6a-75a385388b06","Type":"ContainerStarted","Data":"5cd397deced2a20ab9477b67c7656d32687388f3edaf2cb4c29c68537d5a33ba"} Jul 15 21:10:58.500431 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.500401 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p6dbj" event={"ID":"59dcaa4d-edab-4b62-8d52-e77f680454fa","Type":"ContainerStarted","Data":"98f27ad6d757e89dad43bd5172345bfffb5455afac14138e11ac9bcb9166282f"} Jul 15 21:10:58.503729 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.503694 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6wjx" event={"ID":"4d75077a-4b89-453d-947f-cfb436fce76c","Type":"ContainerStarted","Data":"8dd44ec384b9bc3e92eafca9127741b600b9d3a945f223b4da8b31fc4002d513"} Jul 15 21:10:58.503862 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.503744 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6wjx" event={"ID":"4d75077a-4b89-453d-947f-cfb436fce76c","Type":"ContainerStarted","Data":"463b62ab742e0e6326f5655c9b311ff7800380e023b32511af785d6eb17241d4"} Jul 15 21:10:58.503862 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.503774 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s6wjx" Jul 15 21:10:58.505648 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.505623 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nw4qk" event={"ID":"edf5334e-28c6-4b10-8518-53e51ee345a4","Type":"ContainerStarted","Data":"3c1de7f14d5e8ecde62a17d1165bbe588fc4d209dffe23b2704b813fef4c20c6"} Jul 15 21:10:58.506064 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.506044 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:10:58.507406 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.507385 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" event={"ID":"8a0b117b-ac33-4ea1-8e69-8b36476617a5","Type":"ContainerStarted","Data":"59ada64602fa07a7777fbf95d05077d555de981620c74f7d7041a2c40974d2f4"} Jul 15 21:10:58.507615 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.507595 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:58.509586 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.509553 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29vkv" event={"ID":"5a692c81-d4d5-4032-ba6f-aa0a44dfad0e","Type":"ContainerStarted","Data":"e0bcfa5a30634fe033589c905ecb3fcf07b5091c4e2b62719455764bb18d6323"} Jul 15 21:10:58.509686 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.509671 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" Jul 15 21:10:58.511227 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.511207 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" event={"ID":"ccf5bb8c-b466-4ba1-932d-28205d27a893","Type":"ContainerStarted","Data":"46d4df23831a0d8f23e3955965d934097f22626ad507f7626aa39e04406ad56b"} Jul 15 21:10:58.520674 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.520634 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-znp6n" podStartSLOduration=18.166476078 podStartE2EDuration="36.520621987s" totalImagesPullingTime="18.354145909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.519901894 +0000 UTC m=+80.000886485" watchObservedRunningTime="2026-07-15 21:10:58.520621987 +0000 UTC m=+80.001606556" Jul 15 21:10:58.554697 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.554633 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-29vkv" podStartSLOduration=76.074736316 podStartE2EDuration="1m19.554621685s" totalImagesPullingTime="3.479885369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.554304568 +0000 UTC m=+80.035289157" watchObservedRunningTime="2026-07-15 21:10:58.554621685 +0000 UTC m=+80.035606315" Jul 15 21:10:58.579287 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.579240 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86cc4ddf95-b7h2t" podStartSLOduration=2.996762807 podStartE2EDuration="12.57922512s" totalImagesPullingTime="9.582462313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.578333171 +0000 UTC m=+80.059317762" watchObservedRunningTime="2026-07-15 21:10:58.57922512 +0000 UTC m=+80.060209710" Jul 15 21:10:58.614248 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.614183 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nw4qk" podStartSLOduration=67.268994039 podStartE2EDuration="1m19.614164603s" totalImagesPullingTime="12.345170564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.612536013 +0000 UTC m=+80.093520604" watchObservedRunningTime="2026-07-15 21:10:58.614164603 +0000 UTC m=+80.095149195" Jul 15 21:10:58.680891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.680832 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p6dbj" podStartSLOduration=67.253693406 podStartE2EDuration="1m19.680812389s" totalImagesPullingTime="12.427118983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.635452815 +0000 UTC m=+80.116437405" watchObservedRunningTime="2026-07-15 21:10:58.680812389 +0000 UTC m=+80.161796976" Jul 15 21:10:58.681076 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.681052 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s6wjx" podStartSLOduration=36.486429167 podStartE2EDuration="45.681042175s" totalImagesPullingTime="9.194613008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.67938499 +0000 UTC m=+80.160369582" watchObservedRunningTime="2026-07-15 21:10:58.681042175 +0000 UTC m=+80.162026766" Jul 15 21:10:58.725434 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:58.725372 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85dc65b7d8-jvtc8" podStartSLOduration=3.5171274439999998 podStartE2EDuration="12.725351879s" totalImagesPullingTime="9.208224435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.724845642 +0000 UTC m=+80.205830234" watchObservedRunningTime="2026-07-15 21:10:58.725351879 +0000 UTC m=+80.206336471" Jul 15 21:10:59.520985 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:59.520943 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" event={"ID":"40274878-f0a4-47d7-a27e-f9304422ed22","Type":"ContainerStarted","Data":"3b96ddd726e08638afb169e35106a0dbeb8ed31b37e4c8605e7ac43c8d576670"} Jul 15 21:10:59.522472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:59.522444 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:59.528067 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:59.528045 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" Jul 15 21:10:59.541428 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:10:59.541338 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-md5gh" podStartSLOduration=6.025161559 podStartE2EDuration="7.54131964s" totalImagesPullingTime="1.516158081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:59.540580636 +0000 UTC m=+81.021565227" watchObservedRunningTime="2026-07-15 21:10:59.54131964 +0000 UTC m=+81.022304212" Jul 15 21:11:05.124163 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.124056 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7wgmf"] Jul 15 21:11:05.308167 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.308137 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7wgmf"] Jul 15 21:11:05.308341 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.308185 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wxp8v"] Jul 15 21:11:05.308341 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.308270 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.311263 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.311220 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 21:11:05.311980 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.311796 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 21:11:05.313411 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.312282 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 21:11:05.313411 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.312519 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5whnk\"" Jul 15 21:11:05.313411 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.312722 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 21:11:05.313411 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.312982 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 21:11:05.314311 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.314293 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 21:11:05.335161 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.335134 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.339031 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.339009 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 21:11:05.339031 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.339022 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 21:11:05.339197 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.339078 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-phnng\"" Jul 15 21:11:05.339197 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.339092 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 21:11:05.457536 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457363 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72qp\" (UniqueName: \"kubernetes.io/projected/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-api-access-t72qp\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.457536 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457402 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-tls\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457536 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457437 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-root\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457536 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457460 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457536 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457492 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.457536 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457514 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-wtmp\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-textfile\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457581 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln2sg\" (UniqueName: \"kubernetes.io/projected/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-kube-api-access-ln2sg\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457612 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-sys\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457668 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457707 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-metrics-client-ca\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457738 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d086095-eb77-42cd-8740-4f3a001ccb39-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d086095-eb77-42cd-8740-4f3a001ccb39-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.457887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457845 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.458217 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.457896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558426 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558392 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72qp\" (UniqueName: \"kubernetes.io/projected/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-api-access-t72qp\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.558426 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-tls\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558454 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-root\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558478 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.558653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-wtmp\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558550 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-root\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558556 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-textfile\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558747 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln2sg\" (UniqueName: \"kubernetes.io/projected/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-kube-api-access-ln2sg\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558785 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-sys\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.558885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558815 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.558885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558840 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-metrics-client-ca\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.559193 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558886 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d086095-eb77-42cd-8740-4f3a001ccb39-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.559193 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558942 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d086095-eb77-42cd-8740-4f3a001ccb39-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.559193 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558967 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-textfile\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.559193 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.558969 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.559193 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.559158 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.559248 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.559390 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-wtmp\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.559510 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-sys\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.559714 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.559739 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d086095-eb77-42cd-8740-4f3a001ccb39-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.560017 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-metrics-client-ca\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.560190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.560133 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d086095-eb77-42cd-8740-4f3a001ccb39-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.561691 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.561673 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.562107 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.562086 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-tls\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.562291 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.562268 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.562451 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.562430 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.568160 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.568134 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln2sg\" (UniqueName: \"kubernetes.io/projected/2f4b6a2a-83d7-4ba6-83ed-7acab88330dd-kube-api-access-ln2sg\") pod \"node-exporter-wxp8v\" (UID: \"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd\") " pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:05.568440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.568424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72qp\" (UniqueName: \"kubernetes.io/projected/0d086095-eb77-42cd-8740-4f3a001ccb39-kube-api-access-t72qp\") pod \"kube-state-metrics-785778ff74-7wgmf\" (UID: \"0d086095-eb77-42cd-8740-4f3a001ccb39\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.620584 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.620554 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" Jul 15 21:11:05.644110 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:05.644084 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxp8v" Jul 15 21:11:08.113381 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:11:08.113343 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4b6a2a_83d7_4ba6_83ed_7acab88330dd.slice/crio-5e197e24b030572a9d5f8799eb8b9924815d84b938eb3a758e2b19938478ddf5 WatchSource:0}: Error finding container 5e197e24b030572a9d5f8799eb8b9924815d84b938eb3a758e2b19938478ddf5: Status 404 returned error can't find the container with id 5e197e24b030572a9d5f8799eb8b9924815d84b938eb3a758e2b19938478ddf5 Jul 15 21:11:08.233265 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:08.233220 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7wgmf"] Jul 15 21:11:08.236726 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:11:08.236703 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d086095_eb77_42cd_8740_4f3a001ccb39.slice/crio-e334b4007ede7de8b6f37a8397feb4e809d160f4d7b43c3efec19a482b47eca7 WatchSource:0}: Error finding container e334b4007ede7de8b6f37a8397feb4e809d160f4d7b43c3efec19a482b47eca7: Status 404 returned error can't find the container with id e334b4007ede7de8b6f37a8397feb4e809d160f4d7b43c3efec19a482b47eca7 Jul 15 21:11:08.523236 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:08.523218 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s6wjx" Jul 15 21:11:08.555532 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:08.555376 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxp8v" event={"ID":"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd","Type":"ContainerStarted","Data":"5e197e24b030572a9d5f8799eb8b9924815d84b938eb3a758e2b19938478ddf5"} Jul 15 21:11:08.556834 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:08.556800 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" event={"ID":"0d086095-eb77-42cd-8740-4f3a001ccb39","Type":"ContainerStarted","Data":"e334b4007ede7de8b6f37a8397feb4e809d160f4d7b43c3efec19a482b47eca7"} Jul 15 21:11:09.461474 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.461441 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:11:09.563289 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.563249 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-6p6fn" event={"ID":"63cc2993-22c5-4164-a4bd-71a717184cbc","Type":"ContainerStarted","Data":"9e977f93f86aeb070c7e090119f7c8a24a2ea56063c819426437e8caf358f46b"} Jul 15 21:11:09.563502 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.563460 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:11:09.587398 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.587345 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-6p6fn" podStartSLOduration=3.47758235 podStartE2EDuration="23.587325941s" totalImagesPullingTime="20.109743591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:09.58695778 +0000 UTC m=+91.067942373" watchObservedRunningTime="2026-07-15 21:11:09.587325941 +0000 UTC m=+91.068310533" Jul 15 21:11:09.587560 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.587475 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-6p6fn" Jul 15 21:11:09.963719 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.963685 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6976876dc9-4df6c"] Jul 15 21:11:09.998955 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:09.998899 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.002101 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.001907 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 21:11:10.002946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.002709 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 21:11:10.002946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.002780 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 21:11:10.005003 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.004983 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-64fj2\"" Jul 15 21:11:10.011206 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.010693 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 21:11:10.011567 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.011386 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 21:11:10.020130 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.020102 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 21:11:10.020650 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.020594 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6976876dc9-4df6c"] Jul 15 21:11:10.095268 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095129 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-oauth-config\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.095769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095513 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8hx\" (UniqueName: \"kubernetes.io/projected/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-kube-api-access-ts8hx\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.095769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095575 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-service-ca\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.095769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095620 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-config\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.095769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095644 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-serving-cert\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.095769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095674 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-trusted-ca-bundle\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.095769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.095698 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-oauth-serving-cert\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196371 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-oauth-config\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196446 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8hx\" (UniqueName: \"kubernetes.io/projected/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-kube-api-access-ts8hx\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196475 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-service-ca\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-config\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-serving-cert\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196554 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-trusted-ca-bundle\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.196617 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.196575 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-oauth-serving-cert\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.197389 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.197357 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-service-ca\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.197530 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.197503 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-config\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.198025 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.197975 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-oauth-serving-cert\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.198274 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.198239 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-trusted-ca-bundle\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.199570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.199514 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-serving-cert\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.199570 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.199545 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-oauth-config\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.205280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.205254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8hx\" (UniqueName: \"kubernetes.io/projected/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-kube-api-access-ts8hx\") pod \"console-6976876dc9-4df6c\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.313252 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.313222 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:10.492612 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.492541 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6976876dc9-4df6c"] Jul 15 21:11:10.498570 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:11:10.498404 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a64e2f_d1ae_4836_b8d3_e2e8326cca16.slice/crio-1f4304a0302629c005525697c27139639bee211bb749fbd76a8375d0c5dd370a WatchSource:0}: Error finding container 1f4304a0302629c005525697c27139639bee211bb749fbd76a8375d0c5dd370a: Status 404 returned error can't find the container with id 1f4304a0302629c005525697c27139639bee211bb749fbd76a8375d0c5dd370a Jul 15 21:11:10.568814 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.568770 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976876dc9-4df6c" event={"ID":"31a64e2f-d1ae-4836-b8d3-e2e8326cca16","Type":"ContainerStarted","Data":"1f4304a0302629c005525697c27139639bee211bb749fbd76a8375d0c5dd370a"} Jul 15 21:11:10.570653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.570621 2585 generic.go:356] "Generic (PLEG): container finished" podID="2f4b6a2a-83d7-4ba6-83ed-7acab88330dd" containerID="a3c0428dae8dd4a76de495deda7578d4cad49d83273755aaade035aedf7f6411" exitCode=0 Jul 15 21:11:10.570769 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:10.570711 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxp8v" event={"ID":"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd","Type":"ContainerDied","Data":"a3c0428dae8dd4a76de495deda7578d4cad49d83273755aaade035aedf7f6411"} Jul 15 21:11:11.472681 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.472599 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bbb6dd94b-9npwb" Jul 15 21:11:11.579154 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.579113 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxp8v" event={"ID":"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd","Type":"ContainerStarted","Data":"e82fcd91de1633bf6956e9e87169f4043a983c51c02742150b2ad7a09f8096a2"} Jul 15 21:11:11.579595 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.579182 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxp8v" event={"ID":"2f4b6a2a-83d7-4ba6-83ed-7acab88330dd","Type":"ContainerStarted","Data":"7cda82416c7d7dbee7e7450fcb951fda107ad0dcd7b236eaa3d88b585221b0b9"} Jul 15 21:11:11.582902 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.582868 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" event={"ID":"0d086095-eb77-42cd-8740-4f3a001ccb39","Type":"ContainerStarted","Data":"fcf6f25c886d1c2371000eb5508745064ab9dd6454f4096c4a5f3d1fdfba4e4c"} Jul 15 21:11:11.583053 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.582947 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" event={"ID":"0d086095-eb77-42cd-8740-4f3a001ccb39","Type":"ContainerStarted","Data":"3e4a781469299b909da6915d3dad0063b8d00e1b0fb802e9ddc97ca0fe510ae0"} Jul 15 21:11:11.583053 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.582977 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" event={"ID":"0d086095-eb77-42cd-8740-4f3a001ccb39","Type":"ContainerStarted","Data":"a538818babf7a7039168c5577b622c7dcf24cee07a60d2ff75d4ab8979ce3fe4"} Jul 15 21:11:11.608185 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.608127 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wxp8v" podStartSLOduration=4.334275704 podStartE2EDuration="6.608106811s" totalImagesPullingTime="2.152910748s" totalInitContainerRuntime="120.920359ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:11.606357317 +0000 UTC m=+93.087341908" watchObservedRunningTime="2026-07-15 21:11:11.608106811 +0000 UTC m=+93.089091403" Jul 15 21:11:11.636704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:11.636646 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-7wgmf" podStartSLOduration=4.386894345 podStartE2EDuration="6.636624718s" totalImagesPullingTime="2.249730373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:11.631999629 +0000 UTC m=+93.112984221" watchObservedRunningTime="2026-07-15 21:11:11.636624718 +0000 UTC m=+93.117609312" Jul 15 21:11:14.498772 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.498711 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" podUID="d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" containerName="registry" containerID="cri-o://b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4" gracePeriod=30 Jul 15 21:11:14.600234 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.600193 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976876dc9-4df6c" event={"ID":"31a64e2f-d1ae-4836-b8d3-e2e8326cca16","Type":"ContainerStarted","Data":"467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4"} Jul 15 21:11:14.620408 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.620356 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6976876dc9-4df6c" podStartSLOduration=2.05890005 podStartE2EDuration="5.620341035s" totalImagesPullingTime="3.561440985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:14.619082838 +0000 UTC m=+96.100067442" watchObservedRunningTime="2026-07-15 21:11:14.620341035 +0000 UTC m=+96.101325624" Jul 15 21:11:14.800981 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.800950 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:11:14.939120 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939079 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939288 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939143 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-installation-pull-secrets\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939288 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939165 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-bound-sa-token\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939288 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939196 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-certificates\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939288 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939240 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-image-registry-private-configuration\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939288 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939265 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-trusted-ca\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939320 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxpv6\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-kube-api-access-sxpv6\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.939578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.939367 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-ca-trust-extracted\") pod \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\" (UID: \"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d\") " Jul 15 21:11:14.940108 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.940042 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:14.940237 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.940199 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:14.942465 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.942424 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:14.942569 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.942462 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:14.942989 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.942842 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:14.943587 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.943552 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:14.944176 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.944141 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-kube-api-access-sxpv6" (OuterVolumeSpecName: "kube-api-access-sxpv6") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "kube-api-access-sxpv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:14.951367 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:14.951342 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" (UID: "d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:11:15.040607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040544 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-trusted-ca\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040569 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxpv6\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-kube-api-access-sxpv6\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040579 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-ca-trust-extracted\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040589 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-tls\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040599 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-installation-pull-secrets\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040607 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-bound-sa-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040945 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040621 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-registry-certificates\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.040945 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.040636 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d-image-registry-private-configuration\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:11:15.605338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.605303 2585 generic.go:356] "Generic (PLEG): container finished" podID="d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" containerID="b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4" exitCode=0 Jul 15 21:11:15.605793 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.605367 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" Jul 15 21:11:15.605793 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.605397 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" event={"ID":"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d","Type":"ContainerDied","Data":"b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4"} Jul 15 21:11:15.605793 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.605460 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87f885ffc-s7bwv" event={"ID":"d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d","Type":"ContainerDied","Data":"4cd350062010d6c43725d76f483511551f0178d5923af75039169e26ff6d8899"} Jul 15 21:11:15.605793 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.605493 2585 scope.go:117] "RemoveContainer" containerID="b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4" Jul 15 21:11:15.616901 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.616879 2585 scope.go:117] "RemoveContainer" containerID="b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4" Jul 15 21:11:15.617250 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:11:15.617223 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4\": container with ID starting with b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4 not found: ID does not exist" containerID="b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4" Jul 15 21:11:15.617339 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.617259 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4"} err="failed to get container status \"b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4\": rpc error: code = NotFound desc = could not find container \"b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4\": container with ID starting with b77aba061ab44249b13b58eabc5b45ec8b581eaadadc8edc291c236e6c389ca4 not found: ID does not exist" Jul 15 21:11:15.626093 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.626071 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87f885ffc-s7bwv"] Jul 15 21:11:15.632818 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:15.632798 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-87f885ffc-s7bwv"] Jul 15 21:11:16.977348 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:16.977311 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" path="/var/lib/kubelet/pods/d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d/volumes" Jul 15 21:11:20.313797 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:20.313763 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:20.314391 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:20.313832 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:20.318272 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:20.318251 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:20.630472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:20.630444 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:11:30.526937 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:11:30.526890 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nw4qk" Jul 15 21:12:29.508957 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.508910 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-667cd4848f-tcfk2"] Jul 15 21:12:29.509496 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.509280 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" containerName="registry" Jul 15 21:12:29.509496 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.509296 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" containerName="registry" Jul 15 21:12:29.509496 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.509350 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e4b7b9-30ab-4ba9-a81a-6562b96cfb1d" containerName="registry" Jul 15 21:12:29.512449 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.512428 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.514814 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.514795 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 21:12:29.515092 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.515073 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 21:12:29.515395 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.515374 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 21:12:29.515656 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.515637 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 21:12:29.515736 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.515682 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fc996\"" Jul 15 21:12:29.515794 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.515682 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 21:12:29.522239 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.522219 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 21:12:29.527209 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.527189 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-667cd4848f-tcfk2"] Jul 15 21:12:29.555772 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.555735 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-secret-telemeter-client\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.555967 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.555777 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-serving-certs-ca-bundle\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.555967 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.555800 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-federate-client-tls\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.555967 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.555851 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-telemeter-client-tls\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.555967 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.555900 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-metrics-client-ca\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.555967 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.555968 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4n9f\" (UniqueName: \"kubernetes.io/projected/bbde7504-23d7-42c6-9418-e66973955db2-kube-api-access-q4n9f\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.556206 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.556008 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.556206 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.556031 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.656976 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.656905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.656976 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.656978 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657012 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-secret-telemeter-client\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657037 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-serving-certs-ca-bundle\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-federate-client-tls\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-telemeter-client-tls\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657129 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-metrics-client-ca\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657151 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4n9f\" (UniqueName: \"kubernetes.io/projected/bbde7504-23d7-42c6-9418-e66973955db2-kube-api-access-q4n9f\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.657970 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657939 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-serving-certs-ca-bundle\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.658100 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.657999 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.658207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.658189 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbde7504-23d7-42c6-9418-e66973955db2-metrics-client-ca\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.659610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.659588 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-telemeter-client-tls\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.659813 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.659789 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-secret-telemeter-client\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.659882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.659862 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.659963 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.659863 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bbde7504-23d7-42c6-9418-e66973955db2-federate-client-tls\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.665910 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.665890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4n9f\" (UniqueName: \"kubernetes.io/projected/bbde7504-23d7-42c6-9418-e66973955db2-kube-api-access-q4n9f\") pod \"telemeter-client-667cd4848f-tcfk2\" (UID: \"bbde7504-23d7-42c6-9418-e66973955db2\") " pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.822816 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.822736 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" Jul 15 21:12:29.957958 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:29.957909 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-667cd4848f-tcfk2"] Jul 15 21:12:29.960646 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:12:29.960615 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbde7504_23d7_42c6_9418_e66973955db2.slice/crio-246b37c6e6e6d91d507581fc8d67307417bbd4ddea999c9c7eaef1267ce2e12f WatchSource:0}: Error finding container 246b37c6e6e6d91d507581fc8d67307417bbd4ddea999c9c7eaef1267ce2e12f: Status 404 returned error can't find the container with id 246b37c6e6e6d91d507581fc8d67307417bbd4ddea999c9c7eaef1267ce2e12f Jul 15 21:12:30.866006 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:30.865900 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" event={"ID":"bbde7504-23d7-42c6-9418-e66973955db2","Type":"ContainerStarted","Data":"246b37c6e6e6d91d507581fc8d67307417bbd4ddea999c9c7eaef1267ce2e12f"} Jul 15 21:12:32.876055 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:32.876019 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" event={"ID":"bbde7504-23d7-42c6-9418-e66973955db2","Type":"ContainerStarted","Data":"3cde2c23bf2bc8378b15c6dbc59e6bc1eb5ab893c65eec23726e09354851857e"} Jul 15 21:12:33.882466 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:33.882428 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" event={"ID":"bbde7504-23d7-42c6-9418-e66973955db2","Type":"ContainerStarted","Data":"acb5545d0466dbff64acbf12567789c83edc58f8b4aacebbf0dfda9a5a992d9a"} Jul 15 21:12:33.882955 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:33.882480 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" event={"ID":"bbde7504-23d7-42c6-9418-e66973955db2","Type":"ContainerStarted","Data":"c4ef5bcbac90ed572e00ee77fd078ee22d62c57e814ddc127138eeb2d0a10694"} Jul 15 21:12:33.905212 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:33.905164 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-667cd4848f-tcfk2" podStartSLOduration=1.999163324 podStartE2EDuration="4.905148289s" totalImagesPullingTime="2.905984965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:33.903894253 +0000 UTC m=+175.384878846" watchObservedRunningTime="2026-07-15 21:12:33.905148289 +0000 UTC m=+175.386132880" Jul 15 21:12:34.664602 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.664569 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64fb6dd659-fk9vj"] Jul 15 21:12:34.666778 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.666761 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.680761 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.680737 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64fb6dd659-fk9vj"] Jul 15 21:12:34.795792 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.795752 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-trusted-ca-bundle\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.795792 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.795794 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-serving-cert\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.796014 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.795811 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-service-ca\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.796014 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.795857 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fkd4\" (UniqueName: \"kubernetes.io/projected/541f3bf0-4682-419f-a7bc-38c39785b912-kube-api-access-7fkd4\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.796014 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.795886 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-oauth-config\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.796014 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.795967 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-console-config\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.796132 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.796024 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-oauth-serving-cert\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896483 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896453 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-trusted-ca-bundle\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896483 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896488 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-serving-cert\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896988 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896503 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-service-ca\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896988 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fkd4\" (UniqueName: \"kubernetes.io/projected/541f3bf0-4682-419f-a7bc-38c39785b912-kube-api-access-7fkd4\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896988 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896561 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-oauth-config\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896988 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-console-config\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.896988 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.896611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-oauth-serving-cert\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.897370 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.897328 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-service-ca\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.897454 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.897368 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-console-config\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.897454 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.897373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-oauth-serving-cert\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.897658 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.897632 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-trusted-ca-bundle\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.899161 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.899137 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-serving-cert\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.899281 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.899260 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-oauth-config\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.904563 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.904539 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fkd4\" (UniqueName: \"kubernetes.io/projected/541f3bf0-4682-419f-a7bc-38c39785b912-kube-api-access-7fkd4\") pod \"console-64fb6dd659-fk9vj\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:34.974963 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:34.974873 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:35.116741 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:35.116717 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64fb6dd659-fk9vj"] Jul 15 21:12:35.118905 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:12:35.118873 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541f3bf0_4682_419f_a7bc_38c39785b912.slice/crio-0a194496815f4354d3be00a939faf1b9ff5e456373d350745792b12f56e9d26c WatchSource:0}: Error finding container 0a194496815f4354d3be00a939faf1b9ff5e456373d350745792b12f56e9d26c: Status 404 returned error can't find the container with id 0a194496815f4354d3be00a939faf1b9ff5e456373d350745792b12f56e9d26c Jul 15 21:12:35.895046 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:35.895007 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb6dd659-fk9vj" event={"ID":"541f3bf0-4682-419f-a7bc-38c39785b912","Type":"ContainerStarted","Data":"dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224"} Jul 15 21:12:35.895214 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:35.895098 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb6dd659-fk9vj" event={"ID":"541f3bf0-4682-419f-a7bc-38c39785b912","Type":"ContainerStarted","Data":"0a194496815f4354d3be00a939faf1b9ff5e456373d350745792b12f56e9d26c"} Jul 15 21:12:35.911935 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:35.911872 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64fb6dd659-fk9vj" podStartSLOduration=1.911857454 podStartE2EDuration="1.911857454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:35.910184401 +0000 UTC m=+177.391168992" watchObservedRunningTime="2026-07-15 21:12:35.911857454 +0000 UTC m=+177.392842045" Jul 15 21:12:44.975152 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:44.975125 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:44.975537 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:44.975176 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:44.980023 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:44.980000 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:45.930583 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:45.930555 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:12:45.974439 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:12:45.974411 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6976876dc9-4df6c"] Jul 15 21:13:10.998448 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:10.998395 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6976876dc9-4df6c" podUID="31a64e2f-d1ae-4836-b8d3-e2e8326cca16" containerName="console" containerID="cri-o://467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4" gracePeriod=15 Jul 15 21:13:11.229406 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.229383 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:13:11.265102 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265041 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-config\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265102 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265080 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-serving-cert\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265271 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265122 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-oauth-serving-cert\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265271 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265165 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-oauth-config\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265271 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265192 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-trusted-ca-bundle\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265271 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265217 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts8hx\" (UniqueName: \"kubernetes.io/projected/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-kube-api-access-ts8hx\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265271 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265241 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-service-ca\") pod \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\" (UID: \"31a64e2f-d1ae-4836-b8d3-e2e8326cca16\") " Jul 15 21:13:11.265507 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265485 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-config" (OuterVolumeSpecName: "console-config") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:11.265648 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265607 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:11.265713 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265644 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:11.265749 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.265715 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-service-ca" (OuterVolumeSpecName: "service-ca") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:11.267390 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.267368 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:13:11.267462 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.267386 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-kube-api-access-ts8hx" (OuterVolumeSpecName: "kube-api-access-ts8hx") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "kube-api-access-ts8hx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:13:11.267462 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.267415 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31a64e2f-d1ae-4836-b8d3-e2e8326cca16" (UID: "31a64e2f-d1ae-4836-b8d3-e2e8326cca16"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:13:11.366258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366224 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-config\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:11.366258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366253 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-serving-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:11.366258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366262 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-oauth-serving-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:11.366452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366270 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-console-oauth-config\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:11.366452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366279 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-trusted-ca-bundle\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:11.366452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366286 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts8hx\" (UniqueName: \"kubernetes.io/projected/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-kube-api-access-ts8hx\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:11.366452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:11.366294 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31a64e2f-d1ae-4836-b8d3-e2e8326cca16-service-ca\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:13:12.018823 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.018788 2585 generic.go:356] "Generic (PLEG): container finished" podID="31a64e2f-d1ae-4836-b8d3-e2e8326cca16" containerID="467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4" exitCode=0 Jul 15 21:13:12.019253 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.018833 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976876dc9-4df6c" Jul 15 21:13:12.019253 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.018831 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976876dc9-4df6c" event={"ID":"31a64e2f-d1ae-4836-b8d3-e2e8326cca16","Type":"ContainerDied","Data":"467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4"} Jul 15 21:13:12.019253 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.018975 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976876dc9-4df6c" event={"ID":"31a64e2f-d1ae-4836-b8d3-e2e8326cca16","Type":"ContainerDied","Data":"1f4304a0302629c005525697c27139639bee211bb749fbd76a8375d0c5dd370a"} Jul 15 21:13:12.019253 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.018999 2585 scope.go:117] "RemoveContainer" containerID="467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4" Jul 15 21:13:12.027483 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.027464 2585 scope.go:117] "RemoveContainer" containerID="467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4" Jul 15 21:13:12.027726 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:13:12.027710 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4\": container with ID starting with 467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4 not found: ID does not exist" containerID="467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4" Jul 15 21:13:12.027778 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.027730 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4"} err="failed to get container status \"467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4\": rpc error: code = NotFound desc = could not find container \"467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4\": container with ID starting with 467f60fb08e9dd23936f97bcb640411b627f8de0a82ab14a9bce8d69a6a2c8d4 not found: ID does not exist" Jul 15 21:13:12.041722 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.041694 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6976876dc9-4df6c"] Jul 15 21:13:12.048607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.048573 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6976876dc9-4df6c"] Jul 15 21:13:12.972539 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:12.972510 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a64e2f-d1ae-4836-b8d3-e2e8326cca16" path="/var/lib/kubelet/pods/31a64e2f-d1ae-4836-b8d3-e2e8326cca16/volumes" Jul 15 21:13:39.751560 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.751533 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b65f99c7d-857wr"] Jul 15 21:13:39.751934 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.751807 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a64e2f-d1ae-4836-b8d3-e2e8326cca16" containerName="console" Jul 15 21:13:39.751934 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.751819 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a64e2f-d1ae-4836-b8d3-e2e8326cca16" containerName="console" Jul 15 21:13:39.751934 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.751875 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a64e2f-d1ae-4836-b8d3-e2e8326cca16" containerName="console" Jul 15 21:13:39.755533 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.755513 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.767186 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.767163 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65f99c7d-857wr"] Jul 15 21:13:39.851773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851742 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-trusted-ca-bundle\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.851893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851778 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-oauth-config\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.851893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851794 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-oauth-serving-cert\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.851893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851818 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-service-ca\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.851893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851877 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-serving-cert\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.851893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mknqk\" (UniqueName: \"kubernetes.io/projected/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-kube-api-access-mknqk\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.852100 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.851953 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-config\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953125 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953099 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-config\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953236 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953141 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-trusted-ca-bundle\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953236 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953163 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-oauth-config\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953384 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-oauth-serving-cert\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953429 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953404 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-service-ca\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953478 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-serving-cert\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.953531 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknqk\" (UniqueName: \"kubernetes.io/projected/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-kube-api-access-mknqk\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.954007 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.953979 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-config\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.954098 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.954004 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-oauth-serving-cert\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.954137 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.954121 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-service-ca\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.954169 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.954124 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-trusted-ca-bundle\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.955695 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.955673 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-serving-cert\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.955833 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.955817 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-oauth-config\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:39.963538 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:39.963519 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknqk\" (UniqueName: \"kubernetes.io/projected/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-kube-api-access-mknqk\") pod \"console-b65f99c7d-857wr\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:40.065078 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:40.065022 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:40.189629 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:40.189599 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65f99c7d-857wr"] Jul 15 21:13:40.192097 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:13:40.192070 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ca76c2_ed25_4d11_81ee_fe0d706e4ced.slice/crio-37c8e25971eda36ae23e194109ba2041faea77e991241ebf4d891b167f3c809a WatchSource:0}: Error finding container 37c8e25971eda36ae23e194109ba2041faea77e991241ebf4d891b167f3c809a: Status 404 returned error can't find the container with id 37c8e25971eda36ae23e194109ba2041faea77e991241ebf4d891b167f3c809a Jul 15 21:13:41.124304 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:41.124271 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f99c7d-857wr" event={"ID":"91ca76c2-ed25-4d11-81ee-fe0d706e4ced","Type":"ContainerStarted","Data":"68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc"} Jul 15 21:13:41.124692 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:41.124317 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f99c7d-857wr" event={"ID":"91ca76c2-ed25-4d11-81ee-fe0d706e4ced","Type":"ContainerStarted","Data":"37c8e25971eda36ae23e194109ba2041faea77e991241ebf4d891b167f3c809a"} Jul 15 21:13:41.141932 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:41.141875 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b65f99c7d-857wr" podStartSLOduration=2.141860487 podStartE2EDuration="2.141860487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:13:41.141422908 +0000 UTC m=+242.622407499" watchObservedRunningTime="2026-07-15 21:13:41.141860487 +0000 UTC m=+242.622845077" Jul 15 21:13:50.065358 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:50.065319 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:50.065811 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:50.065381 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:50.070155 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:50.070124 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:50.158999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:50.158968 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:13:50.202139 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:13:50.202106 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64fb6dd659-fk9vj"] Jul 15 21:14:15.224044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.223983 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64fb6dd659-fk9vj" podUID="541f3bf0-4682-419f-a7bc-38c39785b912" containerName="console" containerID="cri-o://dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224" gracePeriod=15 Jul 15 21:14:15.458243 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.458220 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:14:15.520790 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520710 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-console-config\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.520790 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520758 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fkd4\" (UniqueName: \"kubernetes.io/projected/541f3bf0-4682-419f-a7bc-38c39785b912-kube-api-access-7fkd4\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.521027 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520817 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-oauth-config\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.521027 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520845 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-trusted-ca-bundle\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.521027 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520873 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-service-ca\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.521027 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520899 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-serving-cert\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.521027 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.520934 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-oauth-serving-cert\") pod \"541f3bf0-4682-419f-a7bc-38c39785b912\" (UID: \"541f3bf0-4682-419f-a7bc-38c39785b912\") " Jul 15 21:14:15.521257 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.521141 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-console-config" (OuterVolumeSpecName: "console-config") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:14:15.521400 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.521370 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-service-ca" (OuterVolumeSpecName: "service-ca") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:14:15.521464 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.521407 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:14:15.521464 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.521446 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:14:15.523120 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.523095 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:14:15.523394 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.523377 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541f3bf0-4682-419f-a7bc-38c39785b912-kube-api-access-7fkd4" (OuterVolumeSpecName: "kube-api-access-7fkd4") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "kube-api-access-7fkd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:14:15.523460 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.523387 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "541f3bf0-4682-419f-a7bc-38c39785b912" (UID: "541f3bf0-4682-419f-a7bc-38c39785b912"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:14:15.622028 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622002 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-console-config\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:15.622028 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622024 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fkd4\" (UniqueName: \"kubernetes.io/projected/541f3bf0-4682-419f-a7bc-38c39785b912-kube-api-access-7fkd4\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:15.622028 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622034 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-oauth-config\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:15.622196 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622043 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-trusted-ca-bundle\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:15.622196 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622052 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-service-ca\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:15.622196 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622060 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/541f3bf0-4682-419f-a7bc-38c39785b912-console-serving-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:15.622196 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:15.622068 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/541f3bf0-4682-419f-a7bc-38c39785b912-oauth-serving-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:16.245387 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.245349 2585 generic.go:356] "Generic (PLEG): container finished" podID="541f3bf0-4682-419f-a7bc-38c39785b912" containerID="dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224" exitCode=0 Jul 15 21:14:16.245785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.245393 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb6dd659-fk9vj" Jul 15 21:14:16.245785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.245413 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb6dd659-fk9vj" event={"ID":"541f3bf0-4682-419f-a7bc-38c39785b912","Type":"ContainerDied","Data":"dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224"} Jul 15 21:14:16.245785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.245460 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb6dd659-fk9vj" event={"ID":"541f3bf0-4682-419f-a7bc-38c39785b912","Type":"ContainerDied","Data":"0a194496815f4354d3be00a939faf1b9ff5e456373d350745792b12f56e9d26c"} Jul 15 21:14:16.245785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.245486 2585 scope.go:117] "RemoveContainer" containerID="dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224" Jul 15 21:14:16.253464 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.253449 2585 scope.go:117] "RemoveContainer" containerID="dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224" Jul 15 21:14:16.253710 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:14:16.253695 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224\": container with ID starting with dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224 not found: ID does not exist" containerID="dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224" Jul 15 21:14:16.253785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.253719 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224"} err="failed to get container status \"dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224\": rpc error: code = NotFound desc = could not find container \"dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224\": container with ID starting with dba2dad9d47cf538cabb245a130398fbd5b70a8e0a924a031198d5ee6306c224 not found: ID does not exist" Jul 15 21:14:16.265378 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.265355 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64fb6dd659-fk9vj"] Jul 15 21:14:16.269511 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.269491 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64fb6dd659-fk9vj"] Jul 15 21:14:16.973436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:16.973401 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="541f3bf0-4682-419f-a7bc-38c39785b912" path="/var/lib/kubelet/pods/541f3bf0-4682-419f-a7bc-38c39785b912/volumes" Jul 15 21:14:35.486320 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.486288 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9"] Jul 15 21:14:35.486738 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.486554 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541f3bf0-4682-419f-a7bc-38c39785b912" containerName="console" Jul 15 21:14:35.486738 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.486564 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="541f3bf0-4682-419f-a7bc-38c39785b912" containerName="console" Jul 15 21:14:35.486738 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.486616 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="541f3bf0-4682-419f-a7bc-38c39785b912" containerName="console" Jul 15 21:14:35.489471 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.489450 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.492113 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.492094 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-srgtj\"" Jul 15 21:14:35.493652 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.493636 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:14:35.496175 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.496159 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:14:35.501405 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.501387 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9"] Jul 15 21:14:35.663313 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.663269 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.663455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.663323 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.663455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.663404 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv4xz\" (UniqueName: \"kubernetes.io/projected/2c63275a-1673-45d1-b168-94f774298c05-kube-api-access-nv4xz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.764270 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.764207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv4xz\" (UniqueName: \"kubernetes.io/projected/2c63275a-1673-45d1-b168-94f774298c05-kube-api-access-nv4xz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.764270 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.764253 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.764405 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.764289 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.764571 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.764558 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.764605 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.764593 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.774027 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.773999 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv4xz\" (UniqueName: \"kubernetes.io/projected/2c63275a-1673-45d1-b168-94f774298c05-kube-api-access-nv4xz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.797733 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.797712 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:35.925273 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:35.925251 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9"] Jul 15 21:14:35.927365 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:14:35.927337 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c63275a_1673_45d1_b168_94f774298c05.slice/crio-216363cbfbd12caae23f3027487c72f72bafe0e567a9320fd93180a46e6b140f WatchSource:0}: Error finding container 216363cbfbd12caae23f3027487c72f72bafe0e567a9320fd93180a46e6b140f: Status 404 returned error can't find the container with id 216363cbfbd12caae23f3027487c72f72bafe0e567a9320fd93180a46e6b140f Jul 15 21:14:36.319300 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:36.319273 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" event={"ID":"2c63275a-1673-45d1-b168-94f774298c05","Type":"ContainerStarted","Data":"216363cbfbd12caae23f3027487c72f72bafe0e567a9320fd93180a46e6b140f"} Jul 15 21:14:38.881590 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:38.881562 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:14:38.891057 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:38.889760 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:14:38.895611 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:38.895584 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 21:14:42.344035 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:42.343977 2585 generic.go:356] "Generic (PLEG): container finished" podID="2c63275a-1673-45d1-b168-94f774298c05" containerID="6719e4257d160aba04406414c06dec92a640c1a62a048fb6c4c76deb478b3fbd" exitCode=0 Jul 15 21:14:42.344035 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:42.344023 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" event={"ID":"2c63275a-1673-45d1-b168-94f774298c05","Type":"ContainerDied","Data":"6719e4257d160aba04406414c06dec92a640c1a62a048fb6c4c76deb478b3fbd"} Jul 15 21:14:42.344981 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:42.344964 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:14:44.353568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:44.353526 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" event={"ID":"2c63275a-1673-45d1-b168-94f774298c05","Type":"ContainerStarted","Data":"2f2b110ed67f9e807c777dd3d211fc4f069cca1845101e2cb7365b2baaa61544"} Jul 15 21:14:45.358422 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:45.358389 2585 generic.go:356] "Generic (PLEG): container finished" podID="2c63275a-1673-45d1-b168-94f774298c05" containerID="2f2b110ed67f9e807c777dd3d211fc4f069cca1845101e2cb7365b2baaa61544" exitCode=0 Jul 15 21:14:45.358805 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:45.358470 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" event={"ID":"2c63275a-1673-45d1-b168-94f774298c05","Type":"ContainerDied","Data":"2f2b110ed67f9e807c777dd3d211fc4f069cca1845101e2cb7365b2baaa61544"} Jul 15 21:14:52.389308 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:52.389272 2585 generic.go:356] "Generic (PLEG): container finished" podID="2c63275a-1673-45d1-b168-94f774298c05" containerID="822225c477594bfef7dac2889555f4757a5ef0025e7b13a61a062671f78cac47" exitCode=0 Jul 15 21:14:52.389743 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:52.389325 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" event={"ID":"2c63275a-1673-45d1-b168-94f774298c05","Type":"ContainerDied","Data":"822225c477594bfef7dac2889555f4757a5ef0025e7b13a61a062671f78cac47"} Jul 15 21:14:53.517609 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.517581 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:53.705644 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.705558 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-bundle\") pod \"2c63275a-1673-45d1-b168-94f774298c05\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " Jul 15 21:14:53.705644 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.705598 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-util\") pod \"2c63275a-1673-45d1-b168-94f774298c05\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " Jul 15 21:14:53.705644 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.705625 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv4xz\" (UniqueName: \"kubernetes.io/projected/2c63275a-1673-45d1-b168-94f774298c05-kube-api-access-nv4xz\") pod \"2c63275a-1673-45d1-b168-94f774298c05\" (UID: \"2c63275a-1673-45d1-b168-94f774298c05\") " Jul 15 21:14:53.706217 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.706187 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-bundle" (OuterVolumeSpecName: "bundle") pod "2c63275a-1673-45d1-b168-94f774298c05" (UID: "2c63275a-1673-45d1-b168-94f774298c05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:14:53.707752 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.707729 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c63275a-1673-45d1-b168-94f774298c05-kube-api-access-nv4xz" (OuterVolumeSpecName: "kube-api-access-nv4xz") pod "2c63275a-1673-45d1-b168-94f774298c05" (UID: "2c63275a-1673-45d1-b168-94f774298c05"). InnerVolumeSpecName "kube-api-access-nv4xz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:14:53.710319 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.710299 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-util" (OuterVolumeSpecName: "util") pod "2c63275a-1673-45d1-b168-94f774298c05" (UID: "2c63275a-1673-45d1-b168-94f774298c05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:14:53.806789 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.806754 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-bundle\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:53.806789 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.806785 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c63275a-1673-45d1-b168-94f774298c05-util\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:53.806789 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:53.806794 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv4xz\" (UniqueName: \"kubernetes.io/projected/2c63275a-1673-45d1-b168-94f774298c05-kube-api-access-nv4xz\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:14:54.397693 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:54.397660 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" event={"ID":"2c63275a-1673-45d1-b168-94f774298c05","Type":"ContainerDied","Data":"216363cbfbd12caae23f3027487c72f72bafe0e567a9320fd93180a46e6b140f"} Jul 15 21:14:54.397848 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:54.397699 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v79j9" Jul 15 21:14:54.397848 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:54.397709 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="216363cbfbd12caae23f3027487c72f72bafe0e567a9320fd93180a46e6b140f" Jul 15 21:14:58.928452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928412 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn"] Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928757 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="util" Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928771 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="util" Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928784 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="pull" Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928794 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="pull" Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928814 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="extract" Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928822 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="extract" Jul 15 21:14:58.928905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.928886 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c63275a-1673-45d1-b168-94f774298c05" containerName="extract" Jul 15 21:14:58.971702 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.971674 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn"] Jul 15 21:14:58.971840 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.971779 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:58.977655 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.976653 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:14:58.977655 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.976747 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 21:14:58.980815 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:58.980794 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j6zvd\"" Jul 15 21:14:59.043315 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.043285 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlb8\" (UniqueName: \"kubernetes.io/projected/772cac82-152d-408b-88cd-90fe05e3dafa-kube-api-access-phlb8\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmxn\" (UID: \"772cac82-152d-408b-88cd-90fe05e3dafa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.043432 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.043328 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/772cac82-152d-408b-88cd-90fe05e3dafa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmxn\" (UID: \"772cac82-152d-408b-88cd-90fe05e3dafa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.144324 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.144294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlb8\" (UniqueName: \"kubernetes.io/projected/772cac82-152d-408b-88cd-90fe05e3dafa-kube-api-access-phlb8\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmxn\" (UID: \"772cac82-152d-408b-88cd-90fe05e3dafa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.144450 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.144339 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/772cac82-152d-408b-88cd-90fe05e3dafa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmxn\" (UID: \"772cac82-152d-408b-88cd-90fe05e3dafa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.144682 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.144663 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/772cac82-152d-408b-88cd-90fe05e3dafa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmxn\" (UID: \"772cac82-152d-408b-88cd-90fe05e3dafa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.155516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.155495 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlb8\" (UniqueName: \"kubernetes.io/projected/772cac82-152d-408b-88cd-90fe05e3dafa-kube-api-access-phlb8\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmxn\" (UID: \"772cac82-152d-408b-88cd-90fe05e3dafa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.286007 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.285944 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" Jul 15 21:14:59.433080 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:14:59.433053 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn"] Jul 15 21:14:59.436051 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:14:59.436024 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772cac82_152d_408b_88cd_90fe05e3dafa.slice/crio-1cccee49628303ee9b7d4d67909437df25542d0ae08216338ed51d773bc0e1cb WatchSource:0}: Error finding container 1cccee49628303ee9b7d4d67909437df25542d0ae08216338ed51d773bc0e1cb: Status 404 returned error can't find the container with id 1cccee49628303ee9b7d4d67909437df25542d0ae08216338ed51d773bc0e1cb Jul 15 21:15:00.421381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:00.421343 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" event={"ID":"772cac82-152d-408b-88cd-90fe05e3dafa","Type":"ContainerStarted","Data":"1cccee49628303ee9b7d4d67909437df25542d0ae08216338ed51d773bc0e1cb"} Jul 15 21:15:01.427014 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:01.426980 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" event={"ID":"772cac82-152d-408b-88cd-90fe05e3dafa","Type":"ContainerStarted","Data":"2aa951ad6619867aed6a5a8aae4bfa95715d8fec466c2daaf72ef79eb97a07f9"} Jul 15 21:15:01.448927 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:01.448871 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmxn" podStartSLOduration=1.6098297179999999 podStartE2EDuration="3.448855424s" totalImagesPullingTime="1.839025706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:01.446804369 +0000 UTC m=+322.927788960" watchObservedRunningTime="2026-07-15 21:15:01.448855424 +0000 UTC m=+322.929840016" Jul 15 21:15:09.171066 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.171034 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2wsj7"] Jul 15 21:15:09.173466 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.173439 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.177184 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.177151 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8x6s8\"" Jul 15 21:15:09.177299 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.177196 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 21:15:09.177299 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.177211 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 21:15:09.189806 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.189785 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2wsj7"] Jul 15 21:15:09.221248 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.221222 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdm6k\" (UniqueName: \"kubernetes.io/projected/9839f6e7-49ee-4412-baa8-7e46fa66a83d-kube-api-access-zdm6k\") pod \"cert-manager-webhook-6486ffd997-2wsj7\" (UID: \"9839f6e7-49ee-4412-baa8-7e46fa66a83d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.221379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.221276 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9839f6e7-49ee-4412-baa8-7e46fa66a83d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2wsj7\" (UID: \"9839f6e7-49ee-4412-baa8-7e46fa66a83d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.321740 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.321710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdm6k\" (UniqueName: \"kubernetes.io/projected/9839f6e7-49ee-4412-baa8-7e46fa66a83d-kube-api-access-zdm6k\") pod \"cert-manager-webhook-6486ffd997-2wsj7\" (UID: \"9839f6e7-49ee-4412-baa8-7e46fa66a83d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.321850 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.321776 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9839f6e7-49ee-4412-baa8-7e46fa66a83d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2wsj7\" (UID: \"9839f6e7-49ee-4412-baa8-7e46fa66a83d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.337396 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.337369 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdm6k\" (UniqueName: \"kubernetes.io/projected/9839f6e7-49ee-4412-baa8-7e46fa66a83d-kube-api-access-zdm6k\") pod \"cert-manager-webhook-6486ffd997-2wsj7\" (UID: \"9839f6e7-49ee-4412-baa8-7e46fa66a83d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.337720 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.337703 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9839f6e7-49ee-4412-baa8-7e46fa66a83d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2wsj7\" (UID: \"9839f6e7-49ee-4412-baa8-7e46fa66a83d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.482513 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.482451 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:09.610428 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:09.610377 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2wsj7"] Jul 15 21:15:09.612588 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:15:09.612561 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9839f6e7_49ee_4412_baa8_7e46fa66a83d.slice/crio-a2094b9f57859ca4a4a69c69ced95cc2440df29a489d96634e83c3ccdb2a61ef WatchSource:0}: Error finding container a2094b9f57859ca4a4a69c69ced95cc2440df29a489d96634e83c3ccdb2a61ef: Status 404 returned error can't find the container with id a2094b9f57859ca4a4a69c69ced95cc2440df29a489d96634e83c3ccdb2a61ef Jul 15 21:15:10.461936 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:10.461892 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" event={"ID":"9839f6e7-49ee-4412-baa8-7e46fa66a83d","Type":"ContainerStarted","Data":"a2094b9f57859ca4a4a69c69ced95cc2440df29a489d96634e83c3ccdb2a61ef"} Jul 15 21:15:12.475173 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:12.475142 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" event={"ID":"9839f6e7-49ee-4412-baa8-7e46fa66a83d","Type":"ContainerStarted","Data":"f72093e28b2111efecff8b1f76a2a72290a6a8598d8b5e1e5f0ba37582226d67"} Jul 15 21:15:12.475515 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:12.475188 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:12.491171 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:12.491114 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" podStartSLOduration=0.68784268 podStartE2EDuration="3.491096999s" totalImagesPullingTime="2.803254319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:12.490316505 +0000 UTC m=+333.971301094" watchObservedRunningTime="2026-07-15 21:15:12.491096999 +0000 UTC m=+333.972081589" Jul 15 21:15:15.076743 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.076710 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zltpg"] Jul 15 21:15:15.078755 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.078738 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.080955 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.080928 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v7gbh\"" Jul 15 21:15:15.088877 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.088858 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zltpg"] Jul 15 21:15:15.163859 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.163818 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c525g\" (UniqueName: \"kubernetes.io/projected/4b8a991a-fb24-4ab4-a60e-d600812fd5e2-kube-api-access-c525g\") pod \"cert-manager-55b4d954d5-zltpg\" (UID: \"4b8a991a-fb24-4ab4-a60e-d600812fd5e2\") " pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.163859 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.163853 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b8a991a-fb24-4ab4-a60e-d600812fd5e2-bound-sa-token\") pod \"cert-manager-55b4d954d5-zltpg\" (UID: \"4b8a991a-fb24-4ab4-a60e-d600812fd5e2\") " pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.265076 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.265045 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c525g\" (UniqueName: \"kubernetes.io/projected/4b8a991a-fb24-4ab4-a60e-d600812fd5e2-kube-api-access-c525g\") pod \"cert-manager-55b4d954d5-zltpg\" (UID: \"4b8a991a-fb24-4ab4-a60e-d600812fd5e2\") " pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.265076 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.265080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b8a991a-fb24-4ab4-a60e-d600812fd5e2-bound-sa-token\") pod \"cert-manager-55b4d954d5-zltpg\" (UID: \"4b8a991a-fb24-4ab4-a60e-d600812fd5e2\") " pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.273532 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.273502 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b8a991a-fb24-4ab4-a60e-d600812fd5e2-bound-sa-token\") pod \"cert-manager-55b4d954d5-zltpg\" (UID: \"4b8a991a-fb24-4ab4-a60e-d600812fd5e2\") " pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.273642 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.273627 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c525g\" (UniqueName: \"kubernetes.io/projected/4b8a991a-fb24-4ab4-a60e-d600812fd5e2-kube-api-access-c525g\") pod \"cert-manager-55b4d954d5-zltpg\" (UID: \"4b8a991a-fb24-4ab4-a60e-d600812fd5e2\") " pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.386813 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.386786 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zltpg" Jul 15 21:15:15.506577 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:15.506549 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zltpg"] Jul 15 21:15:15.509762 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:15:15.509736 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b8a991a_fb24_4ab4_a60e_d600812fd5e2.slice/crio-e20fccc831191b13c20c34f03a97b2c2906108e50ba9a0d6b1807bfa62d97d76 WatchSource:0}: Error finding container e20fccc831191b13c20c34f03a97b2c2906108e50ba9a0d6b1807bfa62d97d76: Status 404 returned error can't find the container with id e20fccc831191b13c20c34f03a97b2c2906108e50ba9a0d6b1807bfa62d97d76 Jul 15 21:15:16.492502 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:16.492467 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zltpg" event={"ID":"4b8a991a-fb24-4ab4-a60e-d600812fd5e2","Type":"ContainerStarted","Data":"2552d860eedf464dd011c41a23d57453520981fc159e3d38316469a5f72f1d68"} Jul 15 21:15:16.492860 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:16.492503 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zltpg" event={"ID":"4b8a991a-fb24-4ab4-a60e-d600812fd5e2","Type":"ContainerStarted","Data":"e20fccc831191b13c20c34f03a97b2c2906108e50ba9a0d6b1807bfa62d97d76"} Jul 15 21:15:16.508491 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:16.508445 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zltpg" podStartSLOduration=1.508431197 podStartE2EDuration="1.508431197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:16.507827216 +0000 UTC m=+337.988811790" watchObservedRunningTime="2026-07-15 21:15:16.508431197 +0000 UTC m=+337.989415788" Jul 15 21:15:18.481899 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:18.481866 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2wsj7" Jul 15 21:15:33.789532 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.789455 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx"] Jul 15 21:15:33.791984 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.791962 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.794067 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.794048 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:15:33.794949 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.794934 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-srgtj\"" Jul 15 21:15:33.795040 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.794961 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:15:33.800759 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.800735 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx"] Jul 15 21:15:33.892248 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.892222 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzw6g\" (UniqueName: \"kubernetes.io/projected/537195a5-46f1-418b-9726-74c8156bed32-kube-api-access-dzw6g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.892373 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.892261 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.892373 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.892284 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.992991 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.992964 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzw6g\" (UniqueName: \"kubernetes.io/projected/537195a5-46f1-418b-9726-74c8156bed32-kube-api-access-dzw6g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.993110 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.993001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.993110 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.993030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.993326 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.993309 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:33.993392 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:33.993373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:34.000519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:34.000498 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzw6g\" (UniqueName: \"kubernetes.io/projected/537195a5-46f1-418b-9726-74c8156bed32-kube-api-access-dzw6g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:34.101636 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:34.101582 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:34.223285 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:34.223256 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx"] Jul 15 21:15:34.226004 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:15:34.225971 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537195a5_46f1_418b_9726_74c8156bed32.slice/crio-69bc035a76f80afafb771a02eab49be2156e8a77973c076e835613dd980e09b4 WatchSource:0}: Error finding container 69bc035a76f80afafb771a02eab49be2156e8a77973c076e835613dd980e09b4: Status 404 returned error can't find the container with id 69bc035a76f80afafb771a02eab49be2156e8a77973c076e835613dd980e09b4 Jul 15 21:15:34.563853 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:34.563820 2585 generic.go:356] "Generic (PLEG): container finished" podID="537195a5-46f1-418b-9726-74c8156bed32" containerID="09e5ef095f8cc5221766f53b2aebf9b0be589f1cd3b0cfb9f217d192ac916803" exitCode=0 Jul 15 21:15:34.563996 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:34.563869 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" event={"ID":"537195a5-46f1-418b-9726-74c8156bed32","Type":"ContainerDied","Data":"09e5ef095f8cc5221766f53b2aebf9b0be589f1cd3b0cfb9f217d192ac916803"} Jul 15 21:15:34.563996 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:34.563911 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" event={"ID":"537195a5-46f1-418b-9726-74c8156bed32","Type":"ContainerStarted","Data":"69bc035a76f80afafb771a02eab49be2156e8a77973c076e835613dd980e09b4"} Jul 15 21:15:35.569631 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:35.569600 2585 generic.go:356] "Generic (PLEG): container finished" podID="537195a5-46f1-418b-9726-74c8156bed32" containerID="335c481464ae347d579043d8f3a065d8327cb770caa3ac164a5a23dec3e7da3a" exitCode=0 Jul 15 21:15:35.570059 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:35.569656 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" event={"ID":"537195a5-46f1-418b-9726-74c8156bed32","Type":"ContainerDied","Data":"335c481464ae347d579043d8f3a065d8327cb770caa3ac164a5a23dec3e7da3a"} Jul 15 21:15:36.575351 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:36.575316 2585 generic.go:356] "Generic (PLEG): container finished" podID="537195a5-46f1-418b-9726-74c8156bed32" containerID="9e8507de51ab85733dee3396d70fefdc690f495e430b458eaede944f72deb764" exitCode=0 Jul 15 21:15:36.575705 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:36.575397 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" event={"ID":"537195a5-46f1-418b-9726-74c8156bed32","Type":"ContainerDied","Data":"9e8507de51ab85733dee3396d70fefdc690f495e430b458eaede944f72deb764"} Jul 15 21:15:37.707701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.707676 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:37.824555 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.824524 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-util\") pod \"537195a5-46f1-418b-9726-74c8156bed32\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " Jul 15 21:15:37.824731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.824595 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-bundle\") pod \"537195a5-46f1-418b-9726-74c8156bed32\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " Jul 15 21:15:37.824731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.824702 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzw6g\" (UniqueName: \"kubernetes.io/projected/537195a5-46f1-418b-9726-74c8156bed32-kube-api-access-dzw6g\") pod \"537195a5-46f1-418b-9726-74c8156bed32\" (UID: \"537195a5-46f1-418b-9726-74c8156bed32\") " Jul 15 21:15:37.825354 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.825314 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-bundle" (OuterVolumeSpecName: "bundle") pod "537195a5-46f1-418b-9726-74c8156bed32" (UID: "537195a5-46f1-418b-9726-74c8156bed32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:15:37.826704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.826673 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537195a5-46f1-418b-9726-74c8156bed32-kube-api-access-dzw6g" (OuterVolumeSpecName: "kube-api-access-dzw6g") pod "537195a5-46f1-418b-9726-74c8156bed32" (UID: "537195a5-46f1-418b-9726-74c8156bed32"). InnerVolumeSpecName "kube-api-access-dzw6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:15:37.829946 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.829882 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-util" (OuterVolumeSpecName: "util") pod "537195a5-46f1-418b-9726-74c8156bed32" (UID: "537195a5-46f1-418b-9726-74c8156bed32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:15:37.925841 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.925807 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzw6g\" (UniqueName: \"kubernetes.io/projected/537195a5-46f1-418b-9726-74c8156bed32-kube-api-access-dzw6g\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:15:37.925841 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.925833 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-util\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:15:37.925841 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:37.925844 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537195a5-46f1-418b-9726-74c8156bed32-bundle\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:15:38.585411 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:38.585377 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" event={"ID":"537195a5-46f1-418b-9726-74c8156bed32","Type":"ContainerDied","Data":"69bc035a76f80afafb771a02eab49be2156e8a77973c076e835613dd980e09b4"} Jul 15 21:15:38.585591 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:38.585422 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69bc035a76f80afafb771a02eab49be2156e8a77973c076e835613dd980e09b4" Jul 15 21:15:38.585591 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:38.585437 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkjvx" Jul 15 21:15:42.187023 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.186992 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69"] Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187240 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="extract" Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187250 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="extract" Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187262 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="util" Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187267 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="util" Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187276 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="pull" Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187281 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="pull" Jul 15 21:15:42.187427 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.187332 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="537195a5-46f1-418b-9726-74c8156bed32" containerName="extract" Jul 15 21:15:42.190044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.190026 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.192440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.192418 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:15:42.192533 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.192453 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 21:15:42.195093 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.195076 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 21:15:42.196166 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.196131 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z5q8z\"" Jul 15 21:15:42.196278 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.196131 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 21:15:42.196657 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.196496 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 21:15:42.200499 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.200475 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69"] Jul 15 21:15:42.258150 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.258124 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04a0b41c-cceb-413f-8733-d55f233d264e-cert\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.258258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.258151 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04a0b41c-cceb-413f-8733-d55f233d264e-metrics-cert\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.258258 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.258223 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04a0b41c-cceb-413f-8733-d55f233d264e-manager-config\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.258331 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.258257 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr5xs\" (UniqueName: \"kubernetes.io/projected/04a0b41c-cceb-413f-8733-d55f233d264e-kube-api-access-wr5xs\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.358656 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.358630 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04a0b41c-cceb-413f-8733-d55f233d264e-manager-config\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.358745 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.358663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr5xs\" (UniqueName: \"kubernetes.io/projected/04a0b41c-cceb-413f-8733-d55f233d264e-kube-api-access-wr5xs\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.358745 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.358698 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04a0b41c-cceb-413f-8733-d55f233d264e-cert\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.358820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.358749 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04a0b41c-cceb-413f-8733-d55f233d264e-metrics-cert\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.359401 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.359380 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04a0b41c-cceb-413f-8733-d55f233d264e-manager-config\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.361111 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.361092 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04a0b41c-cceb-413f-8733-d55f233d264e-metrics-cert\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.361111 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.361108 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04a0b41c-cceb-413f-8733-d55f233d264e-cert\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.368615 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.368592 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr5xs\" (UniqueName: \"kubernetes.io/projected/04a0b41c-cceb-413f-8733-d55f233d264e-kube-api-access-wr5xs\") pod \"lws-controller-manager-7cd5bf8cdd-zqq69\" (UID: \"04a0b41c-cceb-413f-8733-d55f233d264e\") " pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.498583 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.498510 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:42.619032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:42.619005 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69"] Jul 15 21:15:42.620852 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:15:42.620819 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a0b41c_cceb_413f_8733_d55f233d264e.slice/crio-ac022a09ca91ba44e439d3913140abf0c21b18b728c5c879698c6e57183099c7 WatchSource:0}: Error finding container ac022a09ca91ba44e439d3913140abf0c21b18b728c5c879698c6e57183099c7: Status 404 returned error can't find the container with id ac022a09ca91ba44e439d3913140abf0c21b18b728c5c879698c6e57183099c7 Jul 15 21:15:43.608607 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:43.608565 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" event={"ID":"04a0b41c-cceb-413f-8733-d55f233d264e","Type":"ContainerStarted","Data":"ac022a09ca91ba44e439d3913140abf0c21b18b728c5c879698c6e57183099c7"} Jul 15 21:15:45.617938 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:45.617893 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" event={"ID":"04a0b41c-cceb-413f-8733-d55f233d264e","Type":"ContainerStarted","Data":"1ffe2c7956e99635a923ed52b4e75b5d65ca54f8a9b30e74a86b664ed9997118"} Jul 15 21:15:45.618333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:45.618024 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:15:48.319810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.319750 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" podStartSLOduration=4.320281747 podStartE2EDuration="6.31973383s" totalImagesPullingTime="1.999452083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:45.637291006 +0000 UTC m=+367.118275598" watchObservedRunningTime="2026-07-15 21:15:48.31973383 +0000 UTC m=+369.800718420" Jul 15 21:15:48.320668 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.320647 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p"] Jul 15 21:15:48.323108 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.323093 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.327297 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.327267 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 21:15:48.327621 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.327599 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 21:15:48.327711 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.327693 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 21:15:48.327879 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.327861 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 21:15:48.327951 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.327861 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l72zx\"" Jul 15 21:15:48.355649 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.355627 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p"] Jul 15 21:15:48.409901 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.409873 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e4549619-4c40-4450-bce1-942d915e6048-manifests\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.410035 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.409908 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4549619-4c40-4450-bce1-942d915e6048-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.410035 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.410001 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4549619-4c40-4450-bce1-942d915e6048-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.410144 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.410055 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4l8h\" (UniqueName: \"kubernetes.io/projected/e4549619-4c40-4450-bce1-942d915e6048-kube-api-access-x4l8h\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.410144 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.410087 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4549619-4c40-4450-bce1-942d915e6048-tmp\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.510954 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.510902 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4l8h\" (UniqueName: \"kubernetes.io/projected/e4549619-4c40-4450-bce1-942d915e6048-kube-api-access-x4l8h\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.511085 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.510965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4549619-4c40-4450-bce1-942d915e6048-tmp\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.511085 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.510999 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e4549619-4c40-4450-bce1-942d915e6048-manifests\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.511085 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.511027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4549619-4c40-4450-bce1-942d915e6048-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.511235 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.511087 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4549619-4c40-4450-bce1-942d915e6048-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.511449 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.511414 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e4549619-4c40-4450-bce1-942d915e6048-manifests\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.513091 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.513067 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4549619-4c40-4450-bce1-942d915e6048-tmp\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.513353 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.513329 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4549619-4c40-4450-bce1-942d915e6048-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.513657 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.513638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4549619-4c40-4450-bce1-942d915e6048-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.519871 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.519850 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4l8h\" (UniqueName: \"kubernetes.io/projected/e4549619-4c40-4450-bce1-942d915e6048-kube-api-access-x4l8h\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-9986p\" (UID: \"e4549619-4c40-4450-bce1-942d915e6048\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.636680 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.636651 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:48.798779 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:48.798756 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p"] Jul 15 21:15:48.800338 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:15:48.800313 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4549619_4c40_4450_bce1_942d915e6048.slice/crio-12c412fa11cd9f047651efa3463826649b92a7a7747af16afee4c81212539091 WatchSource:0}: Error finding container 12c412fa11cd9f047651efa3463826649b92a7a7747af16afee4c81212539091: Status 404 returned error can't find the container with id 12c412fa11cd9f047651efa3463826649b92a7a7747af16afee4c81212539091 Jul 15 21:15:49.637009 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:49.636958 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" event={"ID":"e4549619-4c40-4450-bce1-942d915e6048","Type":"ContainerStarted","Data":"12c412fa11cd9f047651efa3463826649b92a7a7747af16afee4c81212539091"} Jul 15 21:15:52.651994 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:52.651960 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" event={"ID":"e4549619-4c40-4450-bce1-942d915e6048","Type":"ContainerStarted","Data":"4b06ff71c5ace018cff56ad72a1e94948422fa6abc069761439c913836507367"} Jul 15 21:15:53.656977 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:53.656939 2585 generic.go:356] "Generic (PLEG): container finished" podID="e4549619-4c40-4450-bce1-942d915e6048" containerID="4b06ff71c5ace018cff56ad72a1e94948422fa6abc069761439c913836507367" exitCode=0 Jul 15 21:15:53.657373 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:53.657006 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" event={"ID":"e4549619-4c40-4450-bce1-942d915e6048","Type":"ContainerDied","Data":"4b06ff71c5ace018cff56ad72a1e94948422fa6abc069761439c913836507367"} Jul 15 21:15:54.663074 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:54.663037 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" event={"ID":"e4549619-4c40-4450-bce1-942d915e6048","Type":"ContainerStarted","Data":"31c5c54cc7ca2f5bbfcf5c6157177683e06b500af7968b9311643842f511e7e1"} Jul 15 21:15:54.663425 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:54.663134 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:15:54.686345 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:54.686300 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" podStartSLOduration=2.552549246 podStartE2EDuration="6.686285701s" totalImagesPullingTime="3.165922223s" totalInitContainerRuntime="967.814232ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:54.684004811 +0000 UTC m=+376.164989402" watchObservedRunningTime="2026-07-15 21:15:54.686285701 +0000 UTC m=+376.167270291" Jul 15 21:15:56.623895 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:15:56.623869 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cd5bf8cdd-zqq69" Jul 15 21:16:05.669329 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:05.669296 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-9986p" Jul 15 21:16:16.402965 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.402931 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8"] Jul 15 21:16:16.407107 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.407086 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.412929 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.412888 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 21:16:16.413078 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.413018 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 21:16:16.413579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.413557 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 21:16:16.413662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.413580 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 21:16:16.413662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.413600 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z655w\"" Jul 15 21:16:16.413662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.413567 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 21:16:16.413813 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.413755 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 21:16:16.420888 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.420865 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8"] Jul 15 21:16:16.423466 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423439 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.423558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423487 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.423558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423535 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.423640 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423563 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljhds\" (UniqueName: \"kubernetes.io/projected/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-kube-api-access-ljhds\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.423640 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.423700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423654 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.423700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.423674 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524615 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524580 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524646 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524674 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljhds\" (UniqueName: \"kubernetes.io/projected/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-kube-api-access-ljhds\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524692 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524730 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.524810 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.524748 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.525449 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.525424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.527245 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.527210 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.527245 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.527227 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.527365 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.527256 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.527584 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.527568 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.544209 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.544181 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.557246 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.557223 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljhds\" (UniqueName: \"kubernetes.io/projected/a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a-kube-api-access-ljhds\") pod \"istiod-openshift-gateway-94bb8fbfd-v78t8\" (UID: \"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.716073 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.715909 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:16.870369 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:16.870336 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8"] Jul 15 21:16:16.873983 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:16:16.873947 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda27ef4d4_4b6e_4f60_b5fa_6a7fcd89eb3a.slice/crio-d3f51b6d9ebae0402252761e9c875620e1a53acd650fd2820106e00cf6bba07e WatchSource:0}: Error finding container d3f51b6d9ebae0402252761e9c875620e1a53acd650fd2820106e00cf6bba07e: Status 404 returned error can't find the container with id d3f51b6d9ebae0402252761e9c875620e1a53acd650fd2820106e00cf6bba07e Jul 15 21:16:17.778478 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:17.778437 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" event={"ID":"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a","Type":"ContainerStarted","Data":"d3f51b6d9ebae0402252761e9c875620e1a53acd650fd2820106e00cf6bba07e"} Jul 15 21:16:19.365656 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:19.365624 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:16:19.365882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:19.365689 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:16:19.791335 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:19.791299 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" event={"ID":"a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a","Type":"ContainerStarted","Data":"11840e80e12805990ffaf768ffbc1a05a1bfc3c0a667726416149521640018ad"} Jul 15 21:16:19.791551 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:19.791375 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:16:19.838047 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:19.837996 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" podStartSLOduration=1.348854148 podStartE2EDuration="3.837981674s" totalImagesPullingTime="2.489127526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:19.836619104 +0000 UTC m=+401.317603697" watchObservedRunningTime="2026-07-15 21:16:19.837981674 +0000 UTC m=+401.318966264" Jul 15 21:16:20.797413 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:20.797381 2585 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-v78t8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:16:20.797827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:20.797465 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" podUID="a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:16:23.797632 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:16:23.797594 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v78t8" Jul 15 21:17:51.193428 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:51.193392 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b65f99c7d-857wr"] Jul 15 21:17:57.810968 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.810929 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6"] Jul 15 21:17:57.814402 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.814374 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:57.817717 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.817697 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:17:57.817954 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.817936 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggchg\"" Jul 15 21:17:57.818471 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.818457 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:17:57.828729 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.828706 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6"] Jul 15 21:17:57.957987 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.957952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmc6\" (UniqueName: \"kubernetes.io/projected/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-kube-api-access-6xmc6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qncn6\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:57.958189 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:57.958086 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qncn6\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.031063 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.031024 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6"] Jul 15 21:17:58.031341 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:17:58.031316 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-6xmc6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" podUID="924ef3ae-6ed0-42a7-9b85-c7a8647347d9" Jul 15 21:17:58.059580 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.059523 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qncn6\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.059768 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.059577 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmc6\" (UniqueName: \"kubernetes.io/projected/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-kube-api-access-6xmc6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qncn6\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.060036 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.060016 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qncn6\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.081785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.081710 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmc6\" (UniqueName: \"kubernetes.io/projected/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-kube-api-access-6xmc6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qncn6\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.216964 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.216912 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.224199 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.224173 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:17:58.363402 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.363297 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-extensions-socket-volume\") pod \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " Jul 15 21:17:58.363402 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.363352 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xmc6\" (UniqueName: \"kubernetes.io/projected/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-kube-api-access-6xmc6\") pod \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\" (UID: \"924ef3ae-6ed0-42a7-9b85-c7a8647347d9\") " Jul 15 21:17:58.363636 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.363586 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "924ef3ae-6ed0-42a7-9b85-c7a8647347d9" (UID: "924ef3ae-6ed0-42a7-9b85-c7a8647347d9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:58.365565 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.365542 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-kube-api-access-6xmc6" (OuterVolumeSpecName: "kube-api-access-6xmc6") pod "924ef3ae-6ed0-42a7-9b85-c7a8647347d9" (UID: "924ef3ae-6ed0-42a7-9b85-c7a8647347d9"). InnerVolumeSpecName "kube-api-access-6xmc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:58.464361 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.464313 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-extensions-socket-volume\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:17:58.464361 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.464354 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xmc6\" (UniqueName: \"kubernetes.io/projected/924ef3ae-6ed0-42a7-9b85-c7a8647347d9-kube-api-access-6xmc6\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:17:58.572025 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.571989 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6"] Jul 15 21:17:58.583794 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.583762 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6"] Jul 15 21:17:58.974822 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:58.974787 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="924ef3ae-6ed0-42a7-9b85-c7a8647347d9" path="/var/lib/kubelet/pods/924ef3ae-6ed0-42a7-9b85-c7a8647347d9/volumes" Jul 15 21:17:59.221514 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:17:59.221482 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qncn6" Jul 15 21:18:10.541420 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.541377 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj"] Jul 15 21:18:10.544563 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.544538 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.547398 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.547375 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggchg\"" Jul 15 21:18:10.547537 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.547402 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:18:10.547537 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.547418 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:18:10.559215 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.559187 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj"] Jul 15 21:18:10.673730 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.673696 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8hzmj\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.673885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.673759 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8pbp\" (UniqueName: \"kubernetes.io/projected/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-kube-api-access-w8pbp\") pod \"kuadrant-operator-controller-manager-86878c769f-8hzmj\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.775012 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.774968 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8hzmj\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.775190 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.775037 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8pbp\" (UniqueName: \"kubernetes.io/projected/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-kube-api-access-w8pbp\") pod \"kuadrant-operator-controller-manager-86878c769f-8hzmj\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.775353 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.775331 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8hzmj\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.786287 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.786256 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8pbp\" (UniqueName: \"kubernetes.io/projected/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-kube-api-access-w8pbp\") pod \"kuadrant-operator-controller-manager-86878c769f-8hzmj\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.854586 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.854501 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:10.990145 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:10.990119 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj"] Jul 15 21:18:10.992368 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:18:10.992339 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e18a5b_5c94_46a4_8a83_87dcfcf0b148.slice/crio-7d48fb506ff1304dbb02fed6c595aadec8efbada29e91aa2e97840a06650780a WatchSource:0}: Error finding container 7d48fb506ff1304dbb02fed6c595aadec8efbada29e91aa2e97840a06650780a: Status 404 returned error can't find the container with id 7d48fb506ff1304dbb02fed6c595aadec8efbada29e91aa2e97840a06650780a Jul 15 21:18:11.275117 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:11.275080 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" event={"ID":"22e18a5b-5c94-46a4-8a83-87dcfcf0b148","Type":"ContainerStarted","Data":"7d48fb506ff1304dbb02fed6c595aadec8efbada29e91aa2e97840a06650780a"} Jul 15 21:18:16.213557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.213517 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b65f99c7d-857wr" podUID="91ca76c2-ed25-4d11-81ee-fe0d706e4ced" containerName="console" containerID="cri-o://68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc" gracePeriod=15 Jul 15 21:18:16.302767 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.302690 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" event={"ID":"22e18a5b-5c94-46a4-8a83-87dcfcf0b148","Type":"ContainerStarted","Data":"533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9"} Jul 15 21:18:16.302905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.302822 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:18:16.474817 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.474791 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:18:16.493327 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.493255 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" podStartSLOduration=1.477725057 podStartE2EDuration="6.493237142s" totalImagesPullingTime="5.015512085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:16.324494754 +0000 UTC m=+517.805479346" watchObservedRunningTime="2026-07-15 21:18:16.493237142 +0000 UTC m=+517.974221734" Jul 15 21:18:16.525474 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525440 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-config\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.525474 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525481 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-trusted-ca-bundle\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.525698 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525505 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mknqk\" (UniqueName: \"kubernetes.io/projected/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-kube-api-access-mknqk\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.525698 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525536 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-service-ca\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.525698 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525564 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-serving-cert\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.525698 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525588 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-oauth-serving-cert\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.525698 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525656 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-oauth-config\") pod \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\" (UID: \"91ca76c2-ed25-4d11-81ee-fe0d706e4ced\") " Jul 15 21:18:16.526039 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.525906 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-config" (OuterVolumeSpecName: "console-config") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:18:16.526099 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.526062 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:18:16.526191 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.526170 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:18:16.526232 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.526192 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-service-ca" (OuterVolumeSpecName: "service-ca") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:18:16.527773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.527743 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-kube-api-access-mknqk" (OuterVolumeSpecName: "kube-api-access-mknqk") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "kube-api-access-mknqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:18:16.527906 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.527784 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:18:16.528055 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.527906 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91ca76c2-ed25-4d11-81ee-fe0d706e4ced" (UID: "91ca76c2-ed25-4d11-81ee-fe0d706e4ced"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:18:16.626306 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626276 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-oauth-config\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:16.626306 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626303 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-config\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:16.626516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626316 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-trusted-ca-bundle\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:16.626516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626329 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mknqk\" (UniqueName: \"kubernetes.io/projected/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-kube-api-access-mknqk\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:16.626516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626341 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-service-ca\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:16.626516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626353 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-console-serving-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:16.626516 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:16.626363 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91ca76c2-ed25-4d11-81ee-fe0d706e4ced-oauth-serving-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:18:17.309239 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.309203 2585 generic.go:356] "Generic (PLEG): container finished" podID="91ca76c2-ed25-4d11-81ee-fe0d706e4ced" containerID="68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc" exitCode=0 Jul 15 21:18:17.309691 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.309247 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f99c7d-857wr" Jul 15 21:18:17.309691 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.309287 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f99c7d-857wr" event={"ID":"91ca76c2-ed25-4d11-81ee-fe0d706e4ced","Type":"ContainerDied","Data":"68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc"} Jul 15 21:18:17.309691 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.309345 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f99c7d-857wr" event={"ID":"91ca76c2-ed25-4d11-81ee-fe0d706e4ced","Type":"ContainerDied","Data":"37c8e25971eda36ae23e194109ba2041faea77e991241ebf4d891b167f3c809a"} Jul 15 21:18:17.309691 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.309375 2585 scope.go:117] "RemoveContainer" containerID="68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc" Jul 15 21:18:17.317891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.317871 2585 scope.go:117] "RemoveContainer" containerID="68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc" Jul 15 21:18:17.318177 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:18:17.318155 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc\": container with ID starting with 68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc not found: ID does not exist" containerID="68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc" Jul 15 21:18:17.318216 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.318185 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc"} err="failed to get container status \"68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc\": rpc error: code = NotFound desc = could not find container \"68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc\": container with ID starting with 68cfb9d13cb16c7c5c3c54c02f01bac5f26206c81d90f575af4ad5093aec83bc not found: ID does not exist" Jul 15 21:18:17.326295 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.326265 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b65f99c7d-857wr"] Jul 15 21:18:17.329083 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:17.329058 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b65f99c7d-857wr"] Jul 15 21:18:18.974520 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:18.974490 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ca76c2-ed25-4d11-81ee-fe0d706e4ced" path="/var/lib/kubelet/pods/91ca76c2-ed25-4d11-81ee-fe0d706e4ced/volumes" Jul 15 21:18:27.311645 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:18:27.311613 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:19:38.915350 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:19:38.915320 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:19:38.918828 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:19:38.918802 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:20:42.715006 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.714978 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8"] Jul 15 21:20:42.715378 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.715276 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ca76c2-ed25-4d11-81ee-fe0d706e4ced" containerName="console" Jul 15 21:20:42.715378 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.715287 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ca76c2-ed25-4d11-81ee-fe0d706e4ced" containerName="console" Jul 15 21:20:42.715378 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.715345 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ca76c2-ed25-4d11-81ee-fe0d706e4ced" containerName="console" Jul 15 21:20:42.718249 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.718228 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.721034 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.720979 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 21:20:42.721134 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.721064 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 21:20:42.721263 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.721243 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2cvfv\"" Jul 15 21:20:42.721987 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.721968 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 21:20:42.728779 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.728757 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8"] Jul 15 21:20:42.769563 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.769539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6cg\" (UniqueName: \"kubernetes.io/projected/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-kube-api-access-7v6cg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.769688 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.769570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.769688 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.769603 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.769688 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.769623 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.769688 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.769648 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.769688 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.769664 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.870910 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.870872 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.870910 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.870906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871167 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.870956 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871167 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.870975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871167 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.871010 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6cg\" (UniqueName: \"kubernetes.io/projected/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-kube-api-access-7v6cg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871167 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.871037 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.871315 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.871333 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.871443 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.871425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.873223 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.873197 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.873612 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.873591 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:42.878694 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:42.878674 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6cg\" (UniqueName: \"kubernetes.io/projected/f386eacb-fdcf-4d2e-b21a-d88a6f9814a1-kube-api-access-7v6cg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrkb8\" (UID: \"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:43.028973 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:43.028874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:43.154777 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:43.154753 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8"] Jul 15 21:20:43.159778 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:43.159755 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:20:43.962044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:43.962005 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" event={"ID":"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1","Type":"ContainerStarted","Data":"ed4fd70c284c06a9052a089af771c1a44808bd374881853c24d17ff21fd09800"} Jul 15 21:20:44.972941 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:44.972880 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" event={"ID":"f386eacb-fdcf-4d2e-b21a-d88a6f9814a1","Type":"ContainerStarted","Data":"97a757a30ee937ae506403c3fe0c428a71f25de64f0ea0dac22ff27f31a96473"} Jul 15 21:20:44.986372 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:44.986326 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" podStartSLOduration=1.935164377 podStartE2EDuration="2.98631207s" totalImagesPullingTime="1.051147693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:44.985192011 +0000 UTC m=+666.466176615" watchObservedRunningTime="2026-07-15 21:20:44.98631207 +0000 UTC m=+666.467296661" Jul 15 21:20:53.029566 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:53.029534 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:53.030111 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:53.029581 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:53.041850 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:53.041816 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:20:54.016525 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:20:54.016497 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrkb8" Jul 15 21:21:01.111438 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.111408 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h"] Jul 15 21:21:01.114953 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.114906 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.117870 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.117850 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 21:21:01.126139 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.126113 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h"] Jul 15 21:21:01.218384 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.218348 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.218556 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.218397 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.218556 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.218474 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/852ef952-7694-4d10-9807-20c9d35b19b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.218556 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.218510 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.218556 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.218554 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7tzc\" (UniqueName: \"kubernetes.io/projected/852ef952-7694-4d10-9807-20c9d35b19b9-kube-api-access-k7tzc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.218712 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.218575 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319269 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319237 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319314 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/852ef952-7694-4d10-9807-20c9d35b19b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319418 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319604 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319468 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7tzc\" (UniqueName: \"kubernetes.io/projected/852ef952-7694-4d10-9807-20c9d35b19b9-kube-api-access-k7tzc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319771 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319742 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319875 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319791 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.319953 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.319867 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.321632 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.321614 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/852ef952-7694-4d10-9807-20c9d35b19b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.321901 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.321882 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/852ef952-7694-4d10-9807-20c9d35b19b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.326875 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.326853 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7tzc\" (UniqueName: \"kubernetes.io/projected/852ef952-7694-4d10-9807-20c9d35b19b9-kube-api-access-k7tzc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h\" (UID: \"852ef952-7694-4d10-9807-20c9d35b19b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.425169 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.425135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:01.549698 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:01.549665 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h"] Jul 15 21:21:01.552760 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:21:01.552729 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852ef952_7694_4d10_9807_20c9d35b19b9.slice/crio-e5a472d9acebc25b7bc5a9bda3a7424e29ebb17bf4d7af13acd2863beb99e4a5 WatchSource:0}: Error finding container e5a472d9acebc25b7bc5a9bda3a7424e29ebb17bf4d7af13acd2863beb99e4a5: Status 404 returned error can't find the container with id e5a472d9acebc25b7bc5a9bda3a7424e29ebb17bf4d7af13acd2863beb99e4a5 Jul 15 21:21:02.039451 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:02.039357 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" event={"ID":"852ef952-7694-4d10-9807-20c9d35b19b9","Type":"ContainerStarted","Data":"a5a3122200816d335f0d6fdc98e091599fa09c275bde6ec6c884365a6de40c38"} Jul 15 21:21:02.039586 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:02.039452 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" event={"ID":"852ef952-7694-4d10-9807-20c9d35b19b9","Type":"ContainerStarted","Data":"e5a472d9acebc25b7bc5a9bda3a7424e29ebb17bf4d7af13acd2863beb99e4a5"} Jul 15 21:21:02.058121 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:02.058065 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" podStartSLOduration=0.872166481 podStartE2EDuration="1.058050521s" totalImagesPullingTime="185.88404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:21:02.056310917 +0000 UTC m=+683.537295510" watchObservedRunningTime="2026-07-15 21:21:02.058050521 +0000 UTC m=+683.539035112" Jul 15 21:21:11.426020 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:11.425987 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:11.426379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:11.426040 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:11.440087 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:11.440058 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:21:12.100543 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:21:12.100513 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h" Jul 15 21:24:38.943990 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:24:38.943951 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:24:38.946629 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:24:38.946609 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:28:19.291860 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:19.291823 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj"] Jul 15 21:28:19.294463 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:19.292138 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" podUID="22e18a5b-5c94-46a4-8a83-87dcfcf0b148" containerName="manager" containerID="cri-o://533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9" gracePeriod=10 Jul 15 21:28:21.241821 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.241793 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:28:21.300701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.300624 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8pbp\" (UniqueName: \"kubernetes.io/projected/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-kube-api-access-w8pbp\") pod \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " Jul 15 21:28:21.300701 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.300673 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-extensions-socket-volume\") pod \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\" (UID: \"22e18a5b-5c94-46a4-8a83-87dcfcf0b148\") " Jul 15 21:28:21.301075 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.301051 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22e18a5b-5c94-46a4-8a83-87dcfcf0b148" (UID: "22e18a5b-5c94-46a4-8a83-87dcfcf0b148"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:28:21.302791 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.302759 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-kube-api-access-w8pbp" (OuterVolumeSpecName: "kube-api-access-w8pbp") pod "22e18a5b-5c94-46a4-8a83-87dcfcf0b148" (UID: "22e18a5b-5c94-46a4-8a83-87dcfcf0b148"). InnerVolumeSpecName "kube-api-access-w8pbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:28:21.401251 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.401222 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8pbp\" (UniqueName: \"kubernetes.io/projected/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-kube-api-access-w8pbp\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:28:21.401251 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.401248 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22e18a5b-5c94-46a4-8a83-87dcfcf0b148-extensions-socket-volume\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:28:21.993983 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.993946 2585 generic.go:356] "Generic (PLEG): container finished" podID="22e18a5b-5c94-46a4-8a83-87dcfcf0b148" containerID="533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9" exitCode=0 Jul 15 21:28:21.994174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.994040 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" Jul 15 21:28:21.994174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.994075 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" event={"ID":"22e18a5b-5c94-46a4-8a83-87dcfcf0b148","Type":"ContainerDied","Data":"533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9"} Jul 15 21:28:21.994174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.994124 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj" event={"ID":"22e18a5b-5c94-46a4-8a83-87dcfcf0b148","Type":"ContainerDied","Data":"7d48fb506ff1304dbb02fed6c595aadec8efbada29e91aa2e97840a06650780a"} Jul 15 21:28:21.994174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:21.994151 2585 scope.go:117] "RemoveContainer" containerID="533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9" Jul 15 21:28:22.003280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:22.003264 2585 scope.go:117] "RemoveContainer" containerID="533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9" Jul 15 21:28:22.003538 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:28:22.003517 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9\": container with ID starting with 533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9 not found: ID does not exist" containerID="533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9" Jul 15 21:28:22.003580 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:22.003547 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9"} err="failed to get container status \"533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9\": rpc error: code = NotFound desc = could not find container \"533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9\": container with ID starting with 533b454cd34453fa6784776fc08cc7bb9805edc17a2100688c3790e82ca0ddc9 not found: ID does not exist" Jul 15 21:28:22.021806 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:22.021785 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj"] Jul 15 21:28:22.025564 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:22.025543 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hzmj"] Jul 15 21:28:22.973884 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:28:22.973851 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22e18a5b-5c94-46a4-8a83-87dcfcf0b148" path="/var/lib/kubelet/pods/22e18a5b-5c94-46a4-8a83-87dcfcf0b148/volumes" Jul 15 21:29:20.533389 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.533359 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj"] Jul 15 21:29:20.533829 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.533650 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e18a5b-5c94-46a4-8a83-87dcfcf0b148" containerName="manager" Jul 15 21:29:20.533829 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.533660 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e18a5b-5c94-46a4-8a83-87dcfcf0b148" containerName="manager" Jul 15 21:29:20.533829 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.533708 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="22e18a5b-5c94-46a4-8a83-87dcfcf0b148" containerName="manager" Jul 15 21:29:20.536573 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.536555 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.538790 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.538771 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:29:20.538871 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.538771 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:29:20.538871 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.538771 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggchg\"" Jul 15 21:29:20.548146 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.548125 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj"] Jul 15 21:29:20.632368 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.632341 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbxhl\" (UniqueName: \"kubernetes.io/projected/37110088-7afd-4b05-be13-51be29374d9b-kube-api-access-jbxhl\") pod \"kuadrant-operator-controller-manager-86878c769f-m2rnj\" (UID: \"37110088-7afd-4b05-be13-51be29374d9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.632474 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.632376 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37110088-7afd-4b05-be13-51be29374d9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2rnj\" (UID: \"37110088-7afd-4b05-be13-51be29374d9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.733359 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.733328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbxhl\" (UniqueName: \"kubernetes.io/projected/37110088-7afd-4b05-be13-51be29374d9b-kube-api-access-jbxhl\") pod \"kuadrant-operator-controller-manager-86878c769f-m2rnj\" (UID: \"37110088-7afd-4b05-be13-51be29374d9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.733489 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.733370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37110088-7afd-4b05-be13-51be29374d9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2rnj\" (UID: \"37110088-7afd-4b05-be13-51be29374d9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.733677 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.733650 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37110088-7afd-4b05-be13-51be29374d9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2rnj\" (UID: \"37110088-7afd-4b05-be13-51be29374d9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.746734 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.746708 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbxhl\" (UniqueName: \"kubernetes.io/projected/37110088-7afd-4b05-be13-51be29374d9b-kube-api-access-jbxhl\") pod \"kuadrant-operator-controller-manager-86878c769f-m2rnj\" (UID: \"37110088-7afd-4b05-be13-51be29374d9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.846487 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.846434 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:20.974816 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:20.974790 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj"] Jul 15 21:29:20.975038 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:29:20.975012 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37110088_7afd_4b05_be13_51be29374d9b.slice/crio-95ece9606990e51144674789e2b84a885060caed560b3f6f50ece01dee7245c2 WatchSource:0}: Error finding container 95ece9606990e51144674789e2b84a885060caed560b3f6f50ece01dee7245c2: Status 404 returned error can't find the container with id 95ece9606990e51144674789e2b84a885060caed560b3f6f50ece01dee7245c2 Jul 15 21:29:21.243782 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:21.243749 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" event={"ID":"37110088-7afd-4b05-be13-51be29374d9b","Type":"ContainerStarted","Data":"d09fde3a734252cc3058ba417fdee8058d984895dd7153e1b6b66792d9e7ea9f"} Jul 15 21:29:21.243969 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:21.243826 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" event={"ID":"37110088-7afd-4b05-be13-51be29374d9b","Type":"ContainerStarted","Data":"95ece9606990e51144674789e2b84a885060caed560b3f6f50ece01dee7245c2"} Jul 15 21:29:21.243969 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:21.243872 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:21.265143 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:21.265097 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" podStartSLOduration=1.265083621 podStartE2EDuration="1.265083621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:21.263387836 +0000 UTC m=+1182.744372427" watchObservedRunningTime="2026-07-15 21:29:21.265083621 +0000 UTC m=+1182.746068211" Jul 15 21:29:32.249862 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:32.249833 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2rnj" Jul 15 21:29:38.970766 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:38.970735 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:29:38.971206 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:29:38.970849 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:30:00.144151 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.144113 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5"] Jul 15 21:30:00.147282 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.147264 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" Jul 15 21:30:00.149559 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.149535 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jwtcw\"" Jul 15 21:30:00.152422 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.152400 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5"] Jul 15 21:30:00.157610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.157594 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" Jul 15 21:30:00.279733 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.279696 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5"] Jul 15 21:30:00.283255 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:30:00.283230 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cfbfa3_b4a5_4f21_9c6d_8583f4db7653.slice/crio-be52e381e4f85786f54d63edf86072c3040c7f6ca242ba869cabcef9f3765b7a WatchSource:0}: Error finding container be52e381e4f85786f54d63edf86072c3040c7f6ca242ba869cabcef9f3765b7a: Status 404 returned error can't find the container with id be52e381e4f85786f54d63edf86072c3040c7f6ca242ba869cabcef9f3765b7a Jul 15 21:30:00.285166 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.285150 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:30:00.414416 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:00.414354 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" event={"ID":"76cfbfa3-b4a5-4f21-9c6d-8583f4db7653","Type":"ContainerStarted","Data":"be52e381e4f85786f54d63edf86072c3040c7f6ca242ba869cabcef9f3765b7a"} Jul 15 21:30:06.443037 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:06.443004 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" event={"ID":"76cfbfa3-b4a5-4f21-9c6d-8583f4db7653","Type":"ContainerStarted","Data":"ea01a0daa05ed5ae58bf13d0cfdaf1810a2e32d7bd9d6e9fd9278f10cbec5788"} Jul 15 21:30:06.458445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:06.458397 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" podStartSLOduration=0.703745701 podStartE2EDuration="6.458379732s" totalImagesPullingTime="5.754634031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:06.457761578 +0000 UTC m=+1227.938746171" watchObservedRunningTime="2026-07-15 21:30:06.458379732 +0000 UTC m=+1227.939364324" Jul 15 21:30:07.449041 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:07.449008 2585 generic.go:356] "Generic (PLEG): container finished" podID="76cfbfa3-b4a5-4f21-9c6d-8583f4db7653" containerID="ea01a0daa05ed5ae58bf13d0cfdaf1810a2e32d7bd9d6e9fd9278f10cbec5788" exitCode=0 Jul 15 21:30:07.449398 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:07.449084 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" event={"ID":"76cfbfa3-b4a5-4f21-9c6d-8583f4db7653","Type":"ContainerDied","Data":"ea01a0daa05ed5ae58bf13d0cfdaf1810a2e32d7bd9d6e9fd9278f10cbec5788"} Jul 15 21:30:08.577205 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:08.577179 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" Jul 15 21:30:09.458733 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:09.458706 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" Jul 15 21:30:09.458878 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:09.458745 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-qnjc5" event={"ID":"76cfbfa3-b4a5-4f21-9c6d-8583f4db7653","Type":"ContainerDied","Data":"be52e381e4f85786f54d63edf86072c3040c7f6ca242ba869cabcef9f3765b7a"} Jul 15 21:30:09.458878 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:30:09.458790 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be52e381e4f85786f54d63edf86072c3040c7f6ca242ba869cabcef9f3765b7a" Jul 15 21:34:39.001193 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:34:39.001165 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:34:39.003500 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:34:39.003481 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:35:36.577164 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.577088 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh"] Jul 15 21:35:36.577519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.577386 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76cfbfa3-b4a5-4f21-9c6d-8583f4db7653" containerName="cleanup" Jul 15 21:35:36.577519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.577399 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="76cfbfa3-b4a5-4f21-9c6d-8583f4db7653" containerName="cleanup" Jul 15 21:35:36.577519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.577449 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="76cfbfa3-b4a5-4f21-9c6d-8583f4db7653" containerName="cleanup" Jul 15 21:35:36.580284 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.580266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.584073 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.584052 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-d28lw\"" Jul 15 21:35:36.584624 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.584595 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d8b57005-serving-cert\"" Jul 15 21:35:36.585154 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.585138 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 21:35:36.585247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.585229 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 21:35:36.605313 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.605293 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh"] Jul 15 21:35:36.609439 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.609419 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c8219-6d31-47b5-8bec-ef57cafec284-openshift-service-ca\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.609525 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.609447 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9c8219-6d31-47b5-8bec-ef57cafec284-maas-api-tls\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.609525 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.609470 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbn6\" (UniqueName: \"kubernetes.io/projected/bb9c8219-6d31-47b5-8bec-ef57cafec284-kube-api-access-4mbn6\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.709957 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.709910 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c8219-6d31-47b5-8bec-ef57cafec284-openshift-service-ca\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.710079 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.709960 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9c8219-6d31-47b5-8bec-ef57cafec284-maas-api-tls\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.710123 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.710078 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbn6\" (UniqueName: \"kubernetes.io/projected/bb9c8219-6d31-47b5-8bec-ef57cafec284-kube-api-access-4mbn6\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.710557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.710538 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c8219-6d31-47b5-8bec-ef57cafec284-openshift-service-ca\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.712165 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.712149 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9c8219-6d31-47b5-8bec-ef57cafec284-maas-api-tls\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.720592 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.720561 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbn6\" (UniqueName: \"kubernetes.io/projected/bb9c8219-6d31-47b5-8bec-ef57cafec284-kube-api-access-4mbn6\") pod \"maas-api-e2e-ait-d8b57005-6996ff7477-75zdh\" (UID: \"bb9c8219-6d31-47b5-8bec-ef57cafec284\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:36.890234 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:36.890208 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:37.046151 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:37.046123 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh"] Jul 15 21:35:37.049601 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:35:37.049578 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9c8219_6d31_47b5_8bec_ef57cafec284.slice/crio-70334cb9a901f934aaaee6b1b5357f01fbbf5972345ee9ed2f87aaf55b477f12 WatchSource:0}: Error finding container 70334cb9a901f934aaaee6b1b5357f01fbbf5972345ee9ed2f87aaf55b477f12: Status 404 returned error can't find the container with id 70334cb9a901f934aaaee6b1b5357f01fbbf5972345ee9ed2f87aaf55b477f12 Jul 15 21:35:37.050875 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:37.050860 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:35:37.933074 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:37.933038 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" event={"ID":"bb9c8219-6d31-47b5-8bec-ef57cafec284","Type":"ContainerStarted","Data":"70334cb9a901f934aaaee6b1b5357f01fbbf5972345ee9ed2f87aaf55b477f12"} Jul 15 21:35:39.947197 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:39.947156 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" event={"ID":"bb9c8219-6d31-47b5-8bec-ef57cafec284","Type":"ContainerStarted","Data":"a2828928c0ce6076a0e6348b2884f49ef75c1d5105eb627f1dd07f5030ca25e4"} Jul 15 21:35:39.947566 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:39.947239 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:35:39.965707 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:39.965658 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" podStartSLOduration=1.752892327 podStartE2EDuration="3.965644812s" totalImagesPullingTime="2.212752485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:39.963719377 +0000 UTC m=+1561.444703966" watchObservedRunningTime="2026-07-15 21:35:39.965644812 +0000 UTC m=+1561.446629402" Jul 15 21:35:45.957473 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:35:45.957445 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8b57005-6996ff7477-75zdh" Jul 15 21:36:01.218322 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.218283 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w"] Jul 15 21:36:01.225593 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.225566 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.228059 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.228027 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-86b85e98-openshift-default-dockercfg-n2kmv\"" Jul 15 21:36:01.234790 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.234766 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w"] Jul 15 21:36:01.314106 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314072 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-token\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314268 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-certs\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314268 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314191 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-podinfo\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314268 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314221 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-credential-socket\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314403 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314266 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-data\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314403 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314300 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfpk\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-kube-api-access-rxfpk\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314403 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314321 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-envoy\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314403 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314339 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-socket\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.314598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.314427 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istiod-ca-cert\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415074 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415044 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-podinfo\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-credential-socket\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-data\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415135 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfpk\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-kube-api-access-rxfpk\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415162 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-envoy\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415204 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-socket\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415439 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415231 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istiod-ca-cert\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415439 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415267 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-token\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415439 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415311 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-certs\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415490 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-credential-socket\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415545 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-data\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415667 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415654 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-socket\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.415759 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.415740 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-certs\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.416108 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.416090 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istiod-ca-cert\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.417929 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.417897 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-envoy\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.418242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.418223 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-podinfo\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.424514 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.424488 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfpk\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-kube-api-access-rxfpk\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.426238 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.426215 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-token\") pod \"e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.538035 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.537966 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:01.676436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:01.676412 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w"] Jul 15 21:36:01.678344 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:36:01.678321 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6c80fe_5b23_4d8b_8db2_ea29281ab078.slice/crio-9ed57463911ea6fa0260754ca715cac16d1b6736b99e6cf4a8663632d48e8dd4 WatchSource:0}: Error finding container 9ed57463911ea6fa0260754ca715cac16d1b6736b99e6cf4a8663632d48e8dd4: Status 404 returned error can't find the container with id 9ed57463911ea6fa0260754ca715cac16d1b6736b99e6cf4a8663632d48e8dd4 Jul 15 21:36:02.045905 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:02.045874 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" event={"ID":"fa6c80fe-5b23-4d8b-8db2-ea29281ab078","Type":"ContainerStarted","Data":"9ed57463911ea6fa0260754ca715cac16d1b6736b99e6cf4a8663632d48e8dd4"} Jul 15 21:36:03.935858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:03.935816 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:36:03.936140 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:03.935903 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:36:03.936140 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:03.935971 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:36:04.057883 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:04.057840 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" event={"ID":"fa6c80fe-5b23-4d8b-8db2-ea29281ab078","Type":"ContainerStarted","Data":"9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756"} Jul 15 21:36:04.077959 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:04.077882 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" podStartSLOduration=0.822620728 podStartE2EDuration="3.077862901s" totalImagesPullingTime="2.255242173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:04.076499988 +0000 UTC m=+1585.557484579" watchObservedRunningTime="2026-07-15 21:36:04.077862901 +0000 UTC m=+1585.558847494" Jul 15 21:36:04.538262 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:04.538227 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:04.542730 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:04.542703 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:05.063153 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:05.063125 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:05.064015 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:05.063992 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:06.922744 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:06.922710 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w"] Jul 15 21:36:07.072373 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:07.072341 2585 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" secret="" err="secret \"e2e-derive-86b85e98-openshift-default-dockercfg-n2kmv\" not found" Jul 15 21:36:08.076707 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:08.076668 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" podUID="fa6c80fe-5b23-4d8b-8db2-ea29281ab078" containerName="istio-proxy" containerID="cri-o://9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756" gracePeriod=30 Jul 15 21:36:13.421441 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.421351 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:13.519750 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519673 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-podinfo\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.519750 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519707 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-data\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.519750 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519728 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istiod-ca-cert\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.519750 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519743 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-envoy\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.520086 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519797 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-token\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.520086 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519814 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-certs\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.520086 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519831 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-credential-socket\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.520086 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519851 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxfpk\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-kube-api-access-rxfpk\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.520086 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.519876 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-socket\") pod \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\" (UID: \"fa6c80fe-5b23-4d8b-8db2-ea29281ab078\") " Jul 15 21:36:13.520662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.520629 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:13.521006 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.520806 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:13.521006 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.520822 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:13.521006 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.520851 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:13.524163 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.521004 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:36:13.524947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.524547 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-kube-api-access-rxfpk" (OuterVolumeSpecName: "kube-api-access-rxfpk") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "kube-api-access-rxfpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:36:13.524947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.524628 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:13.524947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.524798 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:36:13.528465 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.528433 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa6c80fe-5b23-4d8b-8db2-ea29281ab078" (UID: "fa6c80fe-5b23-4d8b-8db2-ea29281ab078"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:36:13.621510 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621478 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621510 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621506 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621510 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621516 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621527 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxfpk\" (UniqueName: \"kubernetes.io/projected/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-kube-api-access-rxfpk\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621536 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621545 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621552 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621559 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:13.621708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:13.621566 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6c80fe-5b23-4d8b-8db2-ea29281ab078-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:36:14.106287 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.106257 2585 generic.go:356] "Generic (PLEG): container finished" podID="fa6c80fe-5b23-4d8b-8db2-ea29281ab078" containerID="9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756" exitCode=0 Jul 15 21:36:14.106440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.106309 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" event={"ID":"fa6c80fe-5b23-4d8b-8db2-ea29281ab078","Type":"ContainerDied","Data":"9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756"} Jul 15 21:36:14.106440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.106325 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" Jul 15 21:36:14.106440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.106351 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w" event={"ID":"fa6c80fe-5b23-4d8b-8db2-ea29281ab078","Type":"ContainerDied","Data":"9ed57463911ea6fa0260754ca715cac16d1b6736b99e6cf4a8663632d48e8dd4"} Jul 15 21:36:14.106440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.106371 2585 scope.go:117] "RemoveContainer" containerID="9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756" Jul 15 21:36:14.115685 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.115670 2585 scope.go:117] "RemoveContainer" containerID="9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756" Jul 15 21:36:14.115974 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:36:14.115953 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756\": container with ID starting with 9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756 not found: ID does not exist" containerID="9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756" Jul 15 21:36:14.116022 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.115984 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756"} err="failed to get container status \"9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756\": rpc error: code = NotFound desc = could not find container \"9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756\": container with ID starting with 9a6b920806fd290a1e884f2884baf37cd2d3bcfcf3cde58dae6a27ac9afb8756 not found: ID does not exist" Jul 15 21:36:14.128349 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.128326 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w"] Jul 15 21:36:14.130785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.130765 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-86b85e98-openshift-default-6cf4d5f8bc-lfd7w"] Jul 15 21:36:14.975047 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:36:14.975015 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6c80fe-5b23-4d8b-8db2-ea29281ab078" path="/var/lib/kubelet/pods/fa6c80fe-5b23-4d8b-8db2-ea29281ab078/volumes" Jul 15 21:37:50.153441 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.153407 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w"] Jul 15 21:37:50.154039 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.153735 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6c80fe-5b23-4d8b-8db2-ea29281ab078" containerName="istio-proxy" Jul 15 21:37:50.154039 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.153745 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6c80fe-5b23-4d8b-8db2-ea29281ab078" containerName="istio-proxy" Jul 15 21:37:50.154039 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.153804 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6c80fe-5b23-4d8b-8db2-ea29281ab078" containerName="istio-proxy" Jul 15 21:37:50.156640 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.156623 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.166472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.166451 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c2c3a008-openshift-default-dockercfg-plx64\"" Jul 15 21:37:50.177350 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177326 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-certs\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177446 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177371 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-token\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177446 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177392 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-credential-socket\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177446 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177410 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-envoy\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177457 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0043aea4-8e61-43a6-a79f-af618e2e76d0-istiod-ca-cert\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-podinfo\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177537 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-data\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177598 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-socket\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.177744 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.177635 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nntfz\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-kube-api-access-nntfz\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.203287 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.203252 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w"] Jul 15 21:37:50.278155 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-podinfo\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278155 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278153 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-data\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-socket\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278213 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nntfz\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-kube-api-access-nntfz\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-certs\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-token\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278299 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-credential-socket\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278323 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-envoy\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278344 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0043aea4-8e61-43a6-a79f-af618e2e76d0-istiod-ca-cert\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278717 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-data\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278717 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278616 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-socket\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278806 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278750 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-credential-socket\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.278904 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.278851 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-certs\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.279050 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.279029 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0043aea4-8e61-43a6-a79f-af618e2e76d0-istiod-ca-cert\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.281088 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.281057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-envoy\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.281220 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.281198 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-podinfo\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.289667 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.289642 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-token\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.290419 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.290395 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nntfz\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-kube-api-access-nntfz\") pod \"e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.466103 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.466016 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:50.603599 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.603571 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w"] Jul 15 21:37:50.605225 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:37:50.605202 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0043aea4_8e61_43a6_a79f_af618e2e76d0.slice/crio-92dfa01b915ed506d63d017af105565c701b7d8e44851bf93dc1cd81dacce640 WatchSource:0}: Error finding container 92dfa01b915ed506d63d017af105565c701b7d8e44851bf93dc1cd81dacce640: Status 404 returned error can't find the container with id 92dfa01b915ed506d63d017af105565c701b7d8e44851bf93dc1cd81dacce640 Jul 15 21:37:50.607309 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.607280 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:50.607364 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.607347 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:50.607394 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:50.607384 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:51.549667 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:51.549630 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" event={"ID":"0043aea4-8e61-43a6-a79f-af618e2e76d0","Type":"ContainerStarted","Data":"cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482"} Jul 15 21:37:51.550078 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:51.549692 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" event={"ID":"0043aea4-8e61-43a6-a79f-af618e2e76d0","Type":"ContainerStarted","Data":"92dfa01b915ed506d63d017af105565c701b7d8e44851bf93dc1cd81dacce640"} Jul 15 21:37:51.573494 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:51.573444 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" podStartSLOduration=1.5734270449999999 podStartE2EDuration="1.573427045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:51.57156921 +0000 UTC m=+1693.052553801" watchObservedRunningTime="2026-07-15 21:37:51.573427045 +0000 UTC m=+1693.054411665" Jul 15 21:37:52.466858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:52.466826 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:52.472019 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:52.471993 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:52.555411 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:52.555375 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:37:52.556325 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:37:52.556306 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:06.621065 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:06.621031 2585 generic.go:356] "Generic (PLEG): container finished" podID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerID="cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482" exitCode=0 Jul 15 21:38:06.621450 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:06.621103 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" event={"ID":"0043aea4-8e61-43a6-a79f-af618e2e76d0","Type":"ContainerDied","Data":"cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482"} Jul 15 21:38:06.621499 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:06.621486 2585 scope.go:117] "RemoveContainer" containerID="cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482" Jul 15 21:38:06.622449 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:06.622408 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:38:06.622577 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:06.622496 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:38:06.622577 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:06.622544 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:38:07.556126 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:07.556021 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:07.627028 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:07.626994 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" event={"ID":"0043aea4-8e61-43a6-a79f-af618e2e76d0","Type":"ContainerStarted","Data":"2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022"} Jul 15 21:38:08.466682 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:08.466649 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:08.467696 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:08.467664 2585 patch_prober.go:28] interesting pod/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 21:38:08.467832 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:08.467721 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 21:38:09.466381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:09.466344 2585 patch_prober.go:28] interesting pod/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 21:38:09.466754 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:09.466398 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 21:38:10.466765 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:10.466727 2585 patch_prober.go:28] interesting pod/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 21:38:10.467188 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:10.466782 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 21:38:11.470174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:11.470146 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:11.470569 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:11.470432 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:11.471141 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:11.471123 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:11.845785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:11.845707 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w"] Jul 15 21:38:12.653841 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:12.653810 2585 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" secret="" err="secret \"e2e-mt-c2c3a008-openshift-default-dockercfg-plx64\" not found" Jul 15 21:38:13.658311 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:13.658268 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" containerID="cri-o://2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022" gracePeriod=30 Jul 15 21:38:18.903569 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:18.903546 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:19.027336 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027268 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-credential-socket\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027336 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027297 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-envoy\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027336 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027331 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-data\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027362 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-podinfo\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027392 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-token\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027422 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nntfz\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-kube-api-access-nntfz\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027467 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-socket\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027519 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0043aea4-8e61-43a6-a79f-af618e2e76d0-istiod-ca-cert\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027552 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-certs\") pod \"0043aea4-8e61-43a6-a79f-af618e2e76d0\" (UID: \"0043aea4-8e61-43a6-a79f-af618e2e76d0\") " Jul 15 21:38:19.027791 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027561 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:19.027791 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027759 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:19.027892 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027862 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.027892 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027881 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.028059 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.027989 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:19.028180 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.028136 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0043aea4-8e61-43a6-a79f-af618e2e76d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:38:19.028482 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.028457 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:19.029523 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.029502 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:19.029684 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.029668 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:38:19.029995 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.029977 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:38:19.030060 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.029993 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-kube-api-access-nntfz" (OuterVolumeSpecName: "kube-api-access-nntfz") pod "0043aea4-8e61-43a6-a79f-af618e2e76d0" (UID: "0043aea4-8e61-43a6-a79f-af618e2e76d0"). InnerVolumeSpecName "kube-api-access-nntfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:38:19.128426 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128398 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0043aea4-8e61-43a6-a79f-af618e2e76d0-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.128426 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128421 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.128578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128434 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.128578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128445 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.128578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128457 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.128578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128467 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.128578 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.128479 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nntfz\" (UniqueName: \"kubernetes.io/projected/0043aea4-8e61-43a6-a79f-af618e2e76d0-kube-api-access-nntfz\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:38:19.688208 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.688175 2585 generic.go:356] "Generic (PLEG): container finished" podID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerID="2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022" exitCode=0 Jul 15 21:38:19.688371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.688220 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" event={"ID":"0043aea4-8e61-43a6-a79f-af618e2e76d0","Type":"ContainerDied","Data":"2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022"} Jul 15 21:38:19.688371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.688228 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" Jul 15 21:38:19.688371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.688261 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w" event={"ID":"0043aea4-8e61-43a6-a79f-af618e2e76d0","Type":"ContainerDied","Data":"92dfa01b915ed506d63d017af105565c701b7d8e44851bf93dc1cd81dacce640"} Jul 15 21:38:19.688371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.688282 2585 scope.go:117] "RemoveContainer" containerID="2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022" Jul 15 21:38:19.696975 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.696952 2585 scope.go:117] "RemoveContainer" containerID="cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482" Jul 15 21:38:19.704396 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.704377 2585 scope.go:117] "RemoveContainer" containerID="2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022" Jul 15 21:38:19.704648 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:38:19.704631 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022\": container with ID starting with 2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022 not found: ID does not exist" containerID="2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022" Jul 15 21:38:19.704690 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.704655 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022"} err="failed to get container status \"2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022\": rpc error: code = NotFound desc = could not find container \"2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022\": container with ID starting with 2027e11b33670b656d3d9c23c1125a8336cd332ea921dff6693b52077bae6022 not found: ID does not exist" Jul 15 21:38:19.704690 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.704671 2585 scope.go:117] "RemoveContainer" containerID="cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482" Jul 15 21:38:19.704905 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:38:19.704887 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482\": container with ID starting with cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482 not found: ID does not exist" containerID="cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482" Jul 15 21:38:19.704974 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.704910 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482"} err="failed to get container status \"cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482\": rpc error: code = NotFound desc = could not find container \"cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482\": container with ID starting with cb225fffc3c861ac00ae0f05682a139399995d604d404e13e823f60b3ed74482 not found: ID does not exist" Jul 15 21:38:19.710350 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.710326 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w"] Jul 15 21:38:19.714355 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:19.714332 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c2c3a008-openshift-default-95f755cdc-tkw2w"] Jul 15 21:38:20.975336 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:38:20.975299 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" path="/var/lib/kubelet/pods/0043aea4-8e61-43a6-a79f-af618e2e76d0/volumes" Jul 15 21:39:26.530174 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.530141 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h"] Jul 15 21:39:26.530704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.530633 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" Jul 15 21:39:26.530704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.530651 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" Jul 15 21:39:26.530704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.530674 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" Jul 15 21:39:26.530704 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.530683 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" Jul 15 21:39:26.530907 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.530777 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" Jul 15 21:39:26.532633 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.532614 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.535577 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.535558 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4ec9ec-openshift-default-dockercfg-8s9wr\"" Jul 15 21:39:26.574403 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.574377 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h"] Jul 15 21:39:26.677272 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677242 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-socket\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677431 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677280 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-certs\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677431 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677305 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-token\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677431 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677347 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-credential-socket\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677431 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677380 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-data\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677435 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-podinfo\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677451 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39399711-4b51-421f-992e-54b9cd6b2dbe-istiod-ca-cert\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77grt\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-kube-api-access-77grt\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.677568 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.677487 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-envoy\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778195 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778156 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-token\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778248 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-credential-socket\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778295 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-data\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778320 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-podinfo\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778371 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778335 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39399711-4b51-421f-992e-54b9cd6b2dbe-istiod-ca-cert\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778573 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778484 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77grt\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-kube-api-access-77grt\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778573 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778531 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-envoy\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778675 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778613 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-socket\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778675 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778657 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-certs\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778768 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778687 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-data\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.778768 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778704 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-credential-socket\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.779010 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.778991 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-certs\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.779095 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.779026 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-socket\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.779150 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.779097 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39399711-4b51-421f-992e-54b9cd6b2dbe-istiod-ca-cert\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.780762 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.780697 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-envoy\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.780846 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.780778 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-podinfo\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.786471 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.786449 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77grt\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-kube-api-access-77grt\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.786670 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.786649 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-token\") pod \"e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.850201 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.850173 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:26.990087 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.990050 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h"] Jul 15 21:39:26.993306 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:39:26.993280 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39399711_4b51_421f_992e_54b9cd6b2dbe.slice/crio-37d8752e9e502a37772b5da99c9539139f4b6268c2144af29320a21beb7ecf89 WatchSource:0}: Error finding container 37d8752e9e502a37772b5da99c9539139f4b6268c2144af29320a21beb7ecf89: Status 404 returned error can't find the container with id 37d8752e9e502a37772b5da99c9539139f4b6268c2144af29320a21beb7ecf89 Jul 15 21:39:26.995722 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.995694 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:26.995795 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.995756 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:26.995795 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:26.995784 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:28.001248 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:28.001212 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" event={"ID":"39399711-4b51-421f-992e-54b9cd6b2dbe","Type":"ContainerStarted","Data":"ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172"} Jul 15 21:39:28.001618 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:28.001264 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" event={"ID":"39399711-4b51-421f-992e-54b9cd6b2dbe","Type":"ContainerStarted","Data":"37d8752e9e502a37772b5da99c9539139f4b6268c2144af29320a21beb7ecf89"} Jul 15 21:39:28.023428 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:28.023383 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podStartSLOduration=2.023367849 podStartE2EDuration="2.023367849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:28.021332809 +0000 UTC m=+1789.502317401" watchObservedRunningTime="2026-07-15 21:39:28.023367849 +0000 UTC m=+1789.504352440" Jul 15 21:39:28.850349 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:28.850312 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:28.854685 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:28.854659 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:29.006103 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.006076 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:29.007058 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.007039 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:29.043964 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.043357 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd"] Jul 15 21:39:29.043964 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.043945 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0043aea4-8e61-43a6-a79f-af618e2e76d0" containerName="istio-proxy" Jul 15 21:39:29.050754 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.050731 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.053614 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.053590 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4ec9ec-serving-cert\"" Jul 15 21:39:29.063441 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.063407 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd"] Jul 15 21:39:29.199452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.199424 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4bcf\" (UniqueName: \"kubernetes.io/projected/e4e1b770-e557-489f-9289-1d1b8cdcf544-kube-api-access-z4bcf\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.199614 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.199477 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1b770-e557-489f-9289-1d1b8cdcf544-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.199614 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.199530 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4e1b770-e557-489f-9289-1d1b8cdcf544-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.300575 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.300545 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4e1b770-e557-489f-9289-1d1b8cdcf544-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.300736 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.300601 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4bcf\" (UniqueName: \"kubernetes.io/projected/e4e1b770-e557-489f-9289-1d1b8cdcf544-kube-api-access-z4bcf\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.300736 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.300643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1b770-e557-489f-9289-1d1b8cdcf544-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.301269 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.301251 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1b770-e557-489f-9289-1d1b8cdcf544-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.302881 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.302860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4e1b770-e557-489f-9289-1d1b8cdcf544-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.309354 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.309330 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4bcf\" (UniqueName: \"kubernetes.io/projected/e4e1b770-e557-489f-9289-1d1b8cdcf544-kube-api-access-z4bcf\") pod \"maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd\" (UID: \"e4e1b770-e557-489f-9289-1d1b8cdcf544\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.364550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.364522 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:29.500010 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:29.499984 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd"] Jul 15 21:39:29.502591 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:39:29.502551 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e1b770_e557_489f_9289_1d1b8cdcf544.slice/crio-4642151611f19ee106d525e249d932fea7e255ea41391cdad4b1074baad3c88c WatchSource:0}: Error finding container 4642151611f19ee106d525e249d932fea7e255ea41391cdad4b1074baad3c88c: Status 404 returned error can't find the container with id 4642151611f19ee106d525e249d932fea7e255ea41391cdad4b1074baad3c88c Jul 15 21:39:30.011489 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:30.011445 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" event={"ID":"e4e1b770-e557-489f-9289-1d1b8cdcf544","Type":"ContainerStarted","Data":"8b288a6b9ef0246dfd4a1b0bdb6112c458913c2ce4e565fc0155170bf8b3e340"} Jul 15 21:39:30.011885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:30.011637 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:30.011885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:30.011680 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" event={"ID":"e4e1b770-e557-489f-9289-1d1b8cdcf544","Type":"ContainerStarted","Data":"4642151611f19ee106d525e249d932fea7e255ea41391cdad4b1074baad3c88c"} Jul 15 21:39:30.041069 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:30.041018 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" podStartSLOduration=0.698707297 podStartE2EDuration="1.040998439s" totalImagesPullingTime="342.291142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:30.037546704 +0000 UTC m=+1791.518531296" watchObservedRunningTime="2026-07-15 21:39:30.040998439 +0000 UTC m=+1791.521983033" Jul 15 21:39:35.117818 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.117745 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l"] Jul 15 21:39:35.120276 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.120256 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.122562 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.122541 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a5309f-openshift-default-dockercfg-fpfqq\"" Jul 15 21:39:35.144727 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.144702 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l"] Jul 15 21:39:35.255045 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255010 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-token\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255054 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-envoy\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255081 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-data\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255115 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istiod-ca-cert\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-credential-socket\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255163 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-certs\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255366 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255221 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-socket\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255366 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255283 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-podinfo\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.255366 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.255306 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zssg2\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-kube-api-access-zssg2\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355746 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355707 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zssg2\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-kube-api-access-zssg2\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355764 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-token\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355792 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-envoy\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355807 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-data\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355824 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istiod-ca-cert\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355848 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-credential-socket\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.355947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.355879 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-certs\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356245 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-socket\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356245 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356121 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-podinfo\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356353 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356332 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-certs\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356432 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356410 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-data\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356482 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356462 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-socket\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356519 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356486 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-credential-socket\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.356678 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.356649 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istiod-ca-cert\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.358140 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.358113 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-envoy\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.358407 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.358390 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-podinfo\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.371931 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.371859 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-token\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.372452 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.372428 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zssg2\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-kube-api-access-zssg2\") pod \"e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.430016 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.429991 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:35.564949 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.564902 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l"] Jul 15 21:39:35.566313 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:39:35.566279 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d8f0db_2ad9_47a7_99a1_01d590c50735.slice/crio-62a2afa41830c0d3e7a7d2f92d9443f452552de3732e30131a34913c6147c8c9 WatchSource:0}: Error finding container 62a2afa41830c0d3e7a7d2f92d9443f452552de3732e30131a34913c6147c8c9: Status 404 returned error can't find the container with id 62a2afa41830c0d3e7a7d2f92d9443f452552de3732e30131a34913c6147c8c9 Jul 15 21:39:35.568575 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.568545 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:35.568661 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.568607 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:35.568661 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:35.568635 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:36.022056 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:36.021985 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd" Jul 15 21:39:36.040636 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:36.040606 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" event={"ID":"b4d8f0db-2ad9-47a7-99a1-01d590c50735","Type":"ContainerStarted","Data":"2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2"} Jul 15 21:39:36.040761 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:36.040656 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" event={"ID":"b4d8f0db-2ad9-47a7-99a1-01d590c50735","Type":"ContainerStarted","Data":"62a2afa41830c0d3e7a7d2f92d9443f452552de3732e30131a34913c6147c8c9"} Jul 15 21:39:36.068630 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:36.068581 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podStartSLOduration=1.068560706 podStartE2EDuration="1.068560706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:36.065588273 +0000 UTC m=+1797.546572863" watchObservedRunningTime="2026-07-15 21:39:36.068560706 +0000 UTC m=+1797.549545297" Jul 15 21:39:36.431020 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:36.430992 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:36.436587 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:36.436557 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:37.045352 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:37.045323 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:37.046550 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:37.046529 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:39.028090 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:39.028063 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:39:39.032474 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:39.032453 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:39:45.047106 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:45.047063 2585 patch_prober.go:28] interesting pod/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 21:39:45.047543 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:45.047140 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 21:39:46.106528 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:46.106492 2585 generic.go:356] "Generic (PLEG): container finished" podID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerID="ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172" exitCode=0 Jul 15 21:39:46.106950 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:46.106567 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" event={"ID":"39399711-4b51-421f-992e-54b9cd6b2dbe","Type":"ContainerDied","Data":"ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172"} Jul 15 21:39:46.106996 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:46.106972 2585 scope.go:117] "RemoveContainer" containerID="ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172" Jul 15 21:39:46.108104 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:46.108077 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:46.108176 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:46.108159 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:46.108230 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:46.108217 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:47.113353 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:47.113268 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" event={"ID":"39399711-4b51-421f-992e-54b9cd6b2dbe","Type":"ContainerStarted","Data":"04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289"} Jul 15 21:39:47.851327 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:47.851285 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:47.851544 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:47.851418 2585 patch_prober.go:28] interesting pod/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 21:39:47.851544 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:47.851460 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 21:39:48.850820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:48.850774 2585 patch_prober.go:28] interesting pod/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 21:39:48.851335 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:48.850845 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 21:39:49.850929 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:49.850868 2585 patch_prober.go:28] interesting pod/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 21:39:49.851415 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:49.850955 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 21:39:50.851311 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:50.851269 2585 patch_prober.go:28] interesting pod/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 21:39:50.851904 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:50.851868 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 21:39:51.854734 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:51.854698 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:51.855181 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:51.855093 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:51.855794 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:51.855773 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:39:53.087048 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:53.087008 2585 patch_prober.go:28] interesting pod/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 21:39:53.087501 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:53.087055 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 21:39:54.146544 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:54.146517 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerID="2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2" exitCode=0 Jul 15 21:39:54.146906 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:54.146591 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" event={"ID":"b4d8f0db-2ad9-47a7-99a1-01d590c50735","Type":"ContainerDied","Data":"2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2"} Jul 15 21:39:54.146971 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:54.146952 2585 scope.go:117] "RemoveContainer" containerID="2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2" Jul 15 21:39:54.148115 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:54.148084 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:54.148285 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:54.148263 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:54.148365 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:54.148322 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:55.156538 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:55.156495 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" event={"ID":"b4d8f0db-2ad9-47a7-99a1-01d590c50735","Type":"ContainerStarted","Data":"e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36"} Jul 15 21:39:55.430425 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:55.430330 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:55.430572 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:55.430486 2585 patch_prober.go:28] interesting pod/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 21:39:55.430572 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:55.430531 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 21:39:56.431115 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:56.431083 2585 patch_prober.go:28] interesting pod/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 21:39:56.431484 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:56.431134 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 21:39:57.430744 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:57.430712 2585 patch_prober.go:28] interesting pod/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 21:39:57.430971 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:57.430767 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 21:39:58.431425 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:58.431392 2585 patch_prober.go:28] interesting pod/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 21:39:58.431836 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:58.431446 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 21:39:59.434838 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:59.434810 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:59.435283 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:59.435034 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:39:59.435824 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:39:59.435804 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:41:19.757662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:19.757628 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h"] Jul 15 21:41:19.758173 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:19.757862 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" containerID="cri-o://04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289" gracePeriod=30 Jul 15 21:41:21.857746 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:21.857711 2585 patch_prober.go:28] interesting pod/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:41:21.858122 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:21.857806 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:41:25.012330 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.012298 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:41:25.109305 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109202 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-socket\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109305 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109267 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-certs\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109305 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109296 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-data\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109319 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-envoy\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109343 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-token\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109385 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39399711-4b51-421f-992e-54b9cd6b2dbe-istiod-ca-cert\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109417 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-podinfo\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109439 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77grt\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-kube-api-access-77grt\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109511 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-credential-socket\") pod \"39399711-4b51-421f-992e-54b9cd6b2dbe\" (UID: \"39399711-4b51-421f-992e-54b9cd6b2dbe\") " Jul 15 21:41:25.109585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109520 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:25.109908 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109648 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:25.109908 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109789 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.109908 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109807 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.109908 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.109882 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:25.110181 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.110155 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39399711-4b51-421f-992e-54b9cd6b2dbe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:41:25.110295 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.110270 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-data" (OuterVolumeSpecName: "istio-data") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:25.111791 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.111763 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:41:25.111896 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.111803 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:25.111896 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.111821 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-kube-api-access-77grt" (OuterVolumeSpecName: "kube-api-access-77grt") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "kube-api-access-77grt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:25.111896 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.111848 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-token" (OuterVolumeSpecName: "istio-token") pod "39399711-4b51-421f-992e-54b9cd6b2dbe" (UID: "39399711-4b51-421f-992e-54b9cd6b2dbe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:25.210454 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210417 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39399711-4b51-421f-992e-54b9cd6b2dbe-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.210454 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210447 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.210454 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210456 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77grt\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-kube-api-access-77grt\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.210700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210467 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.210700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210475 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.210700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210483 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.210700 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.210491 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39399711-4b51-421f-992e-54b9cd6b2dbe-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:25.576958 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.576904 2585 generic.go:356] "Generic (PLEG): container finished" podID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerID="04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289" exitCode=0 Jul 15 21:41:25.577122 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.576963 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" Jul 15 21:41:25.577122 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.576989 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" event={"ID":"39399711-4b51-421f-992e-54b9cd6b2dbe","Type":"ContainerDied","Data":"04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289"} Jul 15 21:41:25.577122 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.577040 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h" event={"ID":"39399711-4b51-421f-992e-54b9cd6b2dbe","Type":"ContainerDied","Data":"37d8752e9e502a37772b5da99c9539139f4b6268c2144af29320a21beb7ecf89"} Jul 15 21:41:25.577122 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.577061 2585 scope.go:117] "RemoveContainer" containerID="04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289" Jul 15 21:41:25.586205 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.586191 2585 scope.go:117] "RemoveContainer" containerID="ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172" Jul 15 21:41:25.594302 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.594281 2585 scope.go:117] "RemoveContainer" containerID="04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289" Jul 15 21:41:25.594567 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:41:25.594549 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289\": container with ID starting with 04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289 not found: ID does not exist" containerID="04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289" Jul 15 21:41:25.594608 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.594577 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289"} err="failed to get container status \"04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289\": rpc error: code = NotFound desc = could not find container \"04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289\": container with ID starting with 04b1e6e9a0b7277cb957559bc604a63e9f6f8904f8352e0216786cadf2489289 not found: ID does not exist" Jul 15 21:41:25.594608 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.594595 2585 scope.go:117] "RemoveContainer" containerID="ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172" Jul 15 21:41:25.594836 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:41:25.594821 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172\": container with ID starting with ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172 not found: ID does not exist" containerID="ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172" Jul 15 21:41:25.594889 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.594838 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172"} err="failed to get container status \"ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172\": rpc error: code = NotFound desc = could not find container \"ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172\": container with ID starting with ce1d8fdaf5258d0373c0c05dda79c7def68e0922bc88d175806d8a836e538172 not found: ID does not exist" Jul 15 21:41:25.599777 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.599750 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h"] Jul 15 21:41:25.604374 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:25.604349 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4ec9ec-openshift-default-58889767bc-lsb7h"] Jul 15 21:41:26.974064 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:26.974030 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" path="/var/lib/kubelet/pods/39399711-4b51-421f-992e-54b9cd6b2dbe/volumes" Jul 15 21:41:27.024407 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.024375 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l"] Jul 15 21:41:27.024608 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.024568 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" containerID="cri-o://e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36" gracePeriod=30 Jul 15 21:41:27.951557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.951524 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m"] Jul 15 21:41:27.951876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.951853 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" Jul 15 21:41:27.951876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.951874 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" Jul 15 21:41:27.951876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.951885 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" Jul 15 21:41:27.951876 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.951890 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" Jul 15 21:41:27.952296 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.952075 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" Jul 15 21:41:27.952296 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.952093 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="39399711-4b51-421f-992e-54b9cd6b2dbe" containerName="istio-proxy" Jul 15 21:41:27.955310 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.955291 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:27.957581 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.957562 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-599e95-openshift-default-dockercfg-rmpqf\"" Jul 15 21:41:27.967825 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:27.967804 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m"] Jul 15 21:41:28.032756 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.032722 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-certs\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.032776 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc45n\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-kube-api-access-pc45n\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.032794 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-envoy\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.032909 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-podinfo\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.032974 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-credential-socket\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.032995 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a221305d-5c82-4b04-86d7-1f6eadb43655-istiod-ca-cert\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.033022 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-socket\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033089 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.033070 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-token\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.033350 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.033127 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-data\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134241 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134206 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc45n\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-kube-api-access-pc45n\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134241 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134247 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-envoy\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134459 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134265 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-podinfo\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134459 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-credential-socket\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134459 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134315 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a221305d-5c82-4b04-86d7-1f6eadb43655-istiod-ca-cert\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134459 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134334 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-socket\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-token\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134526 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-data\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134608 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-certs\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.134831 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134722 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-socket\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.135043 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.134983 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-certs\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.135136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.135046 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-credential-socket\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.135136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.135093 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-data\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.135136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.135104 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a221305d-5c82-4b04-86d7-1f6eadb43655-istiod-ca-cert\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.136591 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.136563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-envoy\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.136783 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.136765 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-podinfo\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.143265 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.143243 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-token\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.143601 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.143578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc45n\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-kube-api-access-pc45n\") pod \"e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.265940 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.265839 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:28.400333 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.400214 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m"] Jul 15 21:41:28.402544 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:41:28.402520 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda221305d_5c82_4b04_86d7_1f6eadb43655.slice/crio-c178ed1afc9ea820a270011db7bad7df7ef32ede283d24bcf1fe53f10a52a995 WatchSource:0}: Error finding container c178ed1afc9ea820a270011db7bad7df7ef32ede283d24bcf1fe53f10a52a995: Status 404 returned error can't find the container with id c178ed1afc9ea820a270011db7bad7df7ef32ede283d24bcf1fe53f10a52a995 Jul 15 21:41:28.404659 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.404629 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:28.404731 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.404714 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:28.404767 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.404751 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:28.597609 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.597526 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" event={"ID":"a221305d-5c82-4b04-86d7-1f6eadb43655","Type":"ContainerStarted","Data":"b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6"} Jul 15 21:41:28.597609 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.597597 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" event={"ID":"a221305d-5c82-4b04-86d7-1f6eadb43655","Type":"ContainerStarted","Data":"c178ed1afc9ea820a270011db7bad7df7ef32ede283d24bcf1fe53f10a52a995"} Jul 15 21:41:28.619855 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:28.619800 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podStartSLOduration=1.6197818050000001 podStartE2EDuration="1.619781805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:28.618359551 +0000 UTC m=+1910.099344143" watchObservedRunningTime="2026-07-15 21:41:28.619781805 +0000 UTC m=+1910.100766397" Jul 15 21:41:29.267055 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:29.267018 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:29.271855 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:29.271829 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:29.437932 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:29.437879 2585 patch_prober.go:28] interesting pod/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:41:29.438071 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:29.437961 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:41:29.603292 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:29.603202 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:29.604112 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:29.604091 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:32.273987 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.273964 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:41:32.376545 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376524 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istiod-ca-cert\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.376727 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376553 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-podinfo\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.376727 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376596 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-token\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.376727 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376617 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-credential-socket\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.376887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376743 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-data\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.376887 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376811 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zssg2\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-kube-api-access-zssg2\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.377042 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376902 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-envoy\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.377042 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376942 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:32.377042 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376952 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-certs\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.377042 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.376999 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-socket\") pod \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\" (UID: \"b4d8f0db-2ad9-47a7-99a1-01d590c50735\") " Jul 15 21:41:32.377222 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.377043 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:41:32.377222 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.377201 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:32.377383 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.377362 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.377436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.377378 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:32.377436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.377388 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.377436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.377415 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.378235 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.378206 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:32.378890 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.378863 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:32.379064 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.379042 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:41:32.379235 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.379217 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-kube-api-access-zssg2" (OuterVolumeSpecName: "kube-api-access-zssg2") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "kube-api-access-zssg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:32.379315 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.379300 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4d8f0db-2ad9-47a7-99a1-01d590c50735" (UID: "b4d8f0db-2ad9-47a7-99a1-01d590c50735"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:32.478318 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.478292 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.478318 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.478314 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zssg2\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-kube-api-access-zssg2\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.478318 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.478324 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.478507 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.478332 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4d8f0db-2ad9-47a7-99a1-01d590c50735-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.478507 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.478340 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.478507 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.478349 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d8f0db-2ad9-47a7-99a1-01d590c50735-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:41:32.618265 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.618235 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerID="e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36" exitCode=0 Jul 15 21:41:32.618437 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.618274 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" event={"ID":"b4d8f0db-2ad9-47a7-99a1-01d590c50735","Type":"ContainerDied","Data":"e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36"} Jul 15 21:41:32.618437 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.618281 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" Jul 15 21:41:32.618437 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.618311 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l" event={"ID":"b4d8f0db-2ad9-47a7-99a1-01d590c50735","Type":"ContainerDied","Data":"62a2afa41830c0d3e7a7d2f92d9443f452552de3732e30131a34913c6147c8c9"} Jul 15 21:41:32.618437 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.618332 2585 scope.go:117] "RemoveContainer" containerID="e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36" Jul 15 21:41:32.627341 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.627323 2585 scope.go:117] "RemoveContainer" containerID="2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2" Jul 15 21:41:32.634684 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.634663 2585 scope.go:117] "RemoveContainer" containerID="e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36" Jul 15 21:41:32.634990 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:41:32.634955 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36\": container with ID starting with e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36 not found: ID does not exist" containerID="e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36" Jul 15 21:41:32.635073 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.635003 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36"} err="failed to get container status \"e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36\": rpc error: code = NotFound desc = could not find container \"e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36\": container with ID starting with e08201b5bdd3e932f08b398dcc9e81c16300458be05c4d817ea5d0372314aa36 not found: ID does not exist" Jul 15 21:41:32.635073 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.635026 2585 scope.go:117] "RemoveContainer" containerID="2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2" Jul 15 21:41:32.635294 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:41:32.635272 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2\": container with ID starting with 2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2 not found: ID does not exist" containerID="2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2" Jul 15 21:41:32.635334 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.635302 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2"} err="failed to get container status \"2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2\": rpc error: code = NotFound desc = could not find container \"2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2\": container with ID starting with 2f2d941db4c70f0ed5ffd54a388bf2fd68cd31e1317aad067fce8b75db6679a2 not found: ID does not exist" Jul 15 21:41:32.641591 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.641567 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l"] Jul 15 21:41:32.646142 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.646123 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a5309f-openshift-default-5895777899-ncv9l"] Jul 15 21:41:32.974595 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:32.974517 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" path="/var/lib/kubelet/pods/b4d8f0db-2ad9-47a7-99a1-01d590c50735/volumes" Jul 15 21:41:35.951198 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951166 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk"] Jul 15 21:41:35.951557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951498 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" Jul 15 21:41:35.951557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951509 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" Jul 15 21:41:35.951557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951523 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" Jul 15 21:41:35.951557 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951528 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" Jul 15 21:41:35.951690 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951595 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" Jul 15 21:41:35.951690 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.951604 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d8f0db-2ad9-47a7-99a1-01d590c50735" containerName="istio-proxy" Jul 15 21:41:35.954627 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.954608 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:35.958708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.958684 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d3a40f-openshift-default-dockercfg-8lczg\"" Jul 15 21:41:35.969883 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:35.969861 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk"] Jul 15 21:41:36.009912 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.009885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn97t\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-kube-api-access-fn97t\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010071 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.009998 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-socket\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010137 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010120 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-certs\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010187 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010154 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-podinfo\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010242 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010217 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-credential-socket\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010294 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010278 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-envoy\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010332 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010309 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-token\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010377 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010337 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-data\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.010421 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.010391 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cf36885-b481-462c-80c2-ca4b8c5d939e-istiod-ca-cert\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111408 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-token\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111440 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111442 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-data\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111672 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cf36885-b481-462c-80c2-ca4b8c5d939e-istiod-ca-cert\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111672 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111586 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn97t\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-kube-api-access-fn97t\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111672 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-socket\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111700 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-certs\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111728 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-podinfo\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.111891 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-data\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.112083 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.111888 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-credential-socket\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.112083 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.112004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-envoy\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.112083 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.112060 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-socket\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.112083 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.112073 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-certs\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.112304 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.112285 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cf36885-b481-462c-80c2-ca4b8c5d939e-istiod-ca-cert\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.112355 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.112287 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-credential-socket\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.114248 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.114222 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-podinfo\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.114342 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.114252 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-envoy\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.120185 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.120162 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-token\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.120673 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.120657 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn97t\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-kube-api-access-fn97t\") pod \"e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.264770 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.264695 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:36.396586 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.396562 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk"] Jul 15 21:41:36.398587 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:41:36.398551 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf36885_b481_462c_80c2_ca4b8c5d939e.slice/crio-f58272efbc0aedaea50937c3c4124ee273377d859e1c8fdc355a90e995d50f4b WatchSource:0}: Error finding container f58272efbc0aedaea50937c3c4124ee273377d859e1c8fdc355a90e995d50f4b: Status 404 returned error can't find the container with id f58272efbc0aedaea50937c3c4124ee273377d859e1c8fdc355a90e995d50f4b Jul 15 21:41:36.401192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.401156 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:36.401267 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.401238 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:36.401303 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.401282 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:36.639290 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.639250 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" event={"ID":"1cf36885-b481-462c-80c2-ca4b8c5d939e","Type":"ContainerStarted","Data":"ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb"} Jul 15 21:41:36.639495 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.639321 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" event={"ID":"1cf36885-b481-462c-80c2-ca4b8c5d939e","Type":"ContainerStarted","Data":"f58272efbc0aedaea50937c3c4124ee273377d859e1c8fdc355a90e995d50f4b"} Jul 15 21:41:36.659666 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:36.659620 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" podStartSLOduration=1.6596048780000001 podStartE2EDuration="1.659604878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:36.658065344 +0000 UTC m=+1918.139049935" watchObservedRunningTime="2026-07-15 21:41:36.659604878 +0000 UTC m=+1918.140589467" Jul 15 21:41:37.265352 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:37.265314 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:37.270244 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:37.270217 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:37.658942 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:37.658021 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:37.661965 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:37.661903 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:44.604531 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.604494 2585 patch_prober.go:28] interesting pod/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 21:41:44.604950 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.604550 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 21:41:44.693202 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.693167 2585 generic.go:356] "Generic (PLEG): container finished" podID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerID="b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6" exitCode=0 Jul 15 21:41:44.693374 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.693219 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" event={"ID":"a221305d-5c82-4b04-86d7-1f6eadb43655","Type":"ContainerDied","Data":"b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6"} Jul 15 21:41:44.693630 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.693610 2585 scope.go:117] "RemoveContainer" containerID="b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6" Jul 15 21:41:44.694544 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.694520 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:44.694596 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.694582 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:44.694640 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:44.694612 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:45.700270 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:45.700239 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" event={"ID":"a221305d-5c82-4b04-86d7-1f6eadb43655","Type":"ContainerStarted","Data":"9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309"} Jul 15 21:41:46.267153 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:46.267107 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:46.267379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:46.267249 2585 patch_prober.go:28] interesting pod/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 21:41:46.267379 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:46.267307 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 21:41:47.266513 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:47.266466 2585 patch_prober.go:28] interesting pod/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 21:41:47.267011 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:47.266537 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 21:41:48.266767 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:48.266727 2585 patch_prober.go:28] interesting pod/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 21:41:48.267159 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:48.266786 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 21:41:49.266216 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:49.266176 2585 patch_prober.go:28] interesting pod/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 21:41:49.266404 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:49.266236 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 21:41:50.270503 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.270471 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:50.270885 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.270754 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:50.271470 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.271451 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:41:50.726442 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.726410 2585 generic.go:356] "Generic (PLEG): container finished" podID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerID="ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb" exitCode=0 Jul 15 21:41:50.726642 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.726489 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" event={"ID":"1cf36885-b481-462c-80c2-ca4b8c5d939e","Type":"ContainerDied","Data":"ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb"} Jul 15 21:41:50.727042 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.727025 2585 scope.go:117] "RemoveContainer" containerID="ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb" Jul 15 21:41:50.727947 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.727901 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:50.728017 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.728000 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:50.728058 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:50.728048 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:51.733875 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:51.733846 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" event={"ID":"1cf36885-b481-462c-80c2-ca4b8c5d939e","Type":"ContainerStarted","Data":"2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f"} Jul 15 21:41:52.265794 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:52.265758 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:52.266668 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:52.266642 2585 patch_prober.go:28] interesting pod/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:41:52.266736 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:52.266711 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 21:41:52.657992 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:52.657954 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:53.265817 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:53.265780 2585 patch_prober.go:28] interesting pod/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:41:53.266205 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:53.265845 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 21:41:54.265472 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:54.265432 2585 patch_prober.go:28] interesting pod/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:41:54.265647 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:54.265502 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 21:41:55.265783 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:55.265738 2585 patch_prober.go:28] interesting pod/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:41:55.266232 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:55.265815 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 21:41:56.269445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:56.269416 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:41:56.270460 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:41:56.270441 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:42:03.759899 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:03.759859 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m"] Jul 15 21:42:03.760361 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:03.760178 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" containerID="cri-o://9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309" gracePeriod=30 Jul 15 21:42:05.273397 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:05.273360 2585 patch_prober.go:28] interesting pod/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:42:05.273773 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:05.273417 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:42:09.007233 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.007207 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:42:09.022760 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022677 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-podinfo\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.022760 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022734 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a221305d-5c82-4b04-86d7-1f6eadb43655-istiod-ca-cert\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.022999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022763 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-token\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.022999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022796 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-data\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.022999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022818 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-socket\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.022999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022963 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-certs\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.022999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.022996 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-credential-socket\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.023252 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023042 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-envoy\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.023252 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023085 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc45n\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-kube-api-access-pc45n\") pod \"a221305d-5c82-4b04-86d7-1f6eadb43655\" (UID: \"a221305d-5c82-4b04-86d7-1f6eadb43655\") " Jul 15 21:42:09.023252 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023125 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:09.023252 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023209 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a221305d-5c82-4b04-86d7-1f6eadb43655-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:42:09.023455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023328 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:09.023455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023381 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a221305d-5c82-4b04-86d7-1f6eadb43655-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.023455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023399 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.023455 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023412 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.023630 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023521 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:09.023708 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.023684 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-data" (OuterVolumeSpecName: "istio-data") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:09.025009 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.024978 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:42:09.025560 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.025541 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-token" (OuterVolumeSpecName: "istio-token") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:42:09.025662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.025643 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:09.025662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.025652 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-kube-api-access-pc45n" (OuterVolumeSpecName: "kube-api-access-pc45n") pod "a221305d-5c82-4b04-86d7-1f6eadb43655" (UID: "a221305d-5c82-4b04-86d7-1f6eadb43655"). InnerVolumeSpecName "kube-api-access-pc45n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:42:09.124381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.124342 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc45n\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-kube-api-access-pc45n\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.124381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.124374 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.124381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.124383 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.124381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.124391 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.124655 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.124399 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.124655 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.124407 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a221305d-5c82-4b04-86d7-1f6eadb43655-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:09.830960 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.830901 2585 generic.go:356] "Generic (PLEG): container finished" podID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerID="9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309" exitCode=0 Jul 15 21:42:09.830960 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.830946 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" event={"ID":"a221305d-5c82-4b04-86d7-1f6eadb43655","Type":"ContainerDied","Data":"9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309"} Jul 15 21:42:09.831175 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.830974 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" Jul 15 21:42:09.831175 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.831004 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m" event={"ID":"a221305d-5c82-4b04-86d7-1f6eadb43655","Type":"ContainerDied","Data":"c178ed1afc9ea820a270011db7bad7df7ef32ede283d24bcf1fe53f10a52a995"} Jul 15 21:42:09.831175 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.831026 2585 scope.go:117] "RemoveContainer" containerID="9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309" Jul 15 21:42:09.840386 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.840369 2585 scope.go:117] "RemoveContainer" containerID="b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6" Jul 15 21:42:09.848247 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.848229 2585 scope.go:117] "RemoveContainer" containerID="9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309" Jul 15 21:42:09.848517 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:42:09.848499 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309\": container with ID starting with 9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309 not found: ID does not exist" containerID="9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309" Jul 15 21:42:09.848579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.848526 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309"} err="failed to get container status \"9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309\": rpc error: code = NotFound desc = could not find container \"9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309\": container with ID starting with 9d85149d388c8fb9b9d5970409d32a01e679e6321949b1531107ef51a8d76309 not found: ID does not exist" Jul 15 21:42:09.848579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.848543 2585 scope.go:117] "RemoveContainer" containerID="b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6" Jul 15 21:42:09.848803 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:42:09.848785 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6\": container with ID starting with b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6 not found: ID does not exist" containerID="b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6" Jul 15 21:42:09.848858 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.848814 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6"} err="failed to get container status \"b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6\": rpc error: code = NotFound desc = could not find container \"b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6\": container with ID starting with b2affebdd5a5442103a66b133e91a5c6ed99ebed06c3a83543a9138ad74c51a6 not found: ID does not exist" Jul 15 21:42:09.853722 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.853695 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m"] Jul 15 21:42:09.857582 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:09.857560 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-599e95-openshift-default-64fbdd5c87-vvv8m"] Jul 15 21:42:10.974932 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:10.974887 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" path="/var/lib/kubelet/pods/a221305d-5c82-4b04-86d7-1f6eadb43655/volumes" Jul 15 21:42:16.562167 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:16.562133 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk"] Jul 15 21:42:16.562528 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:16.562344 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" containerID="cri-o://2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f" gracePeriod=30 Jul 15 21:42:19.337118 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337080 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv"] Jul 15 21:42:19.337575 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337555 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" Jul 15 21:42:19.337660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337578 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" Jul 15 21:42:19.337660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337601 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" Jul 15 21:42:19.337660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337610 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" Jul 15 21:42:19.337803 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337683 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" Jul 15 21:42:19.337803 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.337699 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a221305d-5c82-4b04-86d7-1f6eadb43655" containerName="istio-proxy" Jul 15 21:42:19.339591 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.339570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.342096 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.342074 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c664d0-serving-cert\"" Jul 15 21:42:19.355558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.355522 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv"] Jul 15 21:42:19.411057 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.411025 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065489ea-4e11-4e90-a0fc-28c0c3183c51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.411057 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.411056 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hc5\" (UniqueName: \"kubernetes.io/projected/065489ea-4e11-4e90-a0fc-28c0c3183c51-kube-api-access-s7hc5\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.411261 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.411150 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065489ea-4e11-4e90-a0fc-28c0c3183c51-maas-api-tls\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.512284 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.512244 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065489ea-4e11-4e90-a0fc-28c0c3183c51-maas-api-tls\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.512466 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.512300 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065489ea-4e11-4e90-a0fc-28c0c3183c51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.512466 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:42:19.512395 2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-serving-cert: secret "maas-api-e2e-shared-a-c664d0-serving-cert" not found Jul 15 21:42:19.512466 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.512412 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hc5\" (UniqueName: \"kubernetes.io/projected/065489ea-4e11-4e90-a0fc-28c0c3183c51-kube-api-access-s7hc5\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.512576 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:42:19.512480 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065489ea-4e11-4e90-a0fc-28c0c3183c51-maas-api-tls podName:065489ea-4e11-4e90-a0fc-28c0c3183c51 nodeName:}" failed. No retries permitted until 2026-07-15 21:42:20.012458313 +0000 UTC m=+1961.493442883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/065489ea-4e11-4e90-a0fc-28c0c3183c51-maas-api-tls") pod "maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" (UID: "065489ea-4e11-4e90-a0fc-28c0c3183c51") : secret "maas-api-e2e-shared-a-c664d0-serving-cert" not found Jul 15 21:42:19.513030 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.513013 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065489ea-4e11-4e90-a0fc-28c0c3183c51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:19.525142 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:19.525114 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hc5\" (UniqueName: \"kubernetes.io/projected/065489ea-4e11-4e90-a0fc-28c0c3183c51-kube-api-access-s7hc5\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:20.018389 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.018356 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065489ea-4e11-4e90-a0fc-28c0c3183c51-maas-api-tls\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:20.020660 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.020641 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065489ea-4e11-4e90-a0fc-28c0c3183c51-maas-api-tls\") pod \"maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv\" (UID: \"065489ea-4e11-4e90-a0fc-28c0c3183c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:20.250127 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.250093 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:20.390530 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.390505 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv"] Jul 15 21:42:20.392496 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:42:20.392468 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065489ea_4e11_4e90_a0fc_28c0c3183c51.slice/crio-6a14008f26bb3af0626aee9ccf513d26eb52cb0d3884289841b8bfcf4b7cc857 WatchSource:0}: Error finding container 6a14008f26bb3af0626aee9ccf513d26eb52cb0d3884289841b8bfcf4b7cc857: Status 404 returned error can't find the container with id 6a14008f26bb3af0626aee9ccf513d26eb52cb0d3884289841b8bfcf4b7cc857 Jul 15 21:42:20.393817 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.393800 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:42:20.886095 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.886054 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" event={"ID":"065489ea-4e11-4e90-a0fc-28c0c3183c51","Type":"ContainerStarted","Data":"0ed55f450657400817d29d2f7ef42ed2f0e72f95eb55eb4c9efd90370a2cb469"} Jul 15 21:42:20.886278 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.886105 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" event={"ID":"065489ea-4e11-4e90-a0fc-28c0c3183c51","Type":"ContainerStarted","Data":"6a14008f26bb3af0626aee9ccf513d26eb52cb0d3884289841b8bfcf4b7cc857"} Jul 15 21:42:20.886278 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.886169 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:20.904436 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:20.904388 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" podStartSLOduration=1.4996204579999999 podStartE2EDuration="1.904372445s" totalImagesPullingTime="404.751987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:20.903458541 +0000 UTC m=+1962.384443134" watchObservedRunningTime="2026-07-15 21:42:20.904372445 +0000 UTC m=+1962.385357035" Jul 15 21:42:21.811906 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.811877 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:42:21.892999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.892965 2585 generic.go:356] "Generic (PLEG): container finished" podID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerID="2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f" exitCode=0 Jul 15 21:42:21.893179 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.893015 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" Jul 15 21:42:21.893179 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.893049 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" event={"ID":"1cf36885-b481-462c-80c2-ca4b8c5d939e","Type":"ContainerDied","Data":"2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f"} Jul 15 21:42:21.893179 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.893098 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk" event={"ID":"1cf36885-b481-462c-80c2-ca4b8c5d939e","Type":"ContainerDied","Data":"f58272efbc0aedaea50937c3c4124ee273377d859e1c8fdc355a90e995d50f4b"} Jul 15 21:42:21.893179 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.893123 2585 scope.go:117] "RemoveContainer" containerID="2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f" Jul 15 21:42:21.901477 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.901455 2585 scope.go:117] "RemoveContainer" containerID="ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb" Jul 15 21:42:21.909117 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.909095 2585 scope.go:117] "RemoveContainer" containerID="2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f" Jul 15 21:42:21.909393 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:42:21.909371 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f\": container with ID starting with 2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f not found: ID does not exist" containerID="2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f" Jul 15 21:42:21.909485 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.909404 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f"} err="failed to get container status \"2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f\": rpc error: code = NotFound desc = could not find container \"2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f\": container with ID starting with 2c939ef8971313a4284285370897304f142f8b4ea5667af06e5e3fcf3e192b3f not found: ID does not exist" Jul 15 21:42:21.909485 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.909429 2585 scope.go:117] "RemoveContainer" containerID="ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb" Jul 15 21:42:21.909718 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:42:21.909701 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb\": container with ID starting with ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb not found: ID does not exist" containerID="ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb" Jul 15 21:42:21.909867 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.909724 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb"} err="failed to get container status \"ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb\": rpc error: code = NotFound desc = could not find container \"ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb\": container with ID starting with ea29ae6dd644f7c8f05fcbc965b8439ca5c2187d0513c6a1e90d966a697f72bb not found: ID does not exist" Jul 15 21:42:21.935635 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935596 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-data\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.935827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935642 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-socket\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.935827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935670 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-certs\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.935827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935725 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-podinfo\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.935827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935748 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-envoy\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.935827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935779 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-token\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.936136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.935974 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:21.936136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936017 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-credential-socket\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.936136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936034 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:21.936136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936060 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cf36885-b481-462c-80c2-ca4b8c5d939e-istiod-ca-cert\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.936136 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936108 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn97t\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-kube-api-access-fn97t\") pod \"1cf36885-b481-462c-80c2-ca4b8c5d939e\" (UID: \"1cf36885-b481-462c-80c2-ca4b8c5d939e\") " Jul 15 21:42:21.936705 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936415 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:21.936705 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936437 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:21.936705 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936456 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:21.936705 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936656 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:21.936705 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.936699 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf36885-b481-462c-80c2-ca4b8c5d939e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:42:21.938586 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.938562 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-kube-api-access-fn97t" (OuterVolumeSpecName: "kube-api-access-fn97t") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "kube-api-access-fn97t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:42:21.938586 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.938577 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:42:21.938822 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.938802 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:21.938893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:21.938825 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cf36885-b481-462c-80c2-ca4b8c5d939e" (UID: "1cf36885-b481-462c-80c2-ca4b8c5d939e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:42:22.037782 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037746 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.037782 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037777 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.037782 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037785 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.038044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037794 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.038044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037802 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cf36885-b481-462c-80c2-ca4b8c5d939e-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.038044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037811 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cf36885-b481-462c-80c2-ca4b8c5d939e-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.038044 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.037819 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn97t\" (UniqueName: \"kubernetes.io/projected/1cf36885-b481-462c-80c2-ca4b8c5d939e-kube-api-access-fn97t\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:42:22.216910 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.216874 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk"] Jul 15 21:42:22.220893 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.220857 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d3a40f-openshift-default-7cc98498b5-wdvjk"] Jul 15 21:42:22.974260 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:22.974217 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" path="/var/lib/kubelet/pods/1cf36885-b481-462c-80c2-ca4b8c5d939e/volumes" Jul 15 21:42:25.406719 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.406683 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh"] Jul 15 21:42:25.407126 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.407031 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" Jul 15 21:42:25.407126 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.407043 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" Jul 15 21:42:25.407126 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.407104 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" Jul 15 21:42:25.410060 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.410039 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.412728 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.412706 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-700cbf-openshift-default-dockercfg-fjxtv\"" Jul 15 21:42:25.425520 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.425496 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh"] Jul 15 21:42:25.467639 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467601 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-credential-socket\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.467820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467643 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-envoy\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.467820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467678 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e5a19-9683-455e-8a4c-e1750ff08255-istiod-ca-cert\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.467820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467702 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnjwz\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-kube-api-access-gnjwz\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.467820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-podinfo\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.467820 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467747 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-data\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.468030 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467826 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-certs\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.468030 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-token\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.468030 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.467942 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-socket\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.568653 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-envoy\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.568843 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568660 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e5a19-9683-455e-8a4c-e1750ff08255-istiod-ca-cert\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.568843 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnjwz\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-kube-api-access-gnjwz\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.568843 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568723 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-podinfo\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.568843 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568749 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-data\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.568843 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568819 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-certs\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569129 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568903 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-token\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569129 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.568965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-socket\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569129 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.569008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-credential-socket\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569278 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.569218 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-data\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569373 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.569348 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-certs\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569530 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.569507 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-socket\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569597 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.569522 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e5a19-9683-455e-8a4c-e1750ff08255-istiod-ca-cert\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.569597 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.569577 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-credential-socket\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.571001 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.570977 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-envoy\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.571210 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.571194 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-podinfo\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.577850 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.577823 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-token\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.578001 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.577977 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnjwz\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-kube-api-access-gnjwz\") pod \"e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.719972 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.719841 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:25.859122 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.859089 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh"] Jul 15 21:42:25.862648 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:42:25.862618 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4e5a19_9683_455e_8a4c_e1750ff08255.slice/crio-c70598506e32cbada5dc44d93e319b507ccc136a9271989016f0a3b630dc1e1c WatchSource:0}: Error finding container c70598506e32cbada5dc44d93e319b507ccc136a9271989016f0a3b630dc1e1c: Status 404 returned error can't find the container with id c70598506e32cbada5dc44d93e319b507ccc136a9271989016f0a3b630dc1e1c Jul 15 21:42:25.864869 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.864836 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:25.864953 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.864936 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:25.865019 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.865004 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:25.914683 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:25.914655 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" event={"ID":"5f4e5a19-9683-455e-8a4c-e1750ff08255","Type":"ContainerStarted","Data":"c70598506e32cbada5dc44d93e319b507ccc136a9271989016f0a3b630dc1e1c"} Jul 15 21:42:26.898832 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:26.898803 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv" Jul 15 21:42:26.922246 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:26.922210 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" event={"ID":"5f4e5a19-9683-455e-8a4c-e1750ff08255","Type":"ContainerStarted","Data":"7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f"} Jul 15 21:42:26.943299 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:26.943235 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" podStartSLOduration=1.943212844 podStartE2EDuration="1.943212844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:26.942548886 +0000 UTC m=+1968.423533478" watchObservedRunningTime="2026-07-15 21:42:26.943212844 +0000 UTC m=+1968.424197436" Jul 15 21:42:27.720827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.720787 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:27.726221 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.726194 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:27.927346 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.927315 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:27.928359 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.928341 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:27.981186 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.981105 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv"] Jul 15 21:42:27.981508 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.981490 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" Jul 15 21:42:27.981508 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.981507 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" Jul 15 21:42:27.981680 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.981556 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf36885-b481-462c-80c2-ca4b8c5d939e" containerName="istio-proxy" Jul 15 21:42:27.984001 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.983968 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:27.986473 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.986451 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-700cbf-serving-cert\"" Jul 15 21:42:27.997999 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:27.997972 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv"] Jul 15 21:42:28.088748 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.088702 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecfa68d3-14c5-4003-9361-7233df026a62-maas-api-tls\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.088970 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.088760 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxvpd\" (UniqueName: \"kubernetes.io/projected/ecfa68d3-14c5-4003-9361-7233df026a62-kube-api-access-lxvpd\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.088970 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.088867 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecfa68d3-14c5-4003-9361-7233df026a62-openshift-service-ca\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.190332 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.190294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecfa68d3-14c5-4003-9361-7233df026a62-maas-api-tls\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.190561 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.190357 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxvpd\" (UniqueName: \"kubernetes.io/projected/ecfa68d3-14c5-4003-9361-7233df026a62-kube-api-access-lxvpd\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.190561 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.190412 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecfa68d3-14c5-4003-9361-7233df026a62-openshift-service-ca\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.191124 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.191100 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecfa68d3-14c5-4003-9361-7233df026a62-openshift-service-ca\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.192685 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.192661 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecfa68d3-14c5-4003-9361-7233df026a62-maas-api-tls\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.200851 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.200825 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxvpd\" (UniqueName: \"kubernetes.io/projected/ecfa68d3-14c5-4003-9361-7233df026a62-kube-api-access-lxvpd\") pod \"maas-api-e2e-shared-b-700cbf-654f99459b-77cgv\" (UID: \"ecfa68d3-14c5-4003-9361-7233df026a62\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.296583 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.296493 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:28.438551 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.438518 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv"] Jul 15 21:42:28.440072 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:42:28.440040 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfa68d3_14c5_4003_9361_7233df026a62.slice/crio-1cc7dc42e65e81258936bd478028e9abbf22771fc74fe1875507f7dae9739d0b WatchSource:0}: Error finding container 1cc7dc42e65e81258936bd478028e9abbf22771fc74fe1875507f7dae9739d0b: Status 404 returned error can't find the container with id 1cc7dc42e65e81258936bd478028e9abbf22771fc74fe1875507f7dae9739d0b Jul 15 21:42:28.933330 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:28.933298 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" event={"ID":"ecfa68d3-14c5-4003-9361-7233df026a62","Type":"ContainerStarted","Data":"1cc7dc42e65e81258936bd478028e9abbf22771fc74fe1875507f7dae9739d0b"} Jul 15 21:42:29.940222 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:29.940179 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" event={"ID":"ecfa68d3-14c5-4003-9361-7233df026a62","Type":"ContainerStarted","Data":"1627c91da86e99ace7c6a8ec4f84a5f5350129b0798fff417c9169c3f91e6346"} Jul 15 21:42:29.965745 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:29.965695 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" podStartSLOduration=2.443734559 podStartE2EDuration="2.965678396s" totalImagesPullingTime="521.943837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:29.964183257 +0000 UTC m=+1971.445167849" watchObservedRunningTime="2026-07-15 21:42:29.965678396 +0000 UTC m=+1971.446663007" Jul 15 21:42:30.945527 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:30.945453 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:36.963164 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:36.963119 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-700cbf-654f99459b-77cgv" Jul 15 21:42:43.452192 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:43.452148 2585 patch_prober.go:28] interesting pod/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:57528->10.133.0.43:15021: read: connection reset by peer" start-of-body= Jul 15 21:42:43.452626 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:43.452258 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:57528->10.133.0.43:15021: read: connection reset by peer" Jul 15 21:42:44.007059 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:44.007023 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerID="7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f" exitCode=0 Jul 15 21:42:44.007267 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:44.007065 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" event={"ID":"5f4e5a19-9683-455e-8a4c-e1750ff08255","Type":"ContainerDied","Data":"7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f"} Jul 15 21:42:44.007499 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:44.007475 2585 scope.go:117] "RemoveContainer" containerID="7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f" Jul 15 21:42:44.008544 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:44.008513 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:44.008619 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:44.008582 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:44.008662 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:44.008617 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:45.012895 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:45.012861 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" event={"ID":"5f4e5a19-9683-455e-8a4c-e1750ff08255","Type":"ContainerStarted","Data":"47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0"} Jul 15 21:42:45.720396 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:45.720360 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:45.720574 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:45.720533 2585 patch_prober.go:28] interesting pod/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 21:42:45.720616 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:45.720580 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 21:42:46.721261 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:46.721218 2585 patch_prober.go:28] interesting pod/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 21:42:46.721724 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:46.721285 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 21:42:47.720639 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:47.720603 2585 patch_prober.go:28] interesting pod/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 21:42:47.720819 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:47.720658 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 21:42:48.723983 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:48.723947 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:48.724348 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:48.724223 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:42:48.724977 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:42:48.724960 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:44:39.056373 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:44:39.056348 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:44:39.077447 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:44:39.077424 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:45:00.214595 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.214558 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv"] Jul 15 21:45:00.218002 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.217981 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" Jul 15 21:45:00.220640 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.220612 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jwtcw\"" Jul 15 21:45:00.227439 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.227421 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" Jul 15 21:45:00.245827 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.245802 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv"] Jul 15 21:45:00.364610 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.364577 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv"] Jul 15 21:45:00.368225 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:45:00.368200 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb258fefb_0a32_45af_8a92_67e81119aa94.slice/crio-3162f31a70e4b39b56e64d29da6f0cd6e92551ee7e25efeaec5b17479d32aadf WatchSource:0}: Error finding container 3162f31a70e4b39b56e64d29da6f0cd6e92551ee7e25efeaec5b17479d32aadf: Status 404 returned error can't find the container with id 3162f31a70e4b39b56e64d29da6f0cd6e92551ee7e25efeaec5b17479d32aadf Jul 15 21:45:00.656109 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.656084 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" event={"ID":"b258fefb-0a32-45af-8a92-67e81119aa94","Type":"ContainerStarted","Data":"1df10787121773423d2b942f85209c0e9e8862f33d3bc0ce8f5defbca7089b95"} Jul 15 21:45:00.656217 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.656137 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" event={"ID":"b258fefb-0a32-45af-8a92-67e81119aa94","Type":"ContainerStarted","Data":"3162f31a70e4b39b56e64d29da6f0cd6e92551ee7e25efeaec5b17479d32aadf"} Jul 15 21:45:00.671978 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:00.671902 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" podStartSLOduration=0.671887077 podStartE2EDuration="671.887077ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:00.670367553 +0000 UTC m=+2122.151352144" watchObservedRunningTime="2026-07-15 21:45:00.671887077 +0000 UTC m=+2122.152871710" Jul 15 21:45:01.662126 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:01.662095 2585 generic.go:356] "Generic (PLEG): container finished" podID="b258fefb-0a32-45af-8a92-67e81119aa94" containerID="1df10787121773423d2b942f85209c0e9e8862f33d3bc0ce8f5defbca7089b95" exitCode=0 Jul 15 21:45:01.662480 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:01.662182 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" event={"ID":"b258fefb-0a32-45af-8a92-67e81119aa94","Type":"ContainerDied","Data":"1df10787121773423d2b942f85209c0e9e8862f33d3bc0ce8f5defbca7089b95"} Jul 15 21:45:02.794746 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:02.794722 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" Jul 15 21:45:03.674894 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:03.674868 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" Jul 15 21:45:03.675113 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:03.674870 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv" event={"ID":"b258fefb-0a32-45af-8a92-67e81119aa94","Type":"ContainerDied","Data":"3162f31a70e4b39b56e64d29da6f0cd6e92551ee7e25efeaec5b17479d32aadf"} Jul 15 21:45:03.675113 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:45:03.675001 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3162f31a70e4b39b56e64d29da6f0cd6e92551ee7e25efeaec5b17479d32aadf" Jul 15 21:49:06.321754 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:06.321672 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh"] Jul 15 21:49:06.322283 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:06.321943 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" containerID="cri-o://47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0" gracePeriod=30 Jul 15 21:49:11.581418 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.581395 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:49:11.701710 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701681 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-socket\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.701854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701717 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-token\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.701854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701742 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-credential-socket\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.701854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701759 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-podinfo\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.701854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701810 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-data\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.701854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701824 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-certs\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.701854 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701845 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-envoy\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.702198 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701904 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnjwz\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-kube-api-access-gnjwz\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.702198 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.701955 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e5a19-9683-455e-8a4c-e1750ff08255-istiod-ca-cert\") pod \"5f4e5a19-9683-455e-8a4c-e1750ff08255\" (UID: \"5f4e5a19-9683-455e-8a4c-e1750ff08255\") " Jul 15 21:49:11.702198 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702011 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:11.702198 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702044 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:11.702198 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702162 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:11.702445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702259 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.702445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702279 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-credential-socket\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.702445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702292 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-workload-certs\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.702675 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702637 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4e5a19-9683-455e-8a4c-e1750ff08255-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:49:11.702826 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.702798 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:11.704032 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.703995 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:49:11.704229 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.704209 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-kube-api-access-gnjwz" (OuterVolumeSpecName: "kube-api-access-gnjwz") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "kube-api-access-gnjwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:49:11.704361 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.704333 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:49:11.704445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.704329 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f4e5a19-9683-455e-8a4c-e1750ff08255" (UID: "5f4e5a19-9683-455e-8a4c-e1750ff08255"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:11.803579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.803553 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-data\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.803579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.803577 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-envoy\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.803579 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.803587 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnjwz\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-kube-api-access-gnjwz\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.803781 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.803597 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e5a19-9683-455e-8a4c-e1750ff08255-istiod-ca-cert\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.803781 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.803605 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-token\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.803781 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.803621 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4e5a19-9683-455e-8a4c-e1750ff08255-istio-podinfo\") on node \"ip-10-0-143-128.ec2.internal\" DevicePath \"\"" Jul 15 21:49:11.860733 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.860703 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerID="47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0" exitCode=0 Jul 15 21:49:11.860882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.860757 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" Jul 15 21:49:11.860882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.860787 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" event={"ID":"5f4e5a19-9683-455e-8a4c-e1750ff08255","Type":"ContainerDied","Data":"47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0"} Jul 15 21:49:11.860882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.860838 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh" event={"ID":"5f4e5a19-9683-455e-8a4c-e1750ff08255","Type":"ContainerDied","Data":"c70598506e32cbada5dc44d93e319b507ccc136a9271989016f0a3b630dc1e1c"} Jul 15 21:49:11.860882 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.860859 2585 scope.go:117] "RemoveContainer" containerID="47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0" Jul 15 21:49:11.869800 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.869784 2585 scope.go:117] "RemoveContainer" containerID="7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f" Jul 15 21:49:11.877434 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.877417 2585 scope.go:117] "RemoveContainer" containerID="47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0" Jul 15 21:49:11.877696 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:49:11.877678 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0\": container with ID starting with 47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0 not found: ID does not exist" containerID="47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0" Jul 15 21:49:11.877744 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.877704 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0"} err="failed to get container status \"47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0\": rpc error: code = NotFound desc = could not find container \"47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0\": container with ID starting with 47fc74f18adcfb7120b02d1975defa2ef472c70a41b33b235412919be14e31d0 not found: ID does not exist" Jul 15 21:49:11.877744 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.877721 2585 scope.go:117] "RemoveContainer" containerID="7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f" Jul 15 21:49:11.877969 ip-10-0-143-128 kubenswrapper[2585]: E0715 21:49:11.877948 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f\": container with ID starting with 7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f not found: ID does not exist" containerID="7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f" Jul 15 21:49:11.878034 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.877979 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f"} err="failed to get container status \"7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f\": rpc error: code = NotFound desc = could not find container \"7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f\": container with ID starting with 7e1041d6093421a4fb6f9faa267f63f600d3e299ad533b13db60c50cffd9403f not found: ID does not exist" Jul 15 21:49:11.883316 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.883291 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh"] Jul 15 21:49:11.885944 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:11.885898 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-700cbf-openshift-default-664dd56c5-959sh"] Jul 15 21:49:12.973749 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:12.973720 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" path="/var/lib/kubelet/pods/5f4e5a19-9683-455e-8a4c-e1750ff08255/volumes" Jul 15 21:49:13.547246 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:13.547221 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-9986p_e4549619-4c40-4450-bce1-942d915e6048/copy-manifests/0.log" Jul 15 21:49:13.554171 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:13.554144 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-9986p_e4549619-4c40-4450-bce1-942d915e6048/manager/0.log" Jul 15 21:49:14.186263 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:14.186228 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-d8b57005-6996ff7477-75zdh_bb9c8219-6d31-47b5-8bec-ef57cafec284/maas-api/0.log" Jul 15 21:49:14.678785 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:14.678756 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-4ec9ec-67d85575c8-96ntd_e4e1b770-e557-489f-9289-1d1b8cdcf544/maas-api/0.log" Jul 15 21:49:15.204986 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:15.204957 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-c664d0-7fc78b5458-jxtkv_065489ea-4e11-4e90-a0fc-28c0c3183c51/maas-api/0.log" Jul 15 21:49:15.345336 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:15.345310 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-700cbf-654f99459b-77cgv_ecfa68d3-14c5-4003-9361-7233df026a62/maas-api/0.log" Jul 15 21:49:15.467888 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:15.467824 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735850-qnjc5_76cfbfa3-b4a5-4f21-9c6d-8583f4db7653/cleanup/0.log" Jul 15 21:49:16.791390 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:16.791363 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-700cbf-29735865-t28lv_b258fefb-0a32-45af-8a92-67e81119aa94/cleanup/0.log" Jul 15 21:49:18.992869 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:18.992840 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m2rnj_37110088-7afd-4b05-be13-51be29374d9b/manager/0.log" Jul 15 21:49:19.833741 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:19.833716 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v78t8_a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a/discovery/0.log" Jul 15 21:49:21.137841 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:21.137809 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qrkb8_f386eacb-fdcf-4d2e-b21a-d88a6f9814a1/main/0.log" Jul 15 21:49:21.368055 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:21.368027 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbfv2h_852ef952-7694-4d10-9807-20c9d35b19b9/main/0.log" Jul 15 21:49:30.648246 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:30.648210 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p6dbj_59dcaa4d-edab-4b62-8d52-e77f680454fa/global-pull-secret-syncer/0.log" Jul 15 21:49:30.769205 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:30.769175 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ls562_408ef609-eb1d-4f43-8736-92e7b08d6232/konnectivity-agent/0.log" Jul 15 21:49:30.883393 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:30.883370 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-128.ec2.internal_d6ebf78244e31eb2ee166dc2b9cbb9a6/haproxy/0.log" Jul 15 21:49:36.781160 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:36.781119 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m2rnj_37110088-7afd-4b05-be13-51be29374d9b/manager/0.log" Jul 15 21:49:38.829896 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:38.829863 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7wgmf_0d086095-eb77-42cd-8740-4f3a001ccb39/kube-state-metrics/0.log" Jul 15 21:49:38.851061 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:38.851036 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7wgmf_0d086095-eb77-42cd-8740-4f3a001ccb39/kube-rbac-proxy-main/0.log" Jul 15 21:49:38.876774 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:38.876755 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7wgmf_0d086095-eb77-42cd-8740-4f3a001ccb39/kube-rbac-proxy-self/0.log" Jul 15 21:49:39.082720 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.082649 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:49:39.107445 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.107420 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj4gw_42736aec-8772-4ff4-8842-a5bbda681d0d/ovn-acl-logging/0.log" Jul 15 21:49:39.116209 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.116182 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxp8v_2f4b6a2a-83d7-4ba6-83ed-7acab88330dd/node-exporter/0.log" Jul 15 21:49:39.135767 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.135743 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxp8v_2f4b6a2a-83d7-4ba6-83ed-7acab88330dd/kube-rbac-proxy/0.log" Jul 15 21:49:39.156363 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.156344 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxp8v_2f4b6a2a-83d7-4ba6-83ed-7acab88330dd/init-textfile/0.log" Jul 15 21:49:39.466580 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.466548 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-md5gh_40274878-f0a4-47d7-a27e-f9304422ed22/prometheus-operator-admission-webhook/0.log" Jul 15 21:49:39.494062 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.494034 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-667cd4848f-tcfk2_bbde7504-23d7-42c6-9418-e66973955db2/telemeter-client/0.log" Jul 15 21:49:39.514266 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.514242 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-667cd4848f-tcfk2_bbde7504-23d7-42c6-9418-e66973955db2/reload/0.log" Jul 15 21:49:39.535156 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:39.535134 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-667cd4848f-tcfk2_bbde7504-23d7-42c6-9418-e66973955db2/kube-rbac-proxy/0.log" Jul 15 21:49:40.851823 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.851788 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc"] Jul 15 21:49:40.852213 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852177 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" Jul 15 21:49:40.852213 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852189 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" Jul 15 21:49:40.852213 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852206 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b258fefb-0a32-45af-8a92-67e81119aa94" containerName="cleanup" Jul 15 21:49:40.852213 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852212 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b258fefb-0a32-45af-8a92-67e81119aa94" containerName="cleanup" Jul 15 21:49:40.852338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852267 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b258fefb-0a32-45af-8a92-67e81119aa94" containerName="cleanup" Jul 15 21:49:40.852338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852276 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" Jul 15 21:49:40.852338 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.852283 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4e5a19-9683-455e-8a4c-e1750ff08255" containerName="istio-proxy" Jul 15 21:49:40.856585 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.856563 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:40.858982 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.858963 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8hvsf\"/\"default-dockercfg-vhb5k\"" Jul 15 21:49:40.859098 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.858965 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8hvsf\"/\"openshift-service-ca.crt\"" Jul 15 21:49:40.859559 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.859545 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8hvsf\"/\"kube-root-ca.crt\"" Jul 15 21:49:40.863378 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.863356 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc"] Jul 15 21:49:40.945207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.945174 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvx6z\" (UniqueName: \"kubernetes.io/projected/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-kube-api-access-vvx6z\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:40.945207 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.945210 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-lib-modules\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:40.945409 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.945229 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-proc\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:40.945409 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.945286 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-sys\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:40.945409 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:40.945347 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-podres\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046404 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046373 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-podres\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046426 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvx6z\" (UniqueName: \"kubernetes.io/projected/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-kube-api-access-vvx6z\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046446 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-lib-modules\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046461 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-proc\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046478 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-sys\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046558 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046530 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-podres\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046796 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-sys\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046796 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046598 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-lib-modules\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.046796 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.046601 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-proc\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.054320 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.054292 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvx6z\" (UniqueName: \"kubernetes.io/projected/2e3d4447-77b5-45b9-bf02-127a48ca4d2a-kube-api-access-vvx6z\") pod \"perf-node-gather-daemonset-mjnnc\" (UID: \"2e3d4447-77b5-45b9-bf02-127a48ca4d2a\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.167381 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.167357 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:41.290002 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:41.289976 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc"] Jul 15 21:49:41.292103 ip-10-0-143-128 kubenswrapper[2585]: W0715 21:49:41.292073 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2e3d4447_77b5_45b9_bf02_127a48ca4d2a.slice/crio-8456bcfbc10be8c6f45d6787878002e4ce7e419744ae8f7847284015d23f5f34 WatchSource:0}: Error finding container 8456bcfbc10be8c6f45d6787878002e4ce7e419744ae8f7847284015d23f5f34: Status 404 returned error can't find the container with id 8456bcfbc10be8c6f45d6787878002e4ce7e419744ae8f7847284015d23f5f34 Jul 15 21:49:42.012093 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:42.012061 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" event={"ID":"2e3d4447-77b5-45b9-bf02-127a48ca4d2a","Type":"ContainerStarted","Data":"dfc124e741ccc3a4dd438d7a7239c171add915919b2ebd24d8d0b664b49c5f26"} Jul 15 21:49:42.012467 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:42.012117 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:42.012467 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:42.012141 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" event={"ID":"2e3d4447-77b5-45b9-bf02-127a48ca4d2a","Type":"ContainerStarted","Data":"8456bcfbc10be8c6f45d6787878002e4ce7e419744ae8f7847284015d23f5f34"} Jul 15 21:49:42.026492 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:42.026447 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" podStartSLOduration=2.026427907 podStartE2EDuration="2.026427907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:49:42.025719379 +0000 UTC m=+2403.506703962" watchObservedRunningTime="2026-07-15 21:49:42.026427907 +0000 UTC m=+2403.507412499" Jul 15 21:49:42.098898 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:42.098872 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-6p6fn_63cc2993-22c5-4164-a4bd-71a717184cbc/download-server/0.log" Jul 15 21:49:43.813546 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:43.813519 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s6wjx_4d75077a-4b89-453d-947f-cfb436fce76c/dns/0.log" Jul 15 21:49:43.833908 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:43.833878 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s6wjx_4d75077a-4b89-453d-947f-cfb436fce76c/kube-rbac-proxy/0.log" Jul 15 21:49:43.857146 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:43.857125 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h2cc2_04181f0e-be35-4d39-9bd3-e20917b0dced/dns-node-resolver/0.log" Jul 15 21:49:44.440420 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:44.440391 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bbb6dd94b-9npwb_36fa18b3-8eb4-43e3-b407-cb5f7191534b/registry/0.log" Jul 15 21:49:44.506729 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:44.506703 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qhd58_d2f49fea-779d-4c9a-9aa1-385ae3b5c812/node-ca/0.log" Jul 15 21:49:45.526727 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:45.526690 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v78t8_a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a/discovery/0.log" Jul 15 21:49:46.473058 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:46.473030 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qmdx8_24803bab-119c-4c99-be9d-1625cdf6ae94/serve-healthcheck-canary/0.log" Jul 15 21:49:47.120385 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:47.120345 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znp6n_fdb7f91b-dfa0-4608-9a6a-75a385388b06/kube-rbac-proxy/0.log" Jul 15 21:49:47.141658 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:47.141640 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znp6n_fdb7f91b-dfa0-4608-9a6a-75a385388b06/exporter/0.log" Jul 15 21:49:47.161543 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:47.161512 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znp6n_fdb7f91b-dfa0-4608-9a6a-75a385388b06/extractor/0.log" Jul 15 21:49:48.025622 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:48.025594 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-mjnnc" Jul 15 21:49:50.137376 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:50.137344 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-9986p_e4549619-4c40-4450-bce1-942d915e6048/manager/0.log" Jul 15 21:49:50.165456 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:50.165435 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-9986p_e4549619-4c40-4450-bce1-942d915e6048/copy-manifests/0.log" Jul 15 21:49:51.431478 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:51.431450 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v78t8_a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a/discovery/0.log" Jul 15 21:49:51.565655 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:51.565632 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cd5bf8cdd-zqq69_04a0b41c-cceb-413f-8733-d55f233d264e/manager/0.log" Jul 15 21:49:52.975600 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:52.975569 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v78t8_a27ef4d4-4b6e-4f60-b5fa-6a7fcd89eb3a/discovery/0.log" Jul 15 21:49:57.783188 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.783160 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/kube-multus-additional-cni-plugins/0.log" Jul 15 21:49:57.804194 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.804167 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/egress-router-binary-copy/0.log" Jul 15 21:49:57.822874 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.822857 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/cni-plugins/0.log" Jul 15 21:49:57.842280 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.842260 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/bond-cni-plugin/0.log" Jul 15 21:49:57.862364 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.862344 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/routeoverride-cni/0.log" Jul 15 21:49:57.882818 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.882797 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/whereabouts-cni-bincopy/0.log" Jul 15 21:49:57.902613 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:57.902590 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cblrj_23e73a80-0668-4672-a72e-9952c9bc54c7/whereabouts-cni/0.log" Jul 15 21:49:58.311076 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:58.311057 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zf82r_98c41e79-cec5-40d5-bbca-a17336584fd1/kube-multus/0.log" Jul 15 21:49:58.329841 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:58.329820 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-29vkv_5a692c81-d4d5-4032-ba6f-aa0a44dfad0e/network-metrics-daemon/0.log" Jul 15 21:49:58.348276 ip-10-0-143-128 kubenswrapper[2585]: I0715 21:49:58.348256 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-29vkv_5a692c81-d4d5-4032-ba6f-aa0a44dfad0e/kube-rbac-proxy/0.log"