Jul 06 19:32:47.571456 ip-10-0-128-14 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.030376 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035925 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035939 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035944 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035950 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035953 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035957 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035960 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:32:48.099528 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035963 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035966 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035969 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035971 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035974 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035977 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035980 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035983 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035987 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035992 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035995 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.035998 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036002 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036005 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036009 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036012 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036016 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036019 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036025 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:32:48.100450 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036029 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036032 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036035 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036038 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036041 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036044 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036046 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036049 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036051 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036054 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036057 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036059 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036062 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036065 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036068 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036070 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036073 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036076 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036079 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036082 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:32:48.101038 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036084 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036087 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036090 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036092 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036095 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036098 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036101 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036104 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036107 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036109 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036112 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036115 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036118 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036123 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036125 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036129 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036131 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036134 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036137 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036139 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:32:48.101706 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036142 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036145 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036147 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036152 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036154 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036157 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036160 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036163 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036166 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036168 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036171 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036174 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036176 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036180 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036183 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036186 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036188 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036191 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036193 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036196 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:32:48.102321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036199 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036201 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036204 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036208 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036212 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036215 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036218 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036221 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036237 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036240 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036243 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036246 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.036249 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037094 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037104 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037108 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037113 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037118 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037122 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037126 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:32:48.102933 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037130 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037134 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037160 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037167 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037174 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037180 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037186 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037191 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037196 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037200 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037203 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037208 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037212 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037217 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037221 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037241 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037246 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037250 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037254 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037257 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:32:48.103837 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037261 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037265 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037270 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037273 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037277 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037281 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037285 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037290 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037296 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037300 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037304 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037308 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037312 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037316 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037320 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037324 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037328 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037332 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037336 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:32:48.104843 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037341 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037345 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037349 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037353 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037357 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037361 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037366 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037369 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037374 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037378 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037382 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037386 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037390 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037395 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037399 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037403 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037406 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037412 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037416 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037420 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:32:48.105839 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037424 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037428 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037432 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037437 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037442 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037446 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037450 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037454 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037458 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037462 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037466 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037470 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037474 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037479 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037483 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037488 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037493 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037498 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037504 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037509 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:32:48.106774 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037513 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037517 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037521 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037525 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037529 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037535 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037540 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037545 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037549 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037554 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037558 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037562 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.037565 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038119 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038127 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038131 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038135 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038140 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038145 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:32:48.107627 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038149 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038153 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038158 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038162 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038166 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038171 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038176 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038180 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038185 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038189 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038193 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038197 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038202 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038209 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038214 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038219 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038241 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038246 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038253 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:32:48.108281 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038258 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038263 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038269 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038274 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038280 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038285 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038291 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038295 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038300 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038304 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038308 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038312 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038316 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038321 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038325 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038330 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038333 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038337 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038342 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:32:48.109197 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038346 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:32:48.109339 ip-10-0-128-14 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038351 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038355 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038359 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038363 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038367 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038371 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038375 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038379 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038383 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038387 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038391 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038396 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038399 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038403 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038407 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038411 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038417 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038421 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038425 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:32:48.110264 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038428 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038433 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038438 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038442 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038446 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038450 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038454 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038458 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038463 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038466 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038470 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038475 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038479 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038482 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038487 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038491 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038496 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038500 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038504 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038508 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:32:48.111871 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038513 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038517 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038520 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038524 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038529 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038532 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038536 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038541 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038545 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038549 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038557 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038561 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038566 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038569 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.038574 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038672 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038691 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038702 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038708 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038715 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038719 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:32:48.113143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038726 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038733 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038737 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038742 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038747 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038752 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038758 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038763 2585 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038768 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038772 2585 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038777 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038781 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038788 2585 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038792 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038797 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038803 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038808 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038814 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038819 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038824 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038830 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038837 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038842 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038847 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:32:48.114945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038852 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038857 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038864 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038869 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038874 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038878 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038883 2585 flags.go:64] FLAG: --enable-server="true" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038888 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038895 2585 flags.go:64] FLAG: --event-burst="100" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038899 2585 flags.go:64] FLAG: --event-qps="50" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038904 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038909 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038916 2585 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038922 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038927 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038933 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038937 2585 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038942 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038947 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038952 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038956 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038961 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038965 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038970 2585 flags.go:64] FLAG: --feature-gates="" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038975 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:32:48.115875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038980 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038985 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038990 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.038995 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039002 2585 flags.go:64] FLAG: --help="false" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039007 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039012 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039017 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039021 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039026 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039032 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039037 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039041 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039046 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039050 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039055 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039060 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039065 2585 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039070 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039076 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039081 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039085 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039089 2585 flags.go:64] FLAG: --lock-file="" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039095 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:32:48.116942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039099 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039104 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039113 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039118 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039122 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039127 2585 flags.go:64] FLAG: --logging-format="text" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039131 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039137 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039142 2585 flags.go:64] FLAG: --manifest-url="" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039146 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039153 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039158 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039167 2585 flags.go:64] FLAG: --max-pods="110" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039172 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039177 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039181 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039186 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039191 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039195 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039200 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039210 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039215 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039220 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:32:48.117893 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039241 2585 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039245 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039255 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039259 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039265 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039271 2585 flags.go:64] FLAG: --port="10250" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039275 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039280 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7c1e765a35a3307" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039285 2585 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039292 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039297 2585 flags.go:64] FLAG: --register-node="true" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039302 2585 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039307 2585 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039312 2585 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039317 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039321 2585 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039327 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039331 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039336 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039341 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039345 2585 flags.go:64] FLAG: --runonce="false" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039352 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039357 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039362 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039366 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:32:48.118649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039371 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039376 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039380 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039385 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039389 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039394 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039399 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039403 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039408 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039412 2585 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039417 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039425 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039432 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039436 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039443 2585 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039448 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039452 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039458 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039463 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039467 2585 flags.go:64] FLAG: --v="2" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039473 2585 flags.go:64] FLAG: --version="false" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039480 2585 flags.go:64] FLAG: --vmodule="" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039485 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.039491 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039668 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:32:48.119471 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039674 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039679 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039684 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039691 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039696 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039701 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039705 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039709 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039714 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039719 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039723 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039727 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039731 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039736 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039740 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039744 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039748 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039752 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039756 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039763 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:32:48.120209 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039767 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039772 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039776 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039779 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039783 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039788 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039792 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039796 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039800 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039806 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039812 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039817 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039821 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039825 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039830 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039835 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039840 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039844 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039848 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039852 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:32:48.120896 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039856 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039860 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039864 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039868 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039872 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039876 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039880 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039884 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039888 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039892 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039896 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039902 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039906 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039910 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039914 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039918 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039922 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039925 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039931 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039935 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:32:48.121609 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039939 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039943 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039947 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039951 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039955 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039959 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039963 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039970 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039974 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039979 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039983 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039987 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039991 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.039997 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040002 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040007 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040011 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040014 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040018 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:32:48.122216 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040023 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040027 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040031 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040035 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040040 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040045 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040049 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040052 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040056 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040060 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040064 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040068 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040074 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040078 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040082 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040086 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040090 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040096 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:32:48.253604 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.040101 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.040977 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.048527 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.048543 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.048557 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.048563 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048631 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048637 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048640 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048644 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048648 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048651 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048654 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048658 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048661 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:32:48.256560 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048664 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048667 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048670 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048672 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048676 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048679 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048681 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048685 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048687 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048690 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048694 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048697 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048699 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048702 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048705 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048708 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048711 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048714 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048716 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048719 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:32:48.258106 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048723 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048725 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048728 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048733 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048737 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048741 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048744 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048748 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048751 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048754 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048757 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048760 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048763 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048765 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048768 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048771 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048774 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048777 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048781 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:32:48.273659 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048784 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048788 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048791 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048794 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048798 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048803 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048805 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048808 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048812 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048814 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048817 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048820 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048823 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048826 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048832 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048835 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048838 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048841 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048845 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:32:48.274412 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048849 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048852 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048855 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048857 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048860 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048863 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048866 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048869 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048871 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048876 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048879 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048881 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048884 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048887 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048890 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048892 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048895 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048898 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048902 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048905 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:32:48.275073 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048908 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048911 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048914 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048916 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048919 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048922 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048925 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048927 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048931 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048933 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048936 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.048939 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.048944 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049092 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049098 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:32:48.276049 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049101 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049104 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049107 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049110 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049113 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049116 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049120 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049124 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049127 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049130 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049133 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049136 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049138 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049141 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049144 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049146 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049151 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049154 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049156 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:32:48.276671 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049159 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049162 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049165 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049168 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049171 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049173 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049176 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049179 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049182 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049185 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049188 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049190 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049193 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049196 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049199 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049201 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049204 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049207 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049209 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049214 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049216 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:32:48.277337 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049219 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049234 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049238 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049240 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049243 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049248 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049252 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049255 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049260 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049263 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049266 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049269 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049272 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049275 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049278 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049281 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049283 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049286 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049289 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:32:48.277987 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049293 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049296 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049298 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049301 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049304 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049307 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049310 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049312 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049315 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049318 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049320 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049325 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049327 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049330 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049334 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049337 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049341 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049344 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049348 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:32:48.284167 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049352 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049355 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049362 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049367 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049371 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049375 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049379 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049383 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049388 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049391 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049394 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049397 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049400 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049403 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049406 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049409 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049412 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049415 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:32:48.285042 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:48.049417 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.049423 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.049544 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.052034 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.053295 2585 server.go:1019] "Starting client certificate rotation" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.053404 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.053452 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.055670 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.066045 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.073837 2585 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.076905 2585 log.go:25] "Validated CRI v1 image API" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.080426 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:32:48.286340 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.082900 2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 99137ce2-94c9-43a7-8f68-493b20616148:/dev/nvme0n1p4 e617c408-32f0-446b-a042-f64e241fb975:/dev/nvme0n1p3] Jul 06 19:32:48.286814 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.082927 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.087345 2585 manager.go:216] Machine: {Timestamp:2026-07-06 19:32:48.08681492 +0000 UTC m=+0.386224361 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099573 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f5ccc2fecc2db31c28b55195724bc SystemUUID:ec2f5ccc-2fec-c2db-31c2-8b55195724bc BootID:5ac9ce62-4b6d-4a38-aeab-93464005c73f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:63:7e:fc:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:63:7e:fc:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:20:b1:41:a0:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.087451 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.087543 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.090051 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.090079 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-14.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.090872 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.090889 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:32:48.287021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.090900 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.091541 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.092931 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.094402 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.096854 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.096973 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097002 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097012 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097027 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097037 2585 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097047 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097395 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.097417 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.100634 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.102634 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.102665 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103770 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103784 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103791 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103797 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103806 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103812 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103820 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103826 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103833 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103839 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103847 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103853 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103879 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.103884 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.108217 2585 server.go:1268] "Started kubelet" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.108239 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.108321 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.108812 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.110429 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.113124 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.113455 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.113624 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.113926 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:32:48.287377 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.117626 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.121009 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435b76d7d7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.108140503 +0000 UTC m=+0.407549946,LastTimestamp:2026-07-06 19:32:48.108140503 +0000 UTC m=+0.407549946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.123298 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k8bpt" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.123645 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.123663 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.123725 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.124410 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.124416 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.124438 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.124541 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.124551 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125276 2585 factory.go:55] Registering systemd factory Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125298 2585 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125542 2585 factory.go:153] Registering CRI-O factory Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125555 2585 factory.go:223] Registration of the crio container factory successfully Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125627 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125655 2585 factory.go:103] Registering Raw factory Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.125672 2585 manager.go:1196] Started watching for new ooms in manager Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.125903 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.125933 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.126339 2585 manager.go:349] Starting recovery of all containers Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.149290 2585 manager.go:354] Recovery completed Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.154792 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157012 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157046 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157058 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157801 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157814 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157814 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.157890 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.158545 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.158574 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.158584 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.288739 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.159220 2585 policy_none.go:49] "None policy: Start" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.159268 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.159289 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.160280 2585 policy_none.go:47] "Start" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.170916 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.187754 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.199115 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.208513 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.158560351 +0000 UTC m=+0.457969790,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.212817 2585 manager.go:337] "Starting Device Plugin manager" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.212851 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.212861 2585 server.go:87] "Starting device plugin registration server" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.213143 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.213155 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.213229 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:32:48.441035 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.213336 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.213345 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.213836 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.213893 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.221168 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.158579002 +0000 UTC m=+0.457988442,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.232461 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e615572\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.158588846 +0000 UTC m=+0.457998285,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.245028 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca4361da07cd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.215304141 +0000 UTC m=+0.514713570,LastTimestamp:2026-07-06 19:32:48.215304141 +0000 UTC m=+0.514713570,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.314285 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.315467 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.315501 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.315511 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.443474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.315541 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.325051 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.315484345 +0000 UTC m=+0.614893787,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.329748 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.331014 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.331051 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.331075 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.331114 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.334974 2585 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.335119 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.335071 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.315505836 +0000 UTC m=+0.614915280,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.335255 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.338939 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e615572\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.315516134 +0000 UTC m=+0.614925574,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.431811 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal"] Jul 06 19:32:48.443942 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.431906 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.435824 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.435854 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.435866 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.437309 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.437489 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.437518 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.438265 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.438285 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.438295 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.438559 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.438579 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.438588 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.439963 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.439996 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.441863 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.441881 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.446032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.441890 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.448520 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.447985 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.435840526 +0000 UTC m=+0.735249971,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.580423 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.459268 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.435859895 +0000 UTC m=+0.735269336,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.580423 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.468249 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e615572\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.435870508 +0000 UTC m=+0.735279948,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.580423 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.479950 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.438276644 +0000 UTC m=+0.737686084,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.580423 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.481357 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-14.ec2.internal\" not found" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.580423 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.486362 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-14.ec2.internal\" not found" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.580423 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.495829 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.438289985 +0000 UTC m=+0.737699424,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.506538 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e615572\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.438299239 +0000 UTC m=+0.737708679,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.519192 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.438571082 +0000 UTC m=+0.737980521,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.529631 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.438583265 +0000 UTC m=+0.737992705,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.534557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a353b4e16a284a7954e86f68b4b656d8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-14.ec2.internal\" (UID: \"a353b4e16a284a7954e86f68b4b656d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.534581 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/551a2656eb9acdf6b8852513bf829170-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" (UID: \"551a2656eb9acdf6b8852513bf829170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.534600 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/551a2656eb9acdf6b8852513bf829170-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" (UID: \"551a2656eb9acdf6b8852513bf829170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.535610 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.536894 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.536926 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.536937 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.582767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.536967 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.583238 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.539100 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e615572\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.438591797 +0000 UTC m=+0.738001237,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.583238 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.548737 2585 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.583238 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.548804 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.44187255 +0000 UTC m=+0.741281989,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.583238 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.552683 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.441885429 +0000 UTC m=+0.741294868,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.583238 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.559242 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e615572\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e615572 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157062514 +0000 UTC m=+0.456471954,LastTimestamp:2026-07-06 19:32:48.441894366 +0000 UTC m=+0.741303806,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.583726 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.564238 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e60d1a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e60d1a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.15702877 +0000 UTC m=+0.456438219,LastTimestamp:2026-07-06 19:32:48.5369098 +0000 UTC m=+0.836319239,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.583726 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.573738 2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-14.ec2.internal.18bfca435e612dd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-14.ec2.internal.18bfca435e612dd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-14.ec2.internal,UID:ip-10-0-128-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:48.157052372 +0000 UTC m=+0.456461811,LastTimestamp:2026-07-06 19:32:48.536931824 +0000 UTC m=+0.836341263,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:48.728176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.635699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/551a2656eb9acdf6b8852513bf829170-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" (UID: \"551a2656eb9acdf6b8852513bf829170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.728176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.635753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a353b4e16a284a7954e86f68b4b656d8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-14.ec2.internal\" (UID: \"a353b4e16a284a7954e86f68b4b656d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.728176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.635772 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/551a2656eb9acdf6b8852513bf829170-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" (UID: \"551a2656eb9acdf6b8852513bf829170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.728176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.635819 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/551a2656eb9acdf6b8852513bf829170-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" (UID: \"551a2656eb9acdf6b8852513bf829170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.728176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.635829 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a353b4e16a284a7954e86f68b4b656d8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-14.ec2.internal\" (UID: \"a353b4e16a284a7954e86f68b4b656d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.728176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.635830 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/551a2656eb9acdf6b8852513bf829170-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" (UID: \"551a2656eb9acdf6b8852513bf829170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.828821 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.756368 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Jul 06 19:32:48.828821 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.784621 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.828821 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.790307 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.975806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.949168 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:48.975806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.950887 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:48.975806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.950924 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:48.975806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.950937 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:48.975806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:48.950972 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:48.975806 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:48.972060 2585 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:49.124106 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.124069 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:32:49.229918 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.229827 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:49.231149 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.231130 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:49.231246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.231170 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:49.231246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.231182 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:49.279533 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.279498 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:32:49.472055 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:49.472022 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda353b4e16a284a7954e86f68b4b656d8.slice/crio-90972bfd71c3eef17552ebb6733ee55551cf21f642e6fefe1a70e94de72f0d68 WatchSource:0}: Error finding container 90972bfd71c3eef17552ebb6733ee55551cf21f642e6fefe1a70e94de72f0d68: Status 404 returned error can't find the container with id 90972bfd71c3eef17552ebb6733ee55551cf21f642e6fefe1a70e94de72f0d68 Jul 06 19:32:49.478592 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.478573 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:32:49.479746 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:49.479723 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551a2656eb9acdf6b8852513bf829170.slice/crio-d475b88cbdf424cae1f9229decb014ed5fea43be43584c0e0fb2e28cea33145f WatchSource:0}: Error finding container d475b88cbdf424cae1f9229decb014ed5fea43be43584c0e0fb2e28cea33145f: Status 404 returned error can't find the container with id d475b88cbdf424cae1f9229decb014ed5fea43be43584c0e0fb2e28cea33145f Jul 06 19:32:49.491083 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.491001 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-128-14.ec2.internal.18bfca43ad297ba3 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-128-14.ec2.internal,UID:a353b4e16a284a7954e86f68b4b656d8,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1\",Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:49.478802339 +0000 UTC m=+1.778211764,LastTimestamp:2026-07-06 19:32:49.478802339 +0000 UTC m=+1.778211764,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:49.500368 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.500281 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal.18bfca43ad5875f7 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal,UID:551a2656eb9acdf6b8852513bf829170,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52d26498fbce9f8ab56799e6e6f1920bc238d2d31f38945eab91ebc5f68b43dc\",Source:EventSource{Component:kubelet,Host:ip-10-0-128-14.ec2.internal,},FirstTimestamp:2026-07-06 19:32:49.481881079 +0000 UTC m=+1.781290505,LastTimestamp:2026-07-06 19:32:49.481881079 +0000 UTC m=+1.781290505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-14.ec2.internal,}" Jul 06 19:32:49.566490 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.566459 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" Jul 06 19:32:49.566638 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.566555 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:32:49.721771 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.721730 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:32:49.759587 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.759523 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k8bpt" Jul 06 19:32:49.772936 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.772902 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:49.774302 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.774285 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:49.774390 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.774318 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:49.774390 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.774330 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:49.774390 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.774365 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:49.799407 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.799376 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:49.799407 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:49.799407 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-14.ec2.internal\": node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:49.882244 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:49.882205 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:32:50.052873 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:50.052783 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:32:50.053070 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:50.053013 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:32:50.053070 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:50.053031 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{}\" for node \"ip-10-0-128-14.ec2.internal\": Patch \"https://ab139b657877349a193f8796059efe4d-1130fc319a0c744d.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-128-14.ec2.internal/status?timeout=10s\": read tcp 10.0.128.14:33542->100.60.158.192:6443: use of closed network connection" Jul 06 19:32:50.344210 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:50.344012 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" event={"ID":"551a2656eb9acdf6b8852513bf829170","Type":"ContainerStarted","Data":"d475b88cbdf424cae1f9229decb014ed5fea43be43584c0e0fb2e28cea33145f"} Jul 06 19:32:50.345345 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:50.345308 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" event={"ID":"a353b4e16a284a7954e86f68b4b656d8","Type":"ContainerStarted","Data":"90972bfd71c3eef17552ebb6733ee55551cf21f642e6fefe1a70e94de72f0d68"} Jul 06 19:32:50.746418 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:50.746328 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:50.763560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:50.763495 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:27:50 +0000 UTC" deadline="2028-01-28 19:36:21.792795832 +0000 UTC" Jul 06 19:32:50.763709 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:50.763549 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13704h3m31.029252509s" Jul 06 19:32:50.847104 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:50.847066 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:50.947948 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:50.947900 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.048769 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.048679 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.086210 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:51.086176 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:32:51.149250 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.149211 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.249602 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.249558 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.350541 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.350458 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.451331 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.451293 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.552036 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.551996 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.561868 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:51.561850 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:51.563021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:51.563001 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:51.563142 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:51.563044 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:51.563142 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:51.563062 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:51.652613 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.652582 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.753408 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.753356 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.853881 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.853855 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:51.955790 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:51.955757 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:52.057945 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.057903 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:52.159812 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.159766 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:52.262564 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.262501 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:52.351770 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.351732 2585 generic.go:356] "Generic (PLEG): container finished" podID="551a2656eb9acdf6b8852513bf829170" containerID="cd90d071c4ae821456a3dd20c715e8c8df055a48502d7995f06460fee7ceff00" exitCode=0 Jul 06 19:32:52.352923 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.351799 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:52.352923 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.351832 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" event={"ID":"551a2656eb9acdf6b8852513bf829170","Type":"ContainerDied","Data":"cd90d071c4ae821456a3dd20c715e8c8df055a48502d7995f06460fee7ceff00"} Jul 06 19:32:52.353471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.353453 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:52.353559 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.353484 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:52.353559 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.353499 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:52.353559 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.353535 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" event={"ID":"a353b4e16a284a7954e86f68b4b656d8","Type":"ContainerStarted","Data":"25d015d9d08b78b7df1b141ff5fd480cb4b8f574fe6c2d4787679db9ca123b3b"} Jul 06 19:32:52.354069 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.354053 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:32:52.354170 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.354038 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-14.ec2.internal\" not found" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:52.356409 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.356390 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:32:52.356471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.356427 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:32:52.356471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.356442 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:32:52.356613 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.356598 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-14.ec2.internal\" not found" node="ip-10-0-128-14.ec2.internal" Jul 06 19:32:52.363207 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.363191 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:52.463721 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:52.463536 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-14.ec2.internal\" not found" Jul 06 19:32:52.494461 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.494441 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:32:52.524176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.524088 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:52.535491 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.535473 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:32:52.537058 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.537044 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:52.547763 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.547739 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:32:52.702860 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.702829 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:32:52.764368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:52.764335 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:32:53.099919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.099893 2585 apiserver.go:52] "Watching apiserver" Jul 06 19:32:53.103121 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.103105 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:32:53.103289 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.103272 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal"] Jul 06 19:32:53.125238 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.125222 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:32:53.125291 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.125226 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:32:53.138808 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.138782 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:32:53.166832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.166804 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnrhc" Jul 06 19:32:53.174257 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.174233 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnrhc" Jul 06 19:32:53.181867 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.181849 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv"] Jul 06 19:32:53.184236 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.184215 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.184654 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.184630 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-tdgnv"] Jul 06 19:32:53.186800 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.186779 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:32:53.187063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.187048 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-dsh2x"] Jul 06 19:32:53.187205 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.187190 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.187813 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.187798 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.189208 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.189189 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.189507 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.189488 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ww8w7\"" Jul 06 19:32:53.189750 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.189735 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-qv9w9"] Jul 06 19:32:53.189884 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.189869 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.190251 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.190199 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.190605 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.190585 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bddq6\"" Jul 06 19:32:53.190605 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.190626 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.192353 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.192335 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8cqbj"] Jul 06 19:32:53.192474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.192459 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.193260 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.193243 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tgjz7\"" Jul 06 19:32:53.193435 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.193423 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:32:53.193912 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.193899 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.194024 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.194008 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.194095 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.194052 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:32:53.194738 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.194721 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-v44gz"] Jul 06 19:32:53.194918 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.194899 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.197847 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.197104 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.197847 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.197448 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.197847 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.197766 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:32:53.198696 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.198490 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pc8r2\"" Jul 06 19:32:53.198696 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.198561 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:32:53.198913 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.198899 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.199975 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.199863 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:32:53.199975 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.199914 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wqlbq"] Jul 06 19:32:53.200276 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.200164 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.200276 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.200252 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.200575 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.200466 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8vwb\"" Jul 06 19:32:53.202440 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.202422 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xpfb4"] Jul 06 19:32:53.202566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.202550 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.202696 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.202636 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:32:53.202696 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.202665 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.203283 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.203266 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:32:53.203365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.203320 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:32:53.203529 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.203517 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:32:53.203609 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.203595 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.203688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.203600 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4pfkh\"" Jul 06 19:32:53.205103 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.205083 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-94qxf"] Jul 06 19:32:53.205230 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.205211 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.205353 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.205331 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:32:53.207598 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.207581 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-m46nr"] Jul 06 19:32:53.207730 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.207714 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.210078 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.210060 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:53.210181 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.210088 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fc4bl\"" Jul 06 19:32:53.210181 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.210115 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:32:53.210306 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.210292 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:32:53.210359 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.210296 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:32:53.210654 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.210640 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:32:53.232373 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.232354 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-j5fvf"] Jul 06 19:32:53.235143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.235127 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.237726 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.237708 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:32:53.237823 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.237708 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:32:53.237823 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.237713 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2mhlq\"" Jul 06 19:32:53.256570 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.256513 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" podStartSLOduration=1.256498246 podStartE2EDuration="1.256498246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:53.238591751 +0000 UTC m=+5.538001202" watchObservedRunningTime="2026-07-06 19:32:53.256498246 +0000 UTC m=+5.555907688" Jul 06 19:32:53.272427 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272404 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.272526 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272430 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.272526 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272450 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/163686c1-2cc6-4ec9-8222-b6f3f96772d5-dbus\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.272526 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272467 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhrh4\" (UniqueName: \"kubernetes.io/projected/c5d35c53-6802-44c2-a392-729f32a70f9c-kube-api-access-dhrh4\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.272526 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272485 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-kubelet\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.272526 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272518 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-kubernetes\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272567 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/265b29b9-6ad8-47cd-828a-4b4936be39ba-hosts-file\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272593 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-ovn\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272630 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mjs7\" (UniqueName: \"kubernetes.io/projected/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-kube-api-access-4mjs7\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272669 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysctl-d\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272697 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-host\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-log-socket\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.272774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272757 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-env-overrides\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272785 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-lib-modules\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272813 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4176befe-94a8-428d-813e-87ce7c7974e1-tmp\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272835 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5d35c53-6802-44c2-a392-729f32a70f9c-iptables-alerter-script\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272853 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-cni-netd\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272882 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysconfig\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272910 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272945 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-device-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272973 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkxjq\" (UniqueName: \"kubernetes.io/projected/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-kube-api-access-gkxjq\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.272998 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-socket-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273022 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273048 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-sys-fs\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.273074 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273073 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d35c53-6802-44c2-a392-729f32a70f9c-host-slash\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273099 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovn-node-metrics-cert\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273162 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e88f1-b561-46a0-853a-f36e75fbd3de-host\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273241 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f35e88f1-b561-46a0-853a-f36e75fbd3de-serviceca\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273257 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8drq\" (UniqueName: \"kubernetes.io/projected/f35e88f1-b561-46a0-853a-f36e75fbd3de-kube-api-access-v8drq\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273288 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-cni-binary-copy\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273306 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/163686c1-2cc6-4ec9-8222-b6f3f96772d5-kubelet-config\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273323 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lwzj\" (UniqueName: \"kubernetes.io/projected/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-kube-api-access-4lwzj\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273347 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-os-release\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273373 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-systemd\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.273568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273392 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273406 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-sys\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273422 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4176befe-94a8-428d-813e-87ce7c7974e1-etc-tuned\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273438 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktnks\" (UniqueName: \"kubernetes.io/projected/4176befe-94a8-428d-813e-87ce7c7974e1-kube-api-access-ktnks\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273453 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-registration-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hms\" (UniqueName: \"kubernetes.io/projected/265b29b9-6ad8-47cd-828a-4b4936be39ba-kube-api-access-p4hms\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273514 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-slash\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273533 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-run-netns\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273550 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-cni-bin\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273564 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-node-log\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273579 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-modprobe-d\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-cnibin\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273617 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/265b29b9-6ad8-47cd-828a-4b4936be39ba-tmp-dir\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.274110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273634 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273651 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5kmg\" (UniqueName: \"kubernetes.io/projected/ecee77dd-1d33-4349-b7b9-5339c3681908-kube-api-access-b5kmg\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273668 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273690 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-var-lib-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovnkube-config\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-var-lib-kubelet\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273784 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-system-cni-dir\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273808 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-systemd-units\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273834 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-etc-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273859 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-systemd\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273887 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysctl-conf\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273909 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-run\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273933 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.274555 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.273973 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovnkube-script-lib\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.323480 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.323435 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-wh2hj"] Jul 06 19:32:53.326206 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.326184 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.328839 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.328818 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:32:53.329462 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.329441 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rk54j\"" Jul 06 19:32:53.356184 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.356117 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:32:53.356570 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.356551 2585 generic.go:356] "Generic (PLEG): container finished" podID="551a2656eb9acdf6b8852513bf829170" containerID="fd64cc548698ad9b89b1e00a527ad5ff2c2bbc4f1505c6a910cc8733d4ea2ca8" exitCode=1 Jul 06 19:32:53.356661 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.356642 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" event={"ID":"551a2656eb9acdf6b8852513bf829170","Type":"ContainerDied","Data":"fd64cc548698ad9b89b1e00a527ad5ff2c2bbc4f1505c6a910cc8733d4ea2ca8"} Jul 06 19:32:53.356810 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.356799 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:53.356929 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.356918 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:53.374651 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374626 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d35c53-6802-44c2-a392-729f32a70f9c-host-slash\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.374714 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374657 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovn-node-metrics-cert\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.374714 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374690 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-cni-multus\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374718 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374744 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5d35c53-6802-44c2-a392-729f32a70f9c-host-slash\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374745 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374792 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374824 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e88f1-b561-46a0-853a-f36e75fbd3de-host\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374827 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374791 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e88f1-b561-46a0-853a-f36e75fbd3de-host\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.374839 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f35e88f1-b561-46a0-853a-f36e75fbd3de-serviceca\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.374890 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.374888 2585 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-14.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-14.ec2.internal" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374902 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8drq\" (UniqueName: \"kubernetes.io/projected/f35e88f1-b561-46a0-853a-f36e75fbd3de-kube-api-access-v8drq\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.374914 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.374960 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:53.874937356 +0000 UTC m=+6.174346798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374975 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.374999 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:53.874980643 +0000 UTC m=+6.174390080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.374935 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.374835 2585 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375045 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-cni-binary-copy\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375099 2585 scope.go:117] "RemoveContainer" containerID="fd64cc548698ad9b89b1e00a527ad5ff2c2bbc4f1505c6a910cc8733d4ea2ca8" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375246 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/163686c1-2cc6-4ec9-8222-b6f3f96772d5-kubelet-config\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375284 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lwzj\" (UniqueName: \"kubernetes.io/projected/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-kube-api-access-4lwzj\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375313 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-os-release\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375341 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-conf-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.375408 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375373 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-systemd\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375382 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/163686c1-2cc6-4ec9-8222-b6f3f96772d5-kubelet-config\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375399 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375424 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-sys\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4176befe-94a8-428d-813e-87ce7c7974e1-etc-tuned\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375459 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-os-release\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375476 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f35e88f1-b561-46a0-853a-f36e75fbd3de-serviceca\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375485 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnks\" (UniqueName: \"kubernetes.io/projected/4176befe-94a8-428d-813e-87ce7c7974e1-kube-api-access-ktnks\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-system-cni-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375576 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375586 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-k8s-cni-cncf-io\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375616 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-registration-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375633 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-systemd\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hms\" (UniqueName: \"kubernetes.io/projected/265b29b9-6ad8-47cd-828a-4b4936be39ba-kube-api-access-p4hms\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.376117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375675 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-cni-binary-copy\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375669 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-slash\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375707 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375722 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-sys\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375729 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-run-netns\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-cni-bin\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375812 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-registration-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375852 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-run-netns\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375876 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-slash\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375889 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-multus-certs\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375916 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-cni-bin\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375946 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz4mw\" (UniqueName: \"kubernetes.io/projected/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-kube-api-access-nz4mw\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.375967 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-node-log\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376001 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-node-log\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376017 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-modprobe-d\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.377474 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376076 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-cnibin\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376127 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-modprobe-d\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376206 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-cnibin\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/265b29b9-6ad8-47cd-828a-4b4936be39ba-tmp-dir\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376261 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376336 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5kmg\" (UniqueName: \"kubernetes.io/projected/ecee77dd-1d33-4349-b7b9-5339c3681908-kube-api-access-b5kmg\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376377 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-socket-dir-parent\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376610 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-var-lib-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovnkube-config\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376736 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-var-lib-kubelet\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376734 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-var-lib-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-system-cni-dir\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.378249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376798 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-system-cni-dir\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376797 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab60d8f1-46f6-403e-9e7f-15a4c8c04c79-agent-certs\") pod \"konnectivity-agent-j5fvf\" (UID: \"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79\") " pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376843 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-os-release\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-systemd-units\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376919 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-systemd-units\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376919 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-var-lib-kubelet\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-etc-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376972 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-systemd\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.376993 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-etc-openvswitch\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysctl-conf\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-run\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377053 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377057 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-systemd\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377087 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovnkube-script-lib\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.378895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377108 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377114 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377131 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/265b29b9-6ad8-47cd-828a-4b4936be39ba-tmp-dir\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377141 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377222 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysctl-conf\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377255 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-etc-kubernetes\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377280 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/163686c1-2cc6-4ec9-8222-b6f3f96772d5-dbus\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377311 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhrh4\" (UniqueName: \"kubernetes.io/projected/c5d35c53-6802-44c2-a392-729f32a70f9c-kube-api-access-dhrh4\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377329 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovnkube-config\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377340 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-kubelet\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377393 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-kubernetes\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377430 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-kubelet\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377454 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/163686c1-2cc6-4ec9-8222-b6f3f96772d5-dbus\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377313 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecee77dd-1d33-4349-b7b9-5339c3681908-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.379625 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377458 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-hostroot\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377523 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-kubelet\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377577 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-kubernetes\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377581 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/265b29b9-6ad8-47cd-828a-4b4936be39ba-hosts-file\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377617 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-ovn\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377634 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/265b29b9-6ad8-47cd-828a-4b4936be39ba-hosts-file\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377653 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mjs7\" (UniqueName: \"kubernetes.io/projected/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-kube-api-access-4mjs7\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377682 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-run-ovn\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377724 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysctl-d\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377757 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377754 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-host\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-log-socket\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377813 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-host\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-env-overrides\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377894 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-lib-modules\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377894 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysctl-d\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4176befe-94a8-428d-813e-87ce7c7974e1-tmp\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377962 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-cni-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377984 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-lib-modules\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.377991 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5d35c53-6802-44c2-a392-729f32a70f9c-iptables-alerter-script\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378014 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovnkube-script-lib\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378034 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-log-socket\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-cni-netd\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysconfig\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-cni-binary-copy\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-netns\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378187 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-daemon-config\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378216 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378267 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab60d8f1-46f6-403e-9e7f-15a4c8c04c79-konnectivity-ca\") pod \"konnectivity-agent-j5fvf\" (UID: \"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79\") " pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.380914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378298 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-device-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378158 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-run\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378451 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-host-cni-netd\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378498 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkxjq\" (UniqueName: \"kubernetes.io/projected/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-kube-api-access-gkxjq\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-cnibin\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-cni-bin\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378588 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-socket-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378647 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-sys-fs\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378663 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5d35c53-6802-44c2-a392-729f32a70f9c-iptables-alerter-script\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378693 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4176befe-94a8-428d-813e-87ce7c7974e1-etc-sysconfig\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378754 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-sys-fs\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378806 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-device-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378911 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-socket-dir\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.381549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.378975 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.382182 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.379361 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecee77dd-1d33-4349-b7b9-5339c3681908-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.382182 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.379648 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-env-overrides\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.382182 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.381645 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-ovn-node-metrics-cert\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.382513 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.382488 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4176befe-94a8-428d-813e-87ce7c7974e1-etc-tuned\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.382725 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.382705 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4176befe-94a8-428d-813e-87ce7c7974e1-tmp\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.385243 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.385199 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hms\" (UniqueName: \"kubernetes.io/projected/265b29b9-6ad8-47cd-828a-4b4936be39ba-kube-api-access-p4hms\") pod \"node-resolver-tdgnv\" (UID: \"265b29b9-6ad8-47cd-828a-4b4936be39ba\") " pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.385583 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.385560 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktnks\" (UniqueName: \"kubernetes.io/projected/4176befe-94a8-428d-813e-87ce7c7974e1-kube-api-access-ktnks\") pod \"tuned-8cqbj\" (UID: \"4176befe-94a8-428d-813e-87ce7c7974e1\") " pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.385820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.385802 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lwzj\" (UniqueName: \"kubernetes.io/projected/7054bf20-6798-4ec7-bb93-50ebbc81e5ac-kube-api-access-4lwzj\") pod \"aws-ebs-csi-driver-node-fm5tv\" (UID: \"7054bf20-6798-4ec7-bb93-50ebbc81e5ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.386668 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.386640 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5kmg\" (UniqueName: \"kubernetes.io/projected/ecee77dd-1d33-4349-b7b9-5339c3681908-kube-api-access-b5kmg\") pod \"multus-additional-cni-plugins-v44gz\" (UID: \"ecee77dd-1d33-4349-b7b9-5339c3681908\") " pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.387450 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.387290 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:32:53.387450 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.387322 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:32:53.387450 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.387338 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:53.387450 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.387422 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:53.887404002 +0000 UTC m=+6.186813452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:53.387770 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.387747 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8drq\" (UniqueName: \"kubernetes.io/projected/f35e88f1-b561-46a0-853a-f36e75fbd3de-kube-api-access-v8drq\") pod \"node-ca-94qxf\" (UID: \"f35e88f1-b561-46a0-853a-f36e75fbd3de\") " pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.389445 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.389418 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhrh4\" (UniqueName: \"kubernetes.io/projected/c5d35c53-6802-44c2-a392-729f32a70f9c-kube-api-access-dhrh4\") pod \"iptables-alerter-qv9w9\" (UID: \"c5d35c53-6802-44c2-a392-729f32a70f9c\") " pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.389531 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.389449 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mjs7\" (UniqueName: \"kubernetes.io/projected/f05414c8-63ff-4ac1-9e60-b68f375c3e9f-kube-api-access-4mjs7\") pod \"ovnkube-node-dsh2x\" (UID: \"f05414c8-63ff-4ac1-9e60-b68f375c3e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.389966 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.389947 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkxjq\" (UniqueName: \"kubernetes.io/projected/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-kube-api-access-gkxjq\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.479585 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479552 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-cnibin\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.479585 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479583 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-cni-bin\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.479764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479605 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-cni-multus\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.479764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479659 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-cni-multus\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.479764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479685 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-cnibin\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.479764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479684 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-cni-bin\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.479764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479754 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-conf-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-system-cni-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479795 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-k8s-cni-cncf-io\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479824 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-multus-certs\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479844 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-conf-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479851 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz4mw\" (UniqueName: \"kubernetes.io/projected/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-kube-api-access-nz4mw\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479885 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-socket-dir-parent\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479888 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-k8s-cni-cncf-io\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479931 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab60d8f1-46f6-403e-9e7f-15a4c8c04c79-agent-certs\") pod \"konnectivity-agent-j5fvf\" (UID: \"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79\") " pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479942 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-multus-certs\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479955 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-os-release\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.479993 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-etc-kubernetes\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480020 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-kubelet\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480043 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-hostroot\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480079 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-cni-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-cni-binary-copy\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480160 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-socket-dir-parent\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480215 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-netns\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480236 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-hostroot\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480269 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-daemon-config\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480298 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab60d8f1-46f6-403e-9e7f-15a4c8c04c79-konnectivity-ca\") pod \"konnectivity-agent-j5fvf\" (UID: \"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79\") " pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480300 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-run-netns\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480355 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-os-release\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480380 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-etc-kubernetes\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480426 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-cni-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480477 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-system-cni-dir\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.480567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480535 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-host-var-lib-kubelet\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.481258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480720 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-cni-binary-copy\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.481258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480833 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab60d8f1-46f6-403e-9e7f-15a4c8c04c79-konnectivity-ca\") pod \"konnectivity-agent-j5fvf\" (UID: \"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79\") " pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.481258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.480875 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-multus-daemon-config\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.482368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.482350 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab60d8f1-46f6-403e-9e7f-15a4c8c04c79-agent-certs\") pod \"konnectivity-agent-j5fvf\" (UID: \"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79\") " pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.494719 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.494695 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz4mw\" (UniqueName: \"kubernetes.io/projected/9c654cfd-4df8-466a-99ae-06dcfb30ed9b-kube-api-access-nz4mw\") pod \"multus-wh2hj\" (UID: \"9c654cfd-4df8-466a-99ae-06dcfb30ed9b\") " pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.495054 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.495032 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" Jul 06 19:32:53.503314 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.503294 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdgnv" Jul 06 19:32:53.504874 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.504852 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7054bf20_6798_4ec7_bb93_50ebbc81e5ac.slice/crio-fdbba625773aefc44b672b1b760b17bab81f9072c0e548590c3939fbad95e315 WatchSource:0}: Error finding container fdbba625773aefc44b672b1b760b17bab81f9072c0e548590c3939fbad95e315: Status 404 returned error can't find the container with id fdbba625773aefc44b672b1b760b17bab81f9072c0e548590c3939fbad95e315 Jul 06 19:32:53.509241 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.509226 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:32:53.512190 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.512174 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265b29b9_6ad8_47cd_828a_4b4936be39ba.slice/crio-b9fb1677828edbb4871f7fc7e424ef46fc4dfdbedfdd44725a4b3ffaec6786c5 WatchSource:0}: Error finding container b9fb1677828edbb4871f7fc7e424ef46fc4dfdbedfdd44725a4b3ffaec6786c5: Status 404 returned error can't find the container with id b9fb1677828edbb4871f7fc7e424ef46fc4dfdbedfdd44725a4b3ffaec6786c5 Jul 06 19:32:53.516076 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.516057 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qv9w9" Jul 06 19:32:53.517874 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.517851 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05414c8_63ff_4ac1_9e60_b68f375c3e9f.slice/crio-b7bb5acac06434ddb67e6d2ae5f665da45e06fb4181d0f82880cf3967890cb69 WatchSource:0}: Error finding container b7bb5acac06434ddb67e6d2ae5f665da45e06fb4181d0f82880cf3967890cb69: Status 404 returned error can't find the container with id b7bb5acac06434ddb67e6d2ae5f665da45e06fb4181d0f82880cf3967890cb69 Jul 06 19:32:53.522587 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.522564 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" Jul 06 19:32:53.526833 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.526812 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d35c53_6802_44c2_a392_729f32a70f9c.slice/crio-1089bab79e3403c08f420f2299cd0a17380f30c042ddf48e8d8366fc65434f2d WatchSource:0}: Error finding container 1089bab79e3403c08f420f2299cd0a17380f30c042ddf48e8d8366fc65434f2d: Status 404 returned error can't find the container with id 1089bab79e3403c08f420f2299cd0a17380f30c042ddf48e8d8366fc65434f2d Jul 06 19:32:53.526921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.526874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v44gz" Jul 06 19:32:53.531426 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.531407 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4176befe_94a8_428d_813e_87ce7c7974e1.slice/crio-acec16c2d5513679756f47b01c694ea7cee8507ea544839d4e474bcc0fca9730 WatchSource:0}: Error finding container acec16c2d5513679756f47b01c694ea7cee8507ea544839d4e474bcc0fca9730: Status 404 returned error can't find the container with id acec16c2d5513679756f47b01c694ea7cee8507ea544839d4e474bcc0fca9730 Jul 06 19:32:53.531915 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.531897 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-94qxf" Jul 06 19:32:53.535656 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.535631 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecee77dd_1d33_4349_b7b9_5339c3681908.slice/crio-454615c2fc1478c12f6bb5a8481a5152c680fafa0d5fed2927abf1e7b55ac87f WatchSource:0}: Error finding container 454615c2fc1478c12f6bb5a8481a5152c680fafa0d5fed2927abf1e7b55ac87f: Status 404 returned error can't find the container with id 454615c2fc1478c12f6bb5a8481a5152c680fafa0d5fed2927abf1e7b55ac87f Jul 06 19:32:53.541129 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.541112 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35e88f1_b561_46a0_853a_f36e75fbd3de.slice/crio-6f93d782ec542f70912aae0b2e88d83bab0f6cf4e045d77f4ea2e0250e9aed52 WatchSource:0}: Error finding container 6f93d782ec542f70912aae0b2e88d83bab0f6cf4e045d77f4ea2e0250e9aed52: Status 404 returned error can't find the container with id 6f93d782ec542f70912aae0b2e88d83bab0f6cf4e045d77f4ea2e0250e9aed52 Jul 06 19:32:53.542655 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.542636 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:32:53.553321 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.553298 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab60d8f1_46f6_403e_9e7f_15a4c8c04c79.slice/crio-00c6241e32af7c2b34cdc49da0452416fdb3272ffd4949310ab389412ec8faf4 WatchSource:0}: Error finding container 00c6241e32af7c2b34cdc49da0452416fdb3272ffd4949310ab389412ec8faf4: Status 404 returned error can't find the container with id 00c6241e32af7c2b34cdc49da0452416fdb3272ffd4949310ab389412ec8faf4 Jul 06 19:32:53.635059 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.634975 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wh2hj" Jul 06 19:32:53.645976 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:32:53.645952 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c654cfd_4df8_466a_99ae_06dcfb30ed9b.slice/crio-24e3d3e2534fced0e4a60d62e7ca857438753efd9653c385635f9ad0fe1ec796 WatchSource:0}: Error finding container 24e3d3e2534fced0e4a60d62e7ca857438753efd9653c385635f9ad0fe1ec796: Status 404 returned error can't find the container with id 24e3d3e2534fced0e4a60d62e7ca857438753efd9653c385635f9ad0fe1ec796 Jul 06 19:32:53.883875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.883834 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:53.884062 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.883893 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:53.884062 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.884024 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:53.884183 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.884086 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.884068714 +0000 UTC m=+7.183478141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:53.884183 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.884086 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:53.884321 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.884185 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.884163393 +0000 UTC m=+7.183572833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:53.985325 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:53.985230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:53.985505 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.985420 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:32:53.985505 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.985444 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:32:53.985505 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.985457 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:53.985671 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:53.985523 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.985504587 +0000 UTC m=+7.284914018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:54.177854 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.177724 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:27:53 +0000 UTC" deadline="2028-01-24 05:10:15.929276391 +0000 UTC" Jul 06 19:32:54.177854 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.177810 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13593h37m21.751472603s" Jul 06 19:32:54.334473 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.334385 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:54.334791 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.334524 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:32:54.377981 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.377940 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5fvf" event={"ID":"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79","Type":"ContainerStarted","Data":"00c6241e32af7c2b34cdc49da0452416fdb3272ffd4949310ab389412ec8faf4"} Jul 06 19:32:54.385033 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.384969 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-94qxf" event={"ID":"f35e88f1-b561-46a0-853a-f36e75fbd3de","Type":"ContainerStarted","Data":"6f93d782ec542f70912aae0b2e88d83bab0f6cf4e045d77f4ea2e0250e9aed52"} Jul 06 19:32:54.392154 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.392072 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerStarted","Data":"454615c2fc1478c12f6bb5a8481a5152c680fafa0d5fed2927abf1e7b55ac87f"} Jul 06 19:32:54.407678 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.407485 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" event={"ID":"4176befe-94a8-428d-813e-87ce7c7974e1","Type":"ContainerStarted","Data":"acec16c2d5513679756f47b01c694ea7cee8507ea544839d4e474bcc0fca9730"} Jul 06 19:32:54.413976 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.413882 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qv9w9" event={"ID":"c5d35c53-6802-44c2-a392-729f32a70f9c","Type":"ContainerStarted","Data":"1089bab79e3403c08f420f2299cd0a17380f30c042ddf48e8d8366fc65434f2d"} Jul 06 19:32:54.428425 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.428298 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"b7bb5acac06434ddb67e6d2ae5f665da45e06fb4181d0f82880cf3967890cb69"} Jul 06 19:32:54.430518 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.430444 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdgnv" event={"ID":"265b29b9-6ad8-47cd-828a-4b4936be39ba","Type":"ContainerStarted","Data":"b9fb1677828edbb4871f7fc7e424ef46fc4dfdbedfdd44725a4b3ffaec6786c5"} Jul 06 19:32:54.432967 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.432876 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:32:54.434690 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.433651 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" event={"ID":"551a2656eb9acdf6b8852513bf829170","Type":"ContainerStarted","Data":"e761e464dfbfb0f39ce5b97f3793dfc0c25c311fd94586a7d43169234f2cd8ae"} Jul 06 19:32:54.445313 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.445237 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wh2hj" event={"ID":"9c654cfd-4df8-466a-99ae-06dcfb30ed9b","Type":"ContainerStarted","Data":"24e3d3e2534fced0e4a60d62e7ca857438753efd9653c385635f9ad0fe1ec796"} Jul 06 19:32:54.448935 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.448862 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" event={"ID":"7054bf20-6798-4ec7-bb93-50ebbc81e5ac","Type":"ContainerStarted","Data":"fdbba625773aefc44b672b1b760b17bab81f9072c0e548590c3939fbad95e315"} Jul 06 19:32:54.460504 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.460428 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal" podStartSLOduration=2.460406967 podStartE2EDuration="2.460406967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:54.460382393 +0000 UTC m=+6.759791842" watchObservedRunningTime="2026-07-06 19:32:54.460406967 +0000 UTC m=+6.759816413" Jul 06 19:32:54.894186 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.894139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:54.894411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.894213 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:54.894411 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.894396 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:54.894533 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.894463 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:56.894444185 +0000 UTC m=+9.193853619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:54.894882 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.894865 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:54.894966 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.894923 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:56.894904771 +0000 UTC m=+9.194314204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:54.995839 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:54.995796 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:54.996019 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.995978 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:32:54.996091 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.996078 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:32:54.996169 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.996100 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:54.996258 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:54.996177 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:56.996155361 +0000 UTC m=+9.295564790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:55.179189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:55.179089 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:27:53 +0000 UTC" deadline="2028-03-07 04:32:38.315782738 +0000 UTC" Jul 06 19:32:55.179189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:55.179136 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14624h59m43.136651293s" Jul 06 19:32:55.331562 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:55.331525 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:55.331755 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:55.331673 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:32:55.332124 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:55.332102 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:55.332274 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:55.332253 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:32:56.331925 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:56.331892 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:56.332409 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:56.332024 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:32:56.913025 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:56.912515 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:56.913025 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:56.912568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:56.913025 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:56.912736 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:56.913025 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:56.912804 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:00.912784437 +0000 UTC m=+13.212193867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:32:56.917468 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:56.913620 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:56.917468 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:56.913706 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:00.913679633 +0000 UTC m=+13.213089062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:32:57.013619 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:57.013576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:57.013790 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:57.013779 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:32:57.013862 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:57.013800 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:32:57.013862 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:57.013813 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:57.013978 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:57.013887 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:01.013865953 +0000 UTC m=+13.313275391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:32:57.332586 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:57.331872 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:57.332586 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:57.331999 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:32:57.332586 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:57.332391 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:57.332586 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:57.332492 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:32:58.335788 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:58.335330 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:32:58.335788 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:58.335445 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:32:59.332702 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:59.332203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:32:59.332702 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:32:59.332203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:32:59.332702 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:59.332353 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:32:59.332702 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:32:59.332430 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:00.332493 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:00.332315 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:00.332493 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:00.332446 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:00.950214 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:00.950167 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:00.950404 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:00.950223 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:00.950404 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:00.950348 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:33:00.950404 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:00.950375 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:33:00.950560 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:00.950427 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:08.950408351 +0000 UTC m=+21.249817779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:33:00.950560 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:00.950450 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:08.950439118 +0000 UTC m=+21.249848544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:33:01.050629 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:01.050585 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:01.050839 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:01.050823 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:33:01.050898 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:01.050847 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:33:01.050898 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:01.050861 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:33:01.050992 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:01.050917 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:09.050899491 +0000 UTC m=+21.350308932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:33:01.331407 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:01.331321 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:01.331564 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:01.331460 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:01.331887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:01.331869 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:01.332041 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:01.331976 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:02.331750 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:02.331719 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:02.332234 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:02.331853 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:03.331937 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:03.331900 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:03.332449 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:03.332045 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:03.332449 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:03.332099 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:03.332449 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:03.332238 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:04.332299 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:04.332265 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:04.332747 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:04.332393 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:05.331718 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:05.331677 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:05.331895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:05.331725 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:05.331895 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:05.331817 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:05.332001 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:05.331959 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:06.331612 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:06.331578 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:06.332077 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:06.331711 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:07.332234 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:07.332207 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:07.332234 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:07.332224 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:07.332669 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:07.332322 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:07.332669 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:07.332462 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:08.333014 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:08.332981 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:08.333489 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:08.333090 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:09.011400 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:09.011357 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:09.011400 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:09.011407 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:09.011633 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.011537 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:33:09.011633 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.011570 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:33:09.011633 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.011622 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.011599416 +0000 UTC m=+37.311008848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:33:09.011773 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.011645 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.011633094 +0000 UTC m=+37.311042522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:33:09.112132 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:09.112095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:09.112316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.112272 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:33:09.112316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.112301 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:33:09.112316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.112314 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:33:09.112439 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.112368 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.112351813 +0000 UTC m=+37.411761260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:33:09.332141 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:09.332057 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:09.332141 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:09.332062 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:09.332338 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.332224 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:09.332387 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:09.332352 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:10.331957 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:10.331920 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:10.332513 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:10.332048 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:11.331722 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:11.331681 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:11.331722 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:11.331725 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:11.332343 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:11.331819 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:11.332343 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:11.331935 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:12.331697 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.331673 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:12.331909 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:12.331807 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:12.497158 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.497100 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5fvf" event={"ID":"ab60d8f1-46f6-403e-9e7f-15a4c8c04c79","Type":"ContainerStarted","Data":"f2b415f1b0298f9928345db86977aace773bc05e281af9ec7142e270aed7c364"} Jul 06 19:33:12.498532 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.498510 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-94qxf" event={"ID":"f35e88f1-b561-46a0-853a-f36e75fbd3de","Type":"ContainerStarted","Data":"734406a2dc49950384ec80713679e158df1a3a048ddb6f39df4c5ed79a433eba"} Jul 06 19:33:12.499934 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.499908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerStarted","Data":"5dfa3c78e7e7e102b8d27eab7fcdf60a119472af032d26a8b6a59da563deb65f"} Jul 06 19:33:12.501336 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.501310 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" event={"ID":"4176befe-94a8-428d-813e-87ce7c7974e1","Type":"ContainerStarted","Data":"42a14bc977697ff8deeb86c996324af28fbaab92bda6232f854da92bd7457f93"} Jul 06 19:33:12.502686 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.502667 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdgnv" event={"ID":"265b29b9-6ad8-47cd-828a-4b4936be39ba","Type":"ContainerStarted","Data":"4047bf7cfa1f2e67e32e57e7f58eb126224e7373721e57f8acb050d492f926aa"} Jul 06 19:33:12.503972 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.503952 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wh2hj" event={"ID":"9c654cfd-4df8-466a-99ae-06dcfb30ed9b","Type":"ContainerStarted","Data":"07d732712e2b5911431b604d5ffb1ea660c24db0e29d13bbf70a2c33ef162015"} Jul 06 19:33:12.505593 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.505575 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" event={"ID":"7054bf20-6798-4ec7-bb93-50ebbc81e5ac","Type":"ContainerStarted","Data":"52cbeb2733a513a9d8c8e40cf51ada4f1ef9cc7c033bfd26fa7cf0d6370235fa"} Jul 06 19:33:12.513355 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.513320 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j5fvf" podStartSLOduration=12.235844751 podStartE2EDuration="22.513308627s" totalImagesPullingTime="10.277463876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:12.513271999 +0000 UTC m=+24.812681445" watchObservedRunningTime="2026-07-06 19:33:12.513308627 +0000 UTC m=+24.812718073" Jul 06 19:33:12.531741 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.531704 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8cqbj" podStartSLOduration=3.915442839 podStartE2EDuration="22.531691341s" totalImagesPullingTime="18.616248502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:12.530832753 +0000 UTC m=+24.830242198" watchObservedRunningTime="2026-07-06 19:33:12.531691341 +0000 UTC m=+24.831100786" Jul 06 19:33:12.546066 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.545966 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-94qxf" podStartSLOduration=3.941297591 podStartE2EDuration="22.545951644s" totalImagesPullingTime="18.604654053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:12.545402343 +0000 UTC m=+24.844811786" watchObservedRunningTime="2026-07-06 19:33:12.545951644 +0000 UTC m=+24.845361090" Jul 06 19:33:12.565208 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.565129 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wh2hj" podStartSLOduration=4.0542952 podStartE2EDuration="22.565107287s" totalImagesPullingTime="18.510812087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:12.564897295 +0000 UTC m=+24.864306741" watchObservedRunningTime="2026-07-06 19:33:12.565107287 +0000 UTC m=+24.864516738" Jul 06 19:33:12.604799 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:12.604750 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tdgnv" podStartSLOduration=3.971547333 podStartE2EDuration="22.604731536s" totalImagesPullingTime="18.633184203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:12.580847427 +0000 UTC m=+24.880256874" watchObservedRunningTime="2026-07-06 19:33:12.604731536 +0000 UTC m=+24.904140982" Jul 06 19:33:13.217521 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.217371 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:33:13.230459 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.230379 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:33:13.21751872Z","UUID":"75846b3f-bc28-4293-bb06-a7d823a0c80f","Handler":null,"Name":"","Endpoint":""} Jul 06 19:33:13.231994 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.231976 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:33:13.232087 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.232011 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:33:13.332317 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.332283 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:13.332317 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.332322 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:13.332501 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:13.332388 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:13.332535 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:13.332499 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:13.508551 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.508520 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecee77dd-1d33-4349-b7b9-5339c3681908" containerID="5dfa3c78e7e7e102b8d27eab7fcdf60a119472af032d26a8b6a59da563deb65f" exitCode=0 Jul 06 19:33:13.509169 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.508567 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerDied","Data":"5dfa3c78e7e7e102b8d27eab7fcdf60a119472af032d26a8b6a59da563deb65f"} Jul 06 19:33:13.511666 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.511640 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"214a14351a5754b1b9fbe2d58fb669722073f3159273f81c10cb55fd72e50894"} Jul 06 19:33:13.511741 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.511721 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"9b6aa3f1a1a94a07c6c0dc1afaf5272155c04bc2ce76df0d5411f8e42b5471af"} Jul 06 19:33:13.511792 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.511772 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"f90c21001b8b782b82d1df7cbc3c1546a302f102651d75f211cba897efd034fa"} Jul 06 19:33:13.511833 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.511821 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"f8d459c22683041b05ba0516e386f4510214c0d61d19bc4ebd73e9f9522418a3"} Jul 06 19:33:13.511878 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.511867 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"9c8fd9c65a58ff0270892ecb217da706174d339ce011bc49d6ddc4dfe6be8b68"} Jul 06 19:33:13.511922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.511907 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"dfa2a5c33dd3e57b4a6d71a3c269a4a21cae4d384cea9d7de2c9faa463b2225d"} Jul 06 19:33:13.513622 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.513600 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" event={"ID":"7054bf20-6798-4ec7-bb93-50ebbc81e5ac","Type":"ContainerStarted","Data":"b0c5f08efc00e54568c703c0dcec0541badc3541da23b260444fbcd3ccbe3ab9"} Jul 06 19:33:13.542981 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.542956 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:33:13.543473 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:13.543457 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:33:14.331884 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.331649 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:14.332042 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:14.331965 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:14.518029 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.517984 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" event={"ID":"7054bf20-6798-4ec7-bb93-50ebbc81e5ac","Type":"ContainerStarted","Data":"8a8c326671b2efa006f2599b7a7849759c4c3900d972da0d3d09bcb8df8a42ee"} Jul 06 19:33:14.519677 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.519652 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qv9w9" event={"ID":"c5d35c53-6802-44c2-a392-729f32a70f9c","Type":"ContainerStarted","Data":"912369dcfdddf4b11ce419e3c19da1fa39ac6f4a33ba57bf34dfa3b5ba338f80"} Jul 06 19:33:14.519804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.519704 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:33:14.520350 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.520332 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j5fvf" Jul 06 19:33:14.537619 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.537578 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm5tv" podStartSLOduration=4.427780079 podStartE2EDuration="24.537560759s" totalImagesPullingTime="20.10978068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.537425829 +0000 UTC m=+26.836835275" watchObservedRunningTime="2026-07-06 19:33:14.537560759 +0000 UTC m=+26.836970210" Jul 06 19:33:14.567472 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:14.567429 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qv9w9" podStartSLOduration=5.948379661 podStartE2EDuration="24.567415342s" totalImagesPullingTime="18.619035681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.566963775 +0000 UTC m=+26.866373222" watchObservedRunningTime="2026-07-06 19:33:14.567415342 +0000 UTC m=+26.866824787" Jul 06 19:33:15.332402 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:15.332323 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:15.332402 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:15.332330 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:15.332583 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:15.332473 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:15.332623 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:15.332593 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:15.526185 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:15.526129 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"dda113abf4748655174db55cbd58c1cabbe225265aa1df0ffbe164fab53d44db"} Jul 06 19:33:16.331412 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:16.331377 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:16.331576 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:16.331515 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:17.331652 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:17.331619 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:17.332275 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:17.331620 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:17.332275 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:17.331725 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:17.332275 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:17.331822 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:18.332437 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.332253 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:18.332902 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:18.332496 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:18.533256 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.533228 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecee77dd-1d33-4349-b7b9-5339c3681908" containerID="dcfb640c3ea0e5e4f05db3dd96997e4cdec8a3457240b96b785ba4a86e5b5973" exitCode=0 Jul 06 19:33:18.533426 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.533316 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerDied","Data":"dcfb640c3ea0e5e4f05db3dd96997e4cdec8a3457240b96b785ba4a86e5b5973"} Jul 06 19:33:18.537031 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.537010 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" event={"ID":"f05414c8-63ff-4ac1-9e60-b68f375c3e9f","Type":"ContainerStarted","Data":"a250e9245901b39b53be1fe3592bcff1cf9edb29564c500a544557b9624b8c03"} Jul 06 19:33:18.537345 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.537330 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:33:18.537407 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.537384 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:33:18.552879 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.552861 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:33:18.587996 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:18.587902 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" podStartSLOduration=9.498107627 podStartE2EDuration="28.587888508s" totalImagesPullingTime="19.089780881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:18.587466138 +0000 UTC m=+30.886875584" watchObservedRunningTime="2026-07-06 19:33:18.587888508 +0000 UTC m=+30.887297954" Jul 06 19:33:19.331983 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.331828 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:19.332065 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.331876 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:19.332096 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:19.332074 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:19.332194 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:19.332173 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:19.506056 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.505987 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqlbq"] Jul 06 19:33:19.509078 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.509041 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xpfb4"] Jul 06 19:33:19.509645 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.509623 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m46nr"] Jul 06 19:33:19.509747 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.509734 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:19.509864 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:19.509841 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:19.542164 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.542117 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecee77dd-1d33-4349-b7b9-5339c3681908" containerID="39eac4420bdf052417fbe60143c1b3fe34cd9fbbeafa04fe8019d8c803f258e3" exitCode=0 Jul 06 19:33:19.542308 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.542186 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerDied","Data":"39eac4420bdf052417fbe60143c1b3fe34cd9fbbeafa04fe8019d8c803f258e3"} Jul 06 19:33:19.542308 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.542231 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:19.542308 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.542297 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:19.542468 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:19.542397 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:19.543485 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:19.542925 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:19.543485 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.542987 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:33:19.558240 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:19.558212 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:33:20.546949 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:20.546911 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecee77dd-1d33-4349-b7b9-5339c3681908" containerID="86a7310e5bc4be7c33546d622096dc62f71982417c5b9469c2864f1cdec773f6" exitCode=0 Jul 06 19:33:20.547405 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:20.546967 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerDied","Data":"86a7310e5bc4be7c33546d622096dc62f71982417c5b9469c2864f1cdec773f6"} Jul 06 19:33:21.331627 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:21.331595 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:21.331774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:21.331641 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:21.331774 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:21.331715 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:21.331872 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:21.331787 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:21.332211 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:21.332194 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:21.332298 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:21.332261 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:23.331651 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:23.331611 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:23.332425 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:23.331662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:23.332425 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:23.331617 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:23.332425 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:23.331743 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqlbq" podUID="163686c1-2cc6-4ec9-8222-b6f3f96772d5" Jul 06 19:33:23.332425 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:23.331862 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpfb4" podUID="e34f747e-ba5b-4fe8-aeda-e2e344c42f6b" Jul 06 19:33:23.332425 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:23.331916 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m46nr" podUID="21e6d76c-d722-4e19-8c5c-e56eeed25b30" Jul 06 19:33:25.032397 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.032355 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:25.032397 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.032394 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:25.032900 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.032490 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:33:25.032900 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.032497 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:33:25.032900 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.032550 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.032532825 +0000 UTC m=+69.331942255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:33:25.032900 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.032563 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret podName:163686c1-2cc6-4ec9-8222-b6f3f96772d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.032556998 +0000 UTC m=+69.331966421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret") pod "global-pull-secret-syncer-wqlbq" (UID: "163686c1-2cc6-4ec9-8222-b6f3f96772d5") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:33:25.132749 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.132708 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:25.132936 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.132912 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:33:25.133021 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.132944 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:33:25.133021 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.132959 2585 projected.go:196] Error preparing data for projected volume kube-api-access-65wll for pod openshift-network-diagnostics/network-check-target-m46nr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:33:25.133106 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.133022 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll podName:21e6d76c-d722-4e19-8c5c-e56eeed25b30 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.133003093 +0000 UTC m=+69.432412535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-65wll" (UniqueName: "kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll") pod "network-check-target-m46nr" (UID: "21e6d76c-d722-4e19-8c5c-e56eeed25b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:33:25.191041 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.191017 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-14.ec2.internal" event="NodeReady" Jul 06 19:33:25.191206 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.191187 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:33:25.242836 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.242801 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2s449"] Jul 06 19:33:25.269347 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.269312 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5lh89"] Jul 06 19:33:25.269503 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.269464 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.272123 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.272094 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:33:25.272300 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.272093 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:33:25.272300 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.272166 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zq5lq\"" Jul 06 19:33:25.289290 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.289266 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2s449"] Jul 06 19:33:25.289411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.289302 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5lh89"] Jul 06 19:33:25.289411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.289382 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.291732 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.291714 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:33:25.291991 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.291957 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:33:25.292139 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.292118 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c64kp\"" Jul 06 19:33:25.292257 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.292223 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:33:25.331945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.331914 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:25.332127 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.331953 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:25.332127 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.331961 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:25.334757 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.334735 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e42a98d-f050-44d3-88d2-7657cb76ffd2-config-volume\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.334856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.334769 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx8b8\" (UniqueName: \"kubernetes.io/projected/509b6b9d-ec42-40a0-8bae-ce258324c692-kube-api-access-lx8b8\") pod \"ingress-canary-5lh89\" (UID: \"509b6b9d-ec42-40a0-8bae-ce258324c692\") " pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.334856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.334791 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44wwr\" (UniqueName: \"kubernetes.io/projected/1e42a98d-f050-44d3-88d2-7657cb76ffd2-kube-api-access-44wwr\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.334856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.334825 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.334962 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.334877 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e42a98d-f050-44d3-88d2-7657cb76ffd2-tmp-dir\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.334962 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.334894 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509b6b9d-ec42-40a0-8bae-ce258324c692-cert\") pod \"ingress-canary-5lh89\" (UID: \"509b6b9d-ec42-40a0-8bae-ce258324c692\") " pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.335434 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.335351 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:33:25.335545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.335461 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:33:25.335545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.335461 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4gp52\"" Jul 06 19:33:25.335653 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.335549 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:33:25.335653 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.335558 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9cds\"" Jul 06 19:33:25.335653 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.335563 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:33:25.436089 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436047 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.436089 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436091 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e42a98d-f050-44d3-88d2-7657cb76ffd2-tmp-dir\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.436353 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436212 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509b6b9d-ec42-40a0-8bae-ce258324c692-cert\") pod \"ingress-canary-5lh89\" (UID: \"509b6b9d-ec42-40a0-8bae-ce258324c692\") " pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.436353 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.436215 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:25.436353 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e42a98d-f050-44d3-88d2-7657cb76ffd2-config-volume\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.436353 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx8b8\" (UniqueName: \"kubernetes.io/projected/509b6b9d-ec42-40a0-8bae-ce258324c692-kube-api-access-lx8b8\") pod \"ingress-canary-5lh89\" (UID: \"509b6b9d-ec42-40a0-8bae-ce258324c692\") " pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.436353 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.436348 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.936329214 +0000 UTC m=+38.235738641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:25.436584 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436391 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44wwr\" (UniqueName: \"kubernetes.io/projected/1e42a98d-f050-44d3-88d2-7657cb76ffd2-kube-api-access-44wwr\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.436584 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436462 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e42a98d-f050-44d3-88d2-7657cb76ffd2-tmp-dir\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.436941 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.436924 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e42a98d-f050-44d3-88d2-7657cb76ffd2-config-volume\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.440452 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.440427 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509b6b9d-ec42-40a0-8bae-ce258324c692-cert\") pod \"ingress-canary-5lh89\" (UID: \"509b6b9d-ec42-40a0-8bae-ce258324c692\") " pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.445232 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.445204 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44wwr\" (UniqueName: \"kubernetes.io/projected/1e42a98d-f050-44d3-88d2-7657cb76ffd2-kube-api-access-44wwr\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.445532 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.445515 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx8b8\" (UniqueName: \"kubernetes.io/projected/509b6b9d-ec42-40a0-8bae-ce258324c692-kube-api-access-lx8b8\") pod \"ingress-canary-5lh89\" (UID: \"509b6b9d-ec42-40a0-8bae-ce258324c692\") " pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.560541 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.560502 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecee77dd-1d33-4349-b7b9-5339c3681908" containerID="bfe0f0a68c228bb804740066483a1e0adbf95dc899545c9ef983ecceb9a5fd12" exitCode=0 Jul 06 19:33:25.560695 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.560574 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerDied","Data":"bfe0f0a68c228bb804740066483a1e0adbf95dc899545c9ef983ecceb9a5fd12"} Jul 06 19:33:25.600448 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.600426 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5lh89" Jul 06 19:33:25.806796 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.806543 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5lh89"] Jul 06 19:33:25.830992 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:33:25.830963 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509b6b9d_ec42_40a0_8bae_ce258324c692.slice/crio-52573b8117fe35585ac31e988a9a3ac30869fcc2eacfe88db4156cebc7f0839f WatchSource:0}: Error finding container 52573b8117fe35585ac31e988a9a3ac30869fcc2eacfe88db4156cebc7f0839f: Status 404 returned error can't find the container with id 52573b8117fe35585ac31e988a9a3ac30869fcc2eacfe88db4156cebc7f0839f Jul 06 19:33:25.940663 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:25.940632 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:25.940849 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.940785 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:25.940889 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:25.940859 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:26.940842159 +0000 UTC m=+39.240251582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:26.566571 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:26.566534 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecee77dd-1d33-4349-b7b9-5339c3681908" containerID="7b2359e3d826833482f559863e9dd999bbf34e6e3f6142a637677ae83771007a" exitCode=0 Jul 06 19:33:26.567047 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:26.566616 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerDied","Data":"7b2359e3d826833482f559863e9dd999bbf34e6e3f6142a637677ae83771007a"} Jul 06 19:33:26.567998 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:26.567971 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5lh89" event={"ID":"509b6b9d-ec42-40a0-8bae-ce258324c692","Type":"ContainerStarted","Data":"52573b8117fe35585ac31e988a9a3ac30869fcc2eacfe88db4156cebc7f0839f"} Jul 06 19:33:26.948081 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:26.948041 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:26.948278 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:26.948206 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:26.948278 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:26.948275 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:28.948256139 +0000 UTC m=+41.247665570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:27.574724 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:27.574678 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v44gz" event={"ID":"ecee77dd-1d33-4349-b7b9-5339c3681908","Type":"ContainerStarted","Data":"0dd7aa06e904df748c2dd904d9775166a8022810d152ca4113d5518053f99cb3"} Jul 06 19:33:27.607435 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:27.607384 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v44gz" podStartSLOduration=9.229240748 podStartE2EDuration="37.607366533s" totalImagesPullingTime="28.378125785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:27.605692393 +0000 UTC m=+39.905101839" watchObservedRunningTime="2026-07-06 19:33:27.607366533 +0000 UTC m=+39.906775980" Jul 06 19:33:28.578826 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:28.578790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5lh89" event={"ID":"509b6b9d-ec42-40a0-8bae-ce258324c692","Type":"ContainerStarted","Data":"842286792a187a14456b496cb444386256ca761ab08e9807fc32dab1cac0682a"} Jul 06 19:33:28.606264 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:28.606167 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5lh89" podStartSLOduration=1.090115583 podStartE2EDuration="3.606133918s" totalImagesPullingTime="2.516018335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:28.604604422 +0000 UTC m=+40.904013868" watchObservedRunningTime="2026-07-06 19:33:28.606133918 +0000 UTC m=+40.905543361" Jul 06 19:33:28.963853 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:28.963817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:28.964031 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:28.963994 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:28.964115 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:28.964102 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:32.964074305 +0000 UTC m=+45.263483733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:32.991115 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:32.991075 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:32.991737 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:32.991244 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:32.991737 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:32.991312 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:40.991293539 +0000 UTC m=+53.290702962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:41.047883 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:41.047836 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:41.048445 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:41.048000 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:41.048445 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:41.048068 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.048052757 +0000 UTC m=+69.347462187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:51.560793 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:51.560761 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsh2x" Jul 06 19:33:57.060220 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.060176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:57.060220 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.060219 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:33:57.060759 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.060259 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:33:57.060759 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:57.060346 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:33:57.060759 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:57.060408 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls podName:1e42a98d-f050-44d3-88d2-7657cb76ffd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:29.060389584 +0000 UTC m=+101.359799008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls") pod "dns-default-2s449" (UID: "1e42a98d-f050-44d3-88d2-7657cb76ffd2") : secret "dns-default-metrics-tls" not found Jul 06 19:33:57.063682 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.063660 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:33:57.063734 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.063681 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:33:57.071025 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:57.071002 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:33:57.071102 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:33:57.071074 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs podName:e34f747e-ba5b-4fe8-aeda-e2e344c42f6b nodeName:}" failed. No retries permitted until 2026-07-06 19:35:01.071053929 +0000 UTC m=+133.370463352 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs") pod "network-metrics-daemon-xpfb4" (UID: "e34f747e-ba5b-4fe8-aeda-e2e344c42f6b") : secret "metrics-daemon-secret" not found Jul 06 19:33:57.075049 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.075030 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/163686c1-2cc6-4ec9-8222-b6f3f96772d5-original-pull-secret\") pod \"global-pull-secret-syncer-wqlbq\" (UID: \"163686c1-2cc6-4ec9-8222-b6f3f96772d5\") " pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:57.161079 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.161045 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:57.164132 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.164104 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:33:57.173857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.173830 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:33:57.173994 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.173965 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqlbq" Jul 06 19:33:57.184059 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.184034 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65wll\" (UniqueName: \"kubernetes.io/projected/21e6d76c-d722-4e19-8c5c-e56eeed25b30-kube-api-access-65wll\") pod \"network-check-target-m46nr\" (UID: \"21e6d76c-d722-4e19-8c5c-e56eeed25b30\") " pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:57.292565 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.292531 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqlbq"] Jul 06 19:33:57.295983 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:33:57.295957 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163686c1_2cc6_4ec9_8222_b6f3f96772d5.slice/crio-0069fab40d046c1fdb255aed70c29ca81bc8400254b037b8e8d2cb5c531f312d WatchSource:0}: Error finding container 0069fab40d046c1fdb255aed70c29ca81bc8400254b037b8e8d2cb5c531f312d: Status 404 returned error can't find the container with id 0069fab40d046c1fdb255aed70c29ca81bc8400254b037b8e8d2cb5c531f312d Jul 06 19:33:57.471401 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.471370 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4gp52\"" Jul 06 19:33:57.479672 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.479643 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:33:57.601381 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.601350 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m46nr"] Jul 06 19:33:57.604193 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:33:57.604168 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e6d76c_d722_4e19_8c5c_e56eeed25b30.slice/crio-eee74964221fa7b2a0dc80f15767c6ac7db21451cb0a7a2cc853add5c8709b85 WatchSource:0}: Error finding container eee74964221fa7b2a0dc80f15767c6ac7db21451cb0a7a2cc853add5c8709b85: Status 404 returned error can't find the container with id eee74964221fa7b2a0dc80f15767c6ac7db21451cb0a7a2cc853add5c8709b85 Jul 06 19:33:57.647915 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.647875 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m46nr" event={"ID":"21e6d76c-d722-4e19-8c5c-e56eeed25b30","Type":"ContainerStarted","Data":"eee74964221fa7b2a0dc80f15767c6ac7db21451cb0a7a2cc853add5c8709b85"} Jul 06 19:33:57.649262 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:33:57.649234 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqlbq" event={"ID":"163686c1-2cc6-4ec9-8222-b6f3f96772d5","Type":"ContainerStarted","Data":"0069fab40d046c1fdb255aed70c29ca81bc8400254b037b8e8d2cb5c531f312d"} Jul 06 19:34:02.664055 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:02.664016 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqlbq" event={"ID":"163686c1-2cc6-4ec9-8222-b6f3f96772d5","Type":"ContainerStarted","Data":"3f0ea4ebf9f0eb7a347f2de60b2bc4401ebe6549b7146306aa43a165a2cce8de"} Jul 06 19:34:02.665423 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:02.665398 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m46nr" event={"ID":"21e6d76c-d722-4e19-8c5c-e56eeed25b30","Type":"ContainerStarted","Data":"d75950707ef59f06fd85507a2428960d69fb1249c00210481e9453cd629393c9"} Jul 06 19:34:02.665557 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:02.665542 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:34:02.681234 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:02.681191 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wqlbq" podStartSLOduration=66.145992843 podStartE2EDuration="1m10.681177481s" totalImagesPullingTime="4.535184638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:02.680429142 +0000 UTC m=+74.979838588" watchObservedRunningTime="2026-07-06 19:34:02.681177481 +0000 UTC m=+74.980586920" Jul 06 19:34:02.696992 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:02.696951 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m46nr" podStartSLOduration=68.473084723 podStartE2EDuration="1m12.696937299s" totalImagesPullingTime="4.223852576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:02.696295498 +0000 UTC m=+74.995704945" watchObservedRunningTime="2026-07-06 19:34:02.696937299 +0000 UTC m=+74.996346744" Jul 06 19:34:14.557814 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.557705 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-9q4nt"] Jul 06 19:34:14.561409 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.561389 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.564059 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.564041 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:34:14.564059 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.564051 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j2pcr\"" Jul 06 19:34:14.564189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.564048 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:34:14.564189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.564048 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:34:14.564984 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.564964 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:34:14.570260 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.570242 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:34:14.575198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.575178 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-9q4nt"] Jul 06 19:34:14.664191 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.664167 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn"] Jul 06 19:34:14.666796 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.666781 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6869767d5-ltf8v"] Jul 06 19:34:14.666912 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.666894 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.669325 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.669306 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.670812 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.670793 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 19:34:14.670812 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.670809 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:34:14.670975 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.670797 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:34:14.670975 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.670797 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2fgs4\"" Jul 06 19:34:14.670975 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.670800 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 19:34:14.671765 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.671748 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:34:14.671860 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.671769 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:34:14.672046 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.672025 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xxz86\"" Jul 06 19:34:14.672250 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.672229 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:34:14.672338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.672235 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:34:14.672338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.672276 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:34:14.672440 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.672335 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:34:14.679922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.679657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/944f0118-0a65-4e59-9a79-048b620fb8b6-config\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.679922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.679693 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/944f0118-0a65-4e59-9a79-048b620fb8b6-trusted-ca\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.679922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.679726 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/944f0118-0a65-4e59-9a79-048b620fb8b6-serving-cert\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.679922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.679756 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6kbt\" (UniqueName: \"kubernetes.io/projected/944f0118-0a65-4e59-9a79-048b620fb8b6-kube-api-access-n6kbt\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.680121 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.679971 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn"] Jul 06 19:34:14.683427 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.683407 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6869767d5-ltf8v"] Jul 06 19:34:14.771932 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.771907 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68"] Jul 06 19:34:14.774790 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.774763 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:14.777406 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.777389 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:34:14.777879 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.777863 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:34:14.777963 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.777887 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-shwwp\"" Jul 06 19:34:14.778238 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.778224 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:34:14.780252 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780226 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-default-certificate\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.780346 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780298 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-stats-auth\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.780346 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780336 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lnn\" (UniqueName: \"kubernetes.io/projected/e08c88a7-f17d-4551-a5a6-75a306567711-kube-api-access-t2lnn\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.780463 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780358 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.780463 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780437 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/944f0118-0a65-4e59-9a79-048b620fb8b6-config\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.780566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780472 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/944f0118-0a65-4e59-9a79-048b620fb8b6-trusted-ca\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.780566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780506 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.780566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780550 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/944f0118-0a65-4e59-9a79-048b620fb8b6-serving-cert\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.780820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780582 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2babca22-b684-4714-b7e2-30fe26e57bd3-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.780820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6kbt\" (UniqueName: \"kubernetes.io/projected/944f0118-0a65-4e59-9a79-048b620fb8b6-kube-api-access-n6kbt\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.780820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780794 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.780970 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.780850 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hksg\" (UniqueName: \"kubernetes.io/projected/2babca22-b684-4714-b7e2-30fe26e57bd3-kube-api-access-7hksg\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.781138 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.781106 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/944f0118-0a65-4e59-9a79-048b620fb8b6-config\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.781700 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.781676 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/944f0118-0a65-4e59-9a79-048b620fb8b6-trusted-ca\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.783000 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.782982 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/944f0118-0a65-4e59-9a79-048b620fb8b6-serving-cert\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.787440 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.787416 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68"] Jul 06 19:34:14.794732 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.794711 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6kbt\" (UniqueName: \"kubernetes.io/projected/944f0118-0a65-4e59-9a79-048b620fb8b6-kube-api-access-n6kbt\") pod \"console-operator-68b757fb67-9q4nt\" (UID: \"944f0118-0a65-4e59-9a79-048b620fb8b6\") " pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.871017 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.870964 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:14.882000 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.881979 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-stats-auth\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.882097 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882019 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64m5h\" (UniqueName: \"kubernetes.io/projected/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-kube-api-access-64m5h\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:14.882097 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lnn\" (UniqueName: \"kubernetes.io/projected/e08c88a7-f17d-4551-a5a6-75a306567711-kube-api-access-t2lnn\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.882097 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882081 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.882287 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882127 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.882287 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882189 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2babca22-b684-4714-b7e2-30fe26e57bd3-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.882287 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882218 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.882287 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.882230 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:14.882287 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882243 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:14.882287 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882275 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hksg\" (UniqueName: \"kubernetes.io/projected/2babca22-b684-4714-b7e2-30fe26e57bd3-kube-api-access-7hksg\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.882544 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.882305 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-default-certificate\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.882649 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.882625 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:34:14.882776 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.882620 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls podName:2babca22-b684-4714-b7e2-30fe26e57bd3 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:15.382597572 +0000 UTC m=+87.682007009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lrgdn" (UID: "2babca22-b684-4714-b7e2-30fe26e57bd3") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:14.883429 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.882868 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:15.38283687 +0000 UTC m=+87.682246305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : secret "router-metrics-certs-default" not found Jul 06 19:34:14.883429 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.883086 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:15.383071006 +0000 UTC m=+87.682480429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : configmap references non-existent config key: service-ca.crt Jul 06 19:34:14.885206 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.885185 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2babca22-b684-4714-b7e2-30fe26e57bd3-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.887669 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.885345 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-stats-auth\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.889743 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.889720 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-default-certificate\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.898076 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.898054 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lnn\" (UniqueName: \"kubernetes.io/projected/e08c88a7-f17d-4551-a5a6-75a306567711-kube-api-access-t2lnn\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:14.898704 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.898652 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hksg\" (UniqueName: \"kubernetes.io/projected/2babca22-b684-4714-b7e2-30fe26e57bd3-kube-api-access-7hksg\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:14.983811 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.983779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:14.983981 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.983838 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64m5h\" (UniqueName: \"kubernetes.io/projected/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-kube-api-access-64m5h\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:14.983981 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.983959 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:34:14.984094 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:14.984043 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls podName:6c4dc8ee-1a54-442a-85c2-5e7b28b63895 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:15.484020053 +0000 UTC m=+87.783429495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlf68" (UID: "6c4dc8ee-1a54-442a-85c2-5e7b28b63895") : secret "samples-operator-tls" not found Jul 06 19:34:14.992964 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.992942 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64m5h\" (UniqueName: \"kubernetes.io/projected/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-kube-api-access-64m5h\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:14.999067 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:14.999037 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-9q4nt"] Jul 06 19:34:15.001603 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:15.001582 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944f0118_0a65_4e59_9a79_048b620fb8b6.slice/crio-08198b7287e0f6482d9b2f2d3e2509c9257f37fdef281ab0eebb9ba4da5231b4 WatchSource:0}: Error finding container 08198b7287e0f6482d9b2f2d3e2509c9257f37fdef281ab0eebb9ba4da5231b4: Status 404 returned error can't find the container with id 08198b7287e0f6482d9b2f2d3e2509c9257f37fdef281ab0eebb9ba4da5231b4 Jul 06 19:34:15.386761 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:15.386717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:15.386988 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:15.386778 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:15.386988 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:15.386807 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:15.386988 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.386887 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:15.386988 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.386933 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:34:15.386988 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.386935 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.386922419 +0000 UTC m=+88.686331844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : configmap references non-existent config key: service-ca.crt Jul 06 19:34:15.387202 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.386994 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls podName:2babca22-b684-4714-b7e2-30fe26e57bd3 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.386976074 +0000 UTC m=+88.686385510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lrgdn" (UID: "2babca22-b684-4714-b7e2-30fe26e57bd3") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:15.387202 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.387007 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.387000406 +0000 UTC m=+88.686409829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : secret "router-metrics-certs-default" not found Jul 06 19:34:15.487452 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:15.487422 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:15.487607 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.487530 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:34:15.487607 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:15.487587 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls podName:6c4dc8ee-1a54-442a-85c2-5e7b28b63895 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.487570318 +0000 UTC m=+88.786979748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlf68" (UID: "6c4dc8ee-1a54-442a-85c2-5e7b28b63895") : secret "samples-operator-tls" not found Jul 06 19:34:15.698242 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:15.698212 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" event={"ID":"944f0118-0a65-4e59-9a79-048b620fb8b6","Type":"ContainerStarted","Data":"08198b7287e0f6482d9b2f2d3e2509c9257f37fdef281ab0eebb9ba4da5231b4"} Jul 06 19:34:16.396188 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:16.396104 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:16.396188 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:16.396183 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:16.396399 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:16.396218 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:16.396399 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.396269 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:16.396399 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.396327 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:34:16.396399 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.396348 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls podName:2babca22-b684-4714-b7e2-30fe26e57bd3 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.396328575 +0000 UTC m=+90.695738013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lrgdn" (UID: "2babca22-b684-4714-b7e2-30fe26e57bd3") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:16.396399 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.396374 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.39636122 +0000 UTC m=+90.695770651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : secret "router-metrics-certs-default" not found Jul 06 19:34:16.396399 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.396389 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.396382477 +0000 UTC m=+90.695791902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : configmap references non-existent config key: service-ca.crt Jul 06 19:34:16.497598 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:16.497566 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:16.497743 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.497673 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:34:16.497743 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:16.497724 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls podName:6c4dc8ee-1a54-442a-85c2-5e7b28b63895 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.497710522 +0000 UTC m=+90.797119946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlf68" (UID: "6c4dc8ee-1a54-442a-85c2-5e7b28b63895") : secret "samples-operator-tls" not found Jul 06 19:34:17.704435 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:17.704407 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/0.log" Jul 06 19:34:17.704779 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:17.704443 2585 generic.go:356] "Generic (PLEG): container finished" podID="944f0118-0a65-4e59-9a79-048b620fb8b6" containerID="aaec1be1527408ddec4d9607d1019c6fb1db58f3405e0aa23fb3455be8c8291f" exitCode=255 Jul 06 19:34:17.704779 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:17.704478 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" event={"ID":"944f0118-0a65-4e59-9a79-048b620fb8b6","Type":"ContainerDied","Data":"aaec1be1527408ddec4d9607d1019c6fb1db58f3405e0aa23fb3455be8c8291f"} Jul 06 19:34:17.704779 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:17.704681 2585 scope.go:117] "RemoveContainer" containerID="aaec1be1527408ddec4d9607d1019c6fb1db58f3405e0aa23fb3455be8c8291f" Jul 06 19:34:18.412003 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.411965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:18.412003 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.412016 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:18.412240 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.412095 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:34:18.412240 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.412114 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:18.412240 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.412143 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.412127286 +0000 UTC m=+94.711536721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : secret "router-metrics-certs-default" not found Jul 06 19:34:18.412240 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.412137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:18.412240 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.412183 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls podName:2babca22-b684-4714-b7e2-30fe26e57bd3 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.412167604 +0000 UTC m=+94.711577038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lrgdn" (UID: "2babca22-b684-4714-b7e2-30fe26e57bd3") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:18.412240 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.412225 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.412215812 +0000 UTC m=+94.711625237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : configmap references non-existent config key: service-ca.crt Jul 06 19:34:18.512996 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.512965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:18.513123 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.513105 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:34:18.513189 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.513177 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls podName:6c4dc8ee-1a54-442a-85c2-5e7b28b63895 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.51314275 +0000 UTC m=+94.812552184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlf68" (UID: "6c4dc8ee-1a54-442a-85c2-5e7b28b63895") : secret "samples-operator-tls" not found Jul 06 19:34:18.708364 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.708298 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:34:18.708756 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.708680 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/0.log" Jul 06 19:34:18.708756 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.708716 2585 generic.go:356] "Generic (PLEG): container finished" podID="944f0118-0a65-4e59-9a79-048b620fb8b6" containerID="8ac021a8c180c1eab606cea5c3c29ca40d30e2434f0c03b2a11f9d7530e62318" exitCode=255 Jul 06 19:34:18.708826 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.708790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" event={"ID":"944f0118-0a65-4e59-9a79-048b620fb8b6","Type":"ContainerDied","Data":"8ac021a8c180c1eab606cea5c3c29ca40d30e2434f0c03b2a11f9d7530e62318"} Jul 06 19:34:18.708884 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.708871 2585 scope.go:117] "RemoveContainer" containerID="aaec1be1527408ddec4d9607d1019c6fb1db58f3405e0aa23fb3455be8c8291f" Jul 06 19:34:18.709034 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:18.709020 2585 scope.go:117] "RemoveContainer" containerID="8ac021a8c180c1eab606cea5c3c29ca40d30e2434f0c03b2a11f9d7530e62318" Jul 06 19:34:18.709240 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:18.709220 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-9q4nt_openshift-console-operator(944f0118-0a65-4e59-9a79-048b620fb8b6)\"" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" podUID="944f0118-0a65-4e59-9a79-048b620fb8b6" Jul 06 19:34:19.712855 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:19.712826 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:34:19.713235 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:19.713125 2585 scope.go:117] "RemoveContainer" containerID="8ac021a8c180c1eab606cea5c3c29ca40d30e2434f0c03b2a11f9d7530e62318" Jul 06 19:34:19.713312 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:19.713292 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-9q4nt_openshift-console-operator(944f0118-0a65-4e59-9a79-048b620fb8b6)\"" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" podUID="944f0118-0a65-4e59-9a79-048b620fb8b6" Jul 06 19:34:20.285415 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.285381 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tkhlm"] Jul 06 19:34:20.289633 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.289615 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.292068 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.292047 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:34:20.292197 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.292047 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-npgh8\"" Jul 06 19:34:20.292255 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.292232 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:34:20.292345 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.292332 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:34:20.293278 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.293259 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:34:20.302578 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.302536 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tkhlm"] Jul 06 19:34:20.429765 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.429720 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a0956ea-4a11-4730-bca6-0014cfc80628-crio-socket\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.429765 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.429766 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0956ea-4a11-4730-bca6-0014cfc80628-data-volume\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.429991 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.429793 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.429991 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.429820 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vll8j\" (UniqueName: \"kubernetes.io/projected/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-api-access-vll8j\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.429991 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.429846 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530372 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530334 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a0956ea-4a11-4730-bca6-0014cfc80628-crio-socket\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530372 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0956ea-4a11-4730-bca6-0014cfc80628-data-volume\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530395 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530427 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vll8j\" (UniqueName: \"kubernetes.io/projected/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-api-access-vll8j\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530467 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a0956ea-4a11-4730-bca6-0014cfc80628-crio-socket\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:20.530495 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:20.530576 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:20.530583 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:21.030564139 +0000 UTC m=+93.329973565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : configmap "kube-rbac-proxy" not found Jul 06 19:34:20.530621 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:20.530613 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:21.030602433 +0000 UTC m=+93.330011858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : secret "insights-runtime-extractor-tls" not found Jul 06 19:34:20.530947 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.530753 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0956ea-4a11-4730-bca6-0014cfc80628-data-volume\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:20.546821 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:20.546766 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vll8j\" (UniqueName: \"kubernetes.io/projected/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-api-access-vll8j\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:21.034620 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:21.034577 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:21.035090 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:21.034678 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:34:21.035090 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:21.034691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:21.035090 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:21.034735 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.03472121 +0000 UTC m=+94.334130634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : configmap "kube-rbac-proxy" not found Jul 06 19:34:21.035090 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:21.034816 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:34:21.035090 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:21.034886 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.034868984 +0000 UTC m=+94.334278411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : secret "insights-runtime-extractor-tls" not found Jul 06 19:34:22.045882 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.045828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:22.046316 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.045899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:22.046316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.045960 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:34:22.046316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.045992 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:34:22.046316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.046029 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:24.046012903 +0000 UTC m=+96.345422327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : configmap "kube-rbac-proxy" not found Jul 06 19:34:22.046316 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.046044 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:24.046037234 +0000 UTC m=+96.345446657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : secret "insights-runtime-extractor-tls" not found Jul 06 19:34:22.448212 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.448167 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:22.448382 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.448291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:22.448382 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.448322 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:22.448382 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.448347 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:30.448324523 +0000 UTC m=+102.747733947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : configmap references non-existent config key: service-ca.crt Jul 06 19:34:22.448499 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.448418 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:22.448499 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.448460 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls podName:2babca22-b684-4714-b7e2-30fe26e57bd3 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:30.448450236 +0000 UTC m=+102.747859662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lrgdn" (UID: "2babca22-b684-4714-b7e2-30fe26e57bd3") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:22.448499 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.448417 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:34:22.448499 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.448487 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:30.448481773 +0000 UTC m=+102.747891196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : secret "router-metrics-certs-default" not found Jul 06 19:34:22.468997 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.468973 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdgnv_265b29b9-6ad8-47cd-828a-4b4936be39ba/dns-node-resolver/0.log" Jul 06 19:34:22.549187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:22.549132 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:22.549320 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.549289 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:34:22.549361 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:22.549353 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls podName:6c4dc8ee-1a54-442a-85c2-5e7b28b63895 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:30.549338589 +0000 UTC m=+102.848748018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlf68" (UID: "6c4dc8ee-1a54-442a-85c2-5e7b28b63895") : secret "samples-operator-tls" not found Jul 06 19:34:23.267738 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:23.267711 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-94qxf_f35e88f1-b561-46a0-853a-f36e75fbd3de/node-ca/0.log" Jul 06 19:34:23.863460 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:23.863431 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lh89_509b6b9d-ec42-40a0-8bae-ce258324c692/serve-healthcheck-canary/0.log" Jul 06 19:34:24.063842 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:24.063801 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:24.064016 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:24.063851 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:24.064016 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:24.063930 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:34:24.064016 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:24.063969 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:34:24.064016 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:24.063996 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:28.063981229 +0000 UTC m=+100.363390653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : configmap "kube-rbac-proxy" not found Jul 06 19:34:24.064016 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:24.064019 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:28.064007605 +0000 UTC m=+100.363417029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : secret "insights-runtime-extractor-tls" not found Jul 06 19:34:24.871665 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:24.871623 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:24.872037 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:24.871685 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:24.872037 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:24.872000 2585 scope.go:117] "RemoveContainer" containerID="8ac021a8c180c1eab606cea5c3c29ca40d30e2434f0c03b2a11f9d7530e62318" Jul 06 19:34:24.872189 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:24.872142 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-9q4nt_openshift-console-operator(944f0118-0a65-4e59-9a79-048b620fb8b6)\"" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" podUID="944f0118-0a65-4e59-9a79-048b620fb8b6" Jul 06 19:34:28.096452 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:28.096401 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:28.096833 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:28.096483 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:28.096833 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:28.096521 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:34:28.096833 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:28.096625 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:36.096607033 +0000 UTC m=+108.396016464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : configmap "kube-rbac-proxy" not found Jul 06 19:34:28.096833 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:28.096643 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:34:28.096833 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:28.096698 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls podName:4a0956ea-4a11-4730-bca6-0014cfc80628 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:36.096684776 +0000 UTC m=+108.396094200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkhlm" (UID: "4a0956ea-4a11-4730-bca6-0014cfc80628") : secret "insights-runtime-extractor-tls" not found Jul 06 19:34:29.107583 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:29.106685 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:34:29.110362 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:29.110329 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e42a98d-f050-44d3-88d2-7657cb76ffd2-metrics-tls\") pod \"dns-default-2s449\" (UID: \"1e42a98d-f050-44d3-88d2-7657cb76ffd2\") " pod="openshift-dns/dns-default-2s449" Jul 06 19:34:29.182297 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:29.182266 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zq5lq\"" Jul 06 19:34:29.189693 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:29.189668 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2s449" Jul 06 19:34:29.313642 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:29.313554 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2s449"] Jul 06 19:34:29.316441 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:29.316415 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e42a98d_f050_44d3_88d2_7657cb76ffd2.slice/crio-3ccd77b75e831b2b6cab52772c4cb432ea23dc38d0f517c04fbf077858ae80bb WatchSource:0}: Error finding container 3ccd77b75e831b2b6cab52772c4cb432ea23dc38d0f517c04fbf077858ae80bb: Status 404 returned error can't find the container with id 3ccd77b75e831b2b6cab52772c4cb432ea23dc38d0f517c04fbf077858ae80bb Jul 06 19:34:29.739689 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:29.739652 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2s449" event={"ID":"1e42a98d-f050-44d3-88d2-7657cb76ffd2","Type":"ContainerStarted","Data":"3ccd77b75e831b2b6cab52772c4cb432ea23dc38d0f517c04fbf077858ae80bb"} Jul 06 19:34:30.519089 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.519059 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:30.519564 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.519109 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:30.519564 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.519235 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:30.519564 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:30.519287 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle podName:e08c88a7-f17d-4551-a5a6-75a306567711 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:46.51926438 +0000 UTC m=+118.818673803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle") pod "router-default-6869767d5-ltf8v" (UID: "e08c88a7-f17d-4551-a5a6-75a306567711") : configmap references non-existent config key: service-ca.crt Jul 06 19:34:30.519564 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:30.519339 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:30.519564 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:30.519401 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls podName:2babca22-b684-4714-b7e2-30fe26e57bd3 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:46.519389429 +0000 UTC m=+118.818798853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lrgdn" (UID: "2babca22-b684-4714-b7e2-30fe26e57bd3") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:34:30.521711 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.521689 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08c88a7-f17d-4551-a5a6-75a306567711-metrics-certs\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:30.620560 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.620517 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:30.623583 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.623544 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c4dc8ee-1a54-442a-85c2-5e7b28b63895-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlf68\" (UID: \"6c4dc8ee-1a54-442a-85c2-5e7b28b63895\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:30.683496 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.683464 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" Jul 06 19:34:30.841861 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:30.841831 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68"] Jul 06 19:34:31.748101 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:31.748061 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" event={"ID":"6c4dc8ee-1a54-442a-85c2-5e7b28b63895","Type":"ContainerStarted","Data":"0802f31d999bb29110056039acf6c04ae7244afe2c787fcc6f1ae64a39f2ad82"} Jul 06 19:34:31.750030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:31.749995 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2s449" event={"ID":"1e42a98d-f050-44d3-88d2-7657cb76ffd2","Type":"ContainerStarted","Data":"7132b9e37f56f0855f759107776fef927db31a159c5a60fedeb580bfb98031e0"} Jul 06 19:34:31.750162 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:31.750055 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2s449" event={"ID":"1e42a98d-f050-44d3-88d2-7657cb76ffd2","Type":"ContainerStarted","Data":"55024d1e5fdf4b4320d60cd397b8566b6d0c6e9fd302db2ea6751ae045fddbcd"} Jul 06 19:34:31.750223 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:31.750177 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2s449" Jul 06 19:34:31.773481 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:31.773435 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2s449" podStartSLOduration=65.373724347 podStartE2EDuration="1m6.773418088s" totalImagesPullingTime="1.399693741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:31.772283355 +0000 UTC m=+104.071692800" watchObservedRunningTime="2026-07-06 19:34:31.773418088 +0000 UTC m=+104.072827543" Jul 06 19:34:33.670813 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:33.670778 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m46nr" Jul 06 19:34:33.762174 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:33.762132 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" event={"ID":"6c4dc8ee-1a54-442a-85c2-5e7b28b63895","Type":"ContainerStarted","Data":"dd7b092340b10d0b0eb29028b81221b532bdee9c53b7403a33257175de402437"} Jul 06 19:34:33.762357 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:33.762192 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" event={"ID":"6c4dc8ee-1a54-442a-85c2-5e7b28b63895","Type":"ContainerStarted","Data":"f27e19eb0923deef20d5adbd9c0a3f7aa77817aa9287aa37d63929648872a35f"} Jul 06 19:34:33.782137 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:33.782090 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlf68" podStartSLOduration=17.686264378 podStartE2EDuration="19.782076515s" totalImagesPullingTime="2.095812137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:33.781103399 +0000 UTC m=+106.080512845" watchObservedRunningTime="2026-07-06 19:34:33.782076515 +0000 UTC m=+106.081485995" Jul 06 19:34:36.163832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.163798 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:36.164289 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.163846 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:36.164359 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.164341 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a0956ea-4a11-4730-bca6-0014cfc80628-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:36.166063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.166032 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a0956ea-4a11-4730-bca6-0014cfc80628-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkhlm\" (UID: \"4a0956ea-4a11-4730-bca6-0014cfc80628\") " pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:36.198598 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.198577 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tkhlm" Jul 06 19:34:36.331909 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.331883 2585 scope.go:117] "RemoveContainer" containerID="8ac021a8c180c1eab606cea5c3c29ca40d30e2434f0c03b2a11f9d7530e62318" Jul 06 19:34:36.342926 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.342902 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tkhlm"] Jul 06 19:34:36.345618 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:36.345588 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0956ea_4a11_4730_bca6_0014cfc80628.slice/crio-3db5f20f2b9dfc420594431443c21dc9c9459a17b5663602138371ec9a36185c WatchSource:0}: Error finding container 3db5f20f2b9dfc420594431443c21dc9c9459a17b5663602138371ec9a36185c: Status 404 returned error can't find the container with id 3db5f20f2b9dfc420594431443c21dc9c9459a17b5663602138371ec9a36185c Jul 06 19:34:36.772441 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.772418 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:34:36.772594 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.772509 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" event={"ID":"944f0118-0a65-4e59-9a79-048b620fb8b6","Type":"ContainerStarted","Data":"b519eb08bcbe2258bb53090028834d6b698a563899db13df06371b3c3d5ba9e3"} Jul 06 19:34:36.772952 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.772819 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:36.773857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.773832 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkhlm" event={"ID":"4a0956ea-4a11-4730-bca6-0014cfc80628","Type":"ContainerStarted","Data":"3db5f20f2b9dfc420594431443c21dc9c9459a17b5663602138371ec9a36185c"} Jul 06 19:34:36.794353 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:36.794314 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" podStartSLOduration=20.753106717 podStartE2EDuration="22.794296387s" totalImagesPullingTime="2.04118967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:36.793776898 +0000 UTC m=+109.093186343" watchObservedRunningTime="2026-07-06 19:34:36.794296387 +0000 UTC m=+109.093705832" Jul 06 19:34:37.772858 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:37.772820 2585 patch_prober.go:28] interesting pod/console-operator-68b757fb67-9q4nt container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.8:8443/readyz\": context deadline exceeded" start-of-body= Jul 06 19:34:37.773331 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:37.772884 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" podUID="944f0118-0a65-4e59-9a79-048b620fb8b6" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.8:8443/readyz\": context deadline exceeded" Jul 06 19:34:38.712128 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:38.712087 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-9q4nt" Jul 06 19:34:40.788726 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:40.788691 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkhlm" event={"ID":"4a0956ea-4a11-4730-bca6-0014cfc80628","Type":"ContainerStarted","Data":"1950eadaa0f3334fee39b729fc676cf56a3206b9ce24a29bd3295b3271dec424"} Jul 06 19:34:41.759749 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:41.759715 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2s449" Jul 06 19:34:41.794584 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:41.794547 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkhlm" event={"ID":"4a0956ea-4a11-4730-bca6-0014cfc80628","Type":"ContainerStarted","Data":"b1d3e733f3b75cdac7c64c76487ff2f9c827e52c6a942210afcf2dbb59ec7f09"} Jul 06 19:34:42.638967 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.638936 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5dj27"] Jul 06 19:34:42.645858 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.645833 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf99c7d9-j8lt9"] Jul 06 19:34:42.645985 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.645967 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:34:42.648782 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.648759 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pndlh\"" Jul 06 19:34:42.649062 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.649043 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:34:42.649442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.649415 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:34:42.651266 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.651247 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.654367 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.654088 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:34:42.654367 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.654272 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:34:42.655188 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.654719 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:34:42.655188 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.654821 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rqjk7\"" Jul 06 19:34:42.655947 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.655659 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5dj27"] Jul 06 19:34:42.667015 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.666991 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:34:42.671875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.671851 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf99c7d9-j8lt9"] Jul 06 19:34:42.716639 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716609 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-bound-sa-token\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.716783 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716669 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckcf\" (UniqueName: \"kubernetes.io/projected/9eb87134-db89-491b-aa77-a155e61e2fc1-kube-api-access-cckcf\") pod \"downloads-685bfb5f64-5dj27\" (UID: \"9eb87134-db89-491b-aa77-a155e61e2fc1\") " pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:34:42.716783 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716697 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1244e89-cd55-4bcb-93a4-2145592efdb7-installation-pull-secrets\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.716783 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716762 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1244e89-cd55-4bcb-93a4-2145592efdb7-image-registry-private-configuration\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.716951 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716797 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1244e89-cd55-4bcb-93a4-2145592efdb7-ca-trust-extracted\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.716951 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716822 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1244e89-cd55-4bcb-93a4-2145592efdb7-trusted-ca\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.716951 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.716899 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1244e89-cd55-4bcb-93a4-2145592efdb7-registry-certificates\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.717084 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.717006 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jn6r\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-kube-api-access-5jn6r\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.717145 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.717082 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-registry-tls\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.817642 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817613 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-bound-sa-token\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817657 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cckcf\" (UniqueName: \"kubernetes.io/projected/9eb87134-db89-491b-aa77-a155e61e2fc1-kube-api-access-cckcf\") pod \"downloads-685bfb5f64-5dj27\" (UID: \"9eb87134-db89-491b-aa77-a155e61e2fc1\") " pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817681 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1244e89-cd55-4bcb-93a4-2145592efdb7-installation-pull-secrets\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1244e89-cd55-4bcb-93a4-2145592efdb7-image-registry-private-configuration\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817800 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1244e89-cd55-4bcb-93a4-2145592efdb7-ca-trust-extracted\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817848 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1244e89-cd55-4bcb-93a4-2145592efdb7-trusted-ca\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817898 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1244e89-cd55-4bcb-93a4-2145592efdb7-registry-certificates\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.817952 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jn6r\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-kube-api-access-5jn6r\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.818006 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-registry-tls\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.818821 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.818756 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1244e89-cd55-4bcb-93a4-2145592efdb7-ca-trust-extracted\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.819008 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.818988 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1244e89-cd55-4bcb-93a4-2145592efdb7-registry-certificates\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.819109 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.818991 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1244e89-cd55-4bcb-93a4-2145592efdb7-trusted-ca\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.820636 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.820613 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1244e89-cd55-4bcb-93a4-2145592efdb7-image-registry-private-configuration\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.820725 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.820680 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1244e89-cd55-4bcb-93a4-2145592efdb7-installation-pull-secrets\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.820951 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.820927 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-registry-tls\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.832422 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.832396 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jn6r\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-kube-api-access-5jn6r\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.832528 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.832504 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckcf\" (UniqueName: \"kubernetes.io/projected/9eb87134-db89-491b-aa77-a155e61e2fc1-kube-api-access-cckcf\") pod \"downloads-685bfb5f64-5dj27\" (UID: \"9eb87134-db89-491b-aa77-a155e61e2fc1\") " pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:34:42.833300 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.833277 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1244e89-cd55-4bcb-93a4-2145592efdb7-bound-sa-token\") pod \"image-registry-6cf99c7d9-j8lt9\" (UID: \"d1244e89-cd55-4bcb-93a4-2145592efdb7\") " pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:42.960019 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.959986 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:34:42.971369 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:42.971345 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:43.449440 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.449418 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5dj27"] Jul 06 19:34:43.452989 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:43.452967 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb87134_db89_491b_aa77_a155e61e2fc1.slice/crio-a4ef17316093b3dab08820475016c63a0f6988b04b42baeb3356f0de2b0f8463 WatchSource:0}: Error finding container a4ef17316093b3dab08820475016c63a0f6988b04b42baeb3356f0de2b0f8463: Status 404 returned error can't find the container with id a4ef17316093b3dab08820475016c63a0f6988b04b42baeb3356f0de2b0f8463 Jul 06 19:34:43.467464 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.467443 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf99c7d9-j8lt9"] Jul 06 19:34:43.470345 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:43.470325 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1244e89_cd55_4bcb_93a4_2145592efdb7.slice/crio-f7ad58ca0ab549fc6a7bdc812e8fba9e37e52466e69965ebff6bc707c2340b0c WatchSource:0}: Error finding container f7ad58ca0ab549fc6a7bdc812e8fba9e37e52466e69965ebff6bc707c2340b0c: Status 404 returned error can't find the container with id f7ad58ca0ab549fc6a7bdc812e8fba9e37e52466e69965ebff6bc707c2340b0c Jul 06 19:34:43.802680 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.802641 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkhlm" event={"ID":"4a0956ea-4a11-4730-bca6-0014cfc80628","Type":"ContainerStarted","Data":"7a8e5d8b1de262c5baf7623355bb8e26c2ecf71102fc05e0dc9f8521d7481ccf"} Jul 06 19:34:43.803813 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.803788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5dj27" event={"ID":"9eb87134-db89-491b-aa77-a155e61e2fc1","Type":"ContainerStarted","Data":"a4ef17316093b3dab08820475016c63a0f6988b04b42baeb3356f0de2b0f8463"} Jul 06 19:34:43.805129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.805106 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" event={"ID":"d1244e89-cd55-4bcb-93a4-2145592efdb7","Type":"ContainerStarted","Data":"69593db352e29405ca1c0d1a369b9e9142f395918ffcd1e7c7aed3893d40fb37"} Jul 06 19:34:43.805254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.805143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" event={"ID":"d1244e89-cd55-4bcb-93a4-2145592efdb7","Type":"ContainerStarted","Data":"f7ad58ca0ab549fc6a7bdc812e8fba9e37e52466e69965ebff6bc707c2340b0c"} Jul 06 19:34:43.805254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.805196 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:34:43.822844 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.822798 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tkhlm" podStartSLOduration=16.913773289 podStartE2EDuration="23.822784261s" totalImagesPullingTime="6.909010972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:34:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:43.821426726 +0000 UTC m=+116.120836173" watchObservedRunningTime="2026-07-06 19:34:43.822784261 +0000 UTC m=+116.122193684" Jul 06 19:34:43.843664 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:43.842654 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" podStartSLOduration=1.842632138 podStartE2EDuration="1.842632138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:43.842034833 +0000 UTC m=+116.141444279" watchObservedRunningTime="2026-07-06 19:34:43.842632138 +0000 UTC m=+116.142041585" Jul 06 19:34:46.550460 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.550365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:46.550460 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.550433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:46.552772 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.551258 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c88a7-f17d-4551-a5a6-75a306567711-service-ca-bundle\") pod \"router-default-6869767d5-ltf8v\" (UID: \"e08c88a7-f17d-4551-a5a6-75a306567711\") " pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:46.554378 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.553374 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2babca22-b684-4714-b7e2-30fe26e57bd3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lrgdn\" (UID: \"2babca22-b684-4714-b7e2-30fe26e57bd3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:46.777164 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.777118 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" Jul 06 19:34:46.782077 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.782053 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:46.914815 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.914766 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn"] Jul 06 19:34:46.918756 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:46.918720 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2babca22_b684_4714_b7e2_30fe26e57bd3.slice/crio-3e45a38c0eea94b55fbf01f2549751401eff8a8f448362a3821c65d30a9854ee WatchSource:0}: Error finding container 3e45a38c0eea94b55fbf01f2549751401eff8a8f448362a3821c65d30a9854ee: Status 404 returned error can't find the container with id 3e45a38c0eea94b55fbf01f2549751401eff8a8f448362a3821c65d30a9854ee Jul 06 19:34:46.928818 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:46.928792 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6869767d5-ltf8v"] Jul 06 19:34:46.932040 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:46.932014 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08c88a7_f17d_4551_a5a6_75a306567711.slice/crio-b38eb36852150a74037c3301fc416d4fec03836b7df31897e679eca18f284526 WatchSource:0}: Error finding container b38eb36852150a74037c3301fc416d4fec03836b7df31897e679eca18f284526: Status 404 returned error can't find the container with id b38eb36852150a74037c3301fc416d4fec03836b7df31897e679eca18f284526 Jul 06 19:34:47.822313 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:47.822270 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6869767d5-ltf8v" event={"ID":"e08c88a7-f17d-4551-a5a6-75a306567711","Type":"ContainerStarted","Data":"141f7f793d92c84b4ca4e114990704fd3e403eca7b76d75f5a426eb3458c1492"} Jul 06 19:34:47.822767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:47.822334 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6869767d5-ltf8v" event={"ID":"e08c88a7-f17d-4551-a5a6-75a306567711","Type":"ContainerStarted","Data":"b38eb36852150a74037c3301fc416d4fec03836b7df31897e679eca18f284526"} Jul 06 19:34:47.823836 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:47.823807 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" event={"ID":"2babca22-b684-4714-b7e2-30fe26e57bd3","Type":"ContainerStarted","Data":"3e45a38c0eea94b55fbf01f2549751401eff8a8f448362a3821c65d30a9854ee"} Jul 06 19:34:47.848409 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:47.848353 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6869767d5-ltf8v" podStartSLOduration=33.848333979 podStartE2EDuration="33.848333979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:47.8472224 +0000 UTC m=+120.146631848" watchObservedRunningTime="2026-07-06 19:34:47.848333979 +0000 UTC m=+120.147743423" Jul 06 19:34:48.782979 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:48.782917 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:48.787174 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:48.786918 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:48.827666 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:48.827639 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:48.828904 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:48.828881 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6869767d5-ltf8v" Jul 06 19:34:49.669807 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.669773 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs"] Jul 06 19:34:49.672670 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.672653 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:49.675093 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.675073 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:34:49.675247 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.675222 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dg9lc\"" Jul 06 19:34:49.683406 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.683382 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs"] Jul 06 19:34:49.777496 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.777460 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7cf98094-d3b2-4915-ac00-f698f619b114-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-jqpvs\" (UID: \"7cf98094-d3b2-4915-ac00-f698f619b114\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:49.833472 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.833428 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" event={"ID":"2babca22-b684-4714-b7e2-30fe26e57bd3","Type":"ContainerStarted","Data":"2c807318afccc3ec65d4e6a59a0bdb4d6b2bd0f70ba4bcb384d983b748e11e5d"} Jul 06 19:34:49.853052 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.853009 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lrgdn" podStartSLOduration=33.649636838 podStartE2EDuration="35.852992817s" totalImagesPullingTime="2.203355979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:49.851845185 +0000 UTC m=+122.151254645" watchObservedRunningTime="2026-07-06 19:34:49.852992817 +0000 UTC m=+122.152402263" Jul 06 19:34:49.877848 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.877817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7cf98094-d3b2-4915-ac00-f698f619b114-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-jqpvs\" (UID: \"7cf98094-d3b2-4915-ac00-f698f619b114\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:49.880877 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.880859 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7cf98094-d3b2-4915-ac00-f698f619b114-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-jqpvs\" (UID: \"7cf98094-d3b2-4915-ac00-f698f619b114\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:49.982166 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:49.982055 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:50.125776 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:50.125743 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs"] Jul 06 19:34:50.129514 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:50.129478 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf98094_d3b2_4915_ac00_f698f619b114.slice/crio-41687a418b161391409347aaaad4bb866edb75dfa953c9b7f3f8f2c7d6d43c19 WatchSource:0}: Error finding container 41687a418b161391409347aaaad4bb866edb75dfa953c9b7f3f8f2c7d6d43c19: Status 404 returned error can't find the container with id 41687a418b161391409347aaaad4bb866edb75dfa953c9b7f3f8f2c7d6d43c19 Jul 06 19:34:50.838964 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:50.838929 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" event={"ID":"7cf98094-d3b2-4915-ac00-f698f619b114","Type":"ContainerStarted","Data":"41687a418b161391409347aaaad4bb866edb75dfa953c9b7f3f8f2c7d6d43c19"} Jul 06 19:34:51.845984 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:51.845922 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" event={"ID":"7cf98094-d3b2-4915-ac00-f698f619b114","Type":"ContainerStarted","Data":"6902ab831b1ab62f5d2dc70fa71a2f664e6e8c0ebb74fdae558fe8b9c14dbf1d"} Jul 06 19:34:51.846526 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:51.846008 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:51.852142 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:51.852114 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" Jul 06 19:34:51.863824 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:51.863750 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-jqpvs" podStartSLOduration=1.661567637 podStartE2EDuration="2.863730239s" totalImagesPullingTime="1.202162602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:51.862883062 +0000 UTC m=+124.162292510" watchObservedRunningTime="2026-07-06 19:34:51.863730239 +0000 UTC m=+124.163139686" Jul 06 19:34:52.734800 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.734759 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-b887r"] Jul 06 19:34:52.737986 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.737970 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.741584 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.741565 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:34:52.741707 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.741564 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7rpkk\"" Jul 06 19:34:52.741707 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.741564 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 19:34:52.741798 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.741562 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 19:34:52.749838 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.749805 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-b887r"] Jul 06 19:34:52.802514 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.802487 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/970b0cea-b22c-410f-9918-711b30fa3666-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.802688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.802527 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/970b0cea-b22c-410f-9918-711b30fa3666-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.802688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.802551 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vkxp\" (UniqueName: \"kubernetes.io/projected/970b0cea-b22c-410f-9918-711b30fa3666-kube-api-access-2vkxp\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.802688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.802588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/970b0cea-b22c-410f-9918-711b30fa3666-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.903445 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.903414 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/970b0cea-b22c-410f-9918-711b30fa3666-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.903896 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.903476 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vkxp\" (UniqueName: \"kubernetes.io/projected/970b0cea-b22c-410f-9918-711b30fa3666-kube-api-access-2vkxp\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.903896 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.903527 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/970b0cea-b22c-410f-9918-711b30fa3666-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.903896 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.903599 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/970b0cea-b22c-410f-9918-711b30fa3666-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.904275 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.904220 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/970b0cea-b22c-410f-9918-711b30fa3666-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.906242 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.906216 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/970b0cea-b22c-410f-9918-711b30fa3666-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.906489 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.906468 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/970b0cea-b22c-410f-9918-711b30fa3666-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:52.912254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:52.912229 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vkxp\" (UniqueName: \"kubernetes.io/projected/970b0cea-b22c-410f-9918-711b30fa3666-kube-api-access-2vkxp\") pod \"prometheus-operator-567f7b8b7c-b887r\" (UID: \"970b0cea-b22c-410f-9918-711b30fa3666\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:53.047257 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:53.047179 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" Jul 06 19:34:53.198338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:53.198304 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-b887r"] Jul 06 19:34:53.201552 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:53.201522 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970b0cea_b22c_410f_9918_711b30fa3666.slice/crio-a49c97232ed7a8d7fc619c4c469f91e3684ef0e69d5a701d60e33d7d187da86f WatchSource:0}: Error finding container a49c97232ed7a8d7fc619c4c469f91e3684ef0e69d5a701d60e33d7d187da86f: Status 404 returned error can't find the container with id a49c97232ed7a8d7fc619c4c469f91e3684ef0e69d5a701d60e33d7d187da86f Jul 06 19:34:53.854445 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:53.854403 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" event={"ID":"970b0cea-b22c-410f-9918-711b30fa3666","Type":"ContainerStarted","Data":"a49c97232ed7a8d7fc619c4c469f91e3684ef0e69d5a701d60e33d7d187da86f"} Jul 06 19:34:54.016069 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.016034 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5bd84566-7kt6b"] Jul 06 19:34:54.019361 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.019342 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.022057 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.022039 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:34:54.022177 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.022138 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:34:54.022496 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.022481 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:34:54.023087 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.023067 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2c6df\"" Jul 06 19:34:54.024265 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.023302 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:34:54.024265 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.023492 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:34:54.043479 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.043416 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5bd84566-7kt6b"] Jul 06 19:34:54.114093 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.114015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-oauth-serving-cert\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.114093 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.114059 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-config\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.114093 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.114080 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-serving-cert\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.114390 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.114205 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-oauth-config\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.114390 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.114242 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-service-ca\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.114390 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.114329 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7mp\" (UniqueName: \"kubernetes.io/projected/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-kube-api-access-pg7mp\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.214869 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.214835 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-service-ca\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.214869 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.214873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7mp\" (UniqueName: \"kubernetes.io/projected/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-kube-api-access-pg7mp\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215054 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.214992 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-oauth-serving-cert\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215054 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.215034 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-config\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215139 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.215051 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-serving-cert\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215257 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.215235 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-oauth-config\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215681 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.215659 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-oauth-serving-cert\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.215699 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-service-ca\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.215764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.215740 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-config\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.217380 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.217360 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-serving-cert\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.217455 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.217426 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-oauth-config\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.225505 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.225481 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7mp\" (UniqueName: \"kubernetes.io/projected/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-kube-api-access-pg7mp\") pod \"console-7f5bd84566-7kt6b\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.333451 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.333405 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:34:54.792062 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.792010 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5bd84566-7kt6b"] Jul 06 19:34:54.800385 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:34:54.800354 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b298e35_18f5_4aa3_beec_2278a2f1b9fe.slice/crio-4656027bea9e0c76418549c4e9ecd9ceec1822fb8adb949298e96d034ad83bb2 WatchSource:0}: Error finding container 4656027bea9e0c76418549c4e9ecd9ceec1822fb8adb949298e96d034ad83bb2: Status 404 returned error can't find the container with id 4656027bea9e0c76418549c4e9ecd9ceec1822fb8adb949298e96d034ad83bb2 Jul 06 19:34:54.864607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.864380 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" event={"ID":"970b0cea-b22c-410f-9918-711b30fa3666","Type":"ContainerStarted","Data":"7cc52e42409ff514b82bc6f2b2a81ba86fac87f9f22f8fe75e850bc9ad775ca0"} Jul 06 19:34:54.864607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.864443 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" event={"ID":"970b0cea-b22c-410f-9918-711b30fa3666","Type":"ContainerStarted","Data":"853394caec87c6a02fbfe481702230ee66bd88c1f1d49c71d04354394c6faefc"} Jul 06 19:34:54.865733 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.865704 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5bd84566-7kt6b" event={"ID":"8b298e35-18f5-4aa3-beec-2278a2f1b9fe","Type":"ContainerStarted","Data":"4656027bea9e0c76418549c4e9ecd9ceec1822fb8adb949298e96d034ad83bb2"} Jul 06 19:34:54.884534 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:54.884332 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b887r" podStartSLOduration=1.39816838 podStartE2EDuration="2.884310877s" totalImagesPullingTime="1.486142497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:54.882508797 +0000 UTC m=+127.181918244" watchObservedRunningTime="2026-07-06 19:34:54.884310877 +0000 UTC m=+127.183720326" Jul 06 19:34:57.121238 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.121205 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qrxpz"] Jul 06 19:34:57.124536 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.124514 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.127687 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.127671 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:34:57.128567 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.128506 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:34:57.128890 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.128865 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4vfng\"" Jul 06 19:34:57.129162 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.129130 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:34:57.240232 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-wtmp\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240242 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63898b7-9382-4b5c-8548-ca8cbdd9c567-metrics-client-ca\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240285 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-sys\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240326 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-root\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-tls\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240378 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-textfile\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240634 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240412 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240634 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240437 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.240634 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.240549 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwb5\" (UniqueName: \"kubernetes.io/projected/d63898b7-9382-4b5c-8548-ca8cbdd9c567-kube-api-access-zwwb5\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341698 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-root\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341716 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-tls\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341747 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-textfile\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341777 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341793 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-root\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341810 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.341875 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwb5\" (UniqueName: \"kubernetes.io/projected/d63898b7-9382-4b5c-8548-ca8cbdd9c567-kube-api-access-zwwb5\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:57.341889 2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:34:57.341993 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-tls podName:d63898b7-9382-4b5c-8548-ca8cbdd9c567 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:57.841971796 +0000 UTC m=+130.141381226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-tls") pod "node-exporter-qrxpz" (UID: "d63898b7-9382-4b5c-8548-ca8cbdd9c567") : secret "node-exporter-tls" not found Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342014 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-wtmp\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.341898 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-wtmp\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342056 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63898b7-9382-4b5c-8548-ca8cbdd9c567-metrics-client-ca\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342100 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-sys\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342176 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-textfile\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342509 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342210 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d63898b7-9382-4b5c-8548-ca8cbdd9c567-sys\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342653 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342631 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.342718 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.342632 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63898b7-9382-4b5c-8548-ca8cbdd9c567-metrics-client-ca\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.344461 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.344439 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.354906 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.354879 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwb5\" (UniqueName: \"kubernetes.io/projected/d63898b7-9382-4b5c-8548-ca8cbdd9c567-kube-api-access-zwwb5\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.846654 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.846616 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-tls\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:57.849139 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:57.849114 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63898b7-9382-4b5c-8548-ca8cbdd9c567-node-exporter-tls\") pod \"node-exporter-qrxpz\" (UID: \"d63898b7-9382-4b5c-8548-ca8cbdd9c567\") " pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:58.036020 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:58.035986 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrxpz" Jul 06 19:34:59.223937 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.223898 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-bc569dc4c-jxspt"] Jul 06 19:34:59.227668 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.227643 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.230597 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.230506 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 19:34:59.230597 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.230513 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 19:34:59.230785 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.230688 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 19:34:59.230785 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.230716 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 19:34:59.230904 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.230699 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 19:34:59.230904 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.230844 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s4pps\"" Jul 06 19:34:59.231094 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.231072 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-24b5ejutd0v4u\"" Jul 06 19:34:59.243455 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.243428 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bc569dc4c-jxspt"] Jul 06 19:34:59.360004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.359963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-metrics-client-ca\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360090 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360123 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360170 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360371 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-grpc-tls\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360439 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360419 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9k9g\" (UniqueName: \"kubernetes.io/projected/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-kube-api-access-f9k9g\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.360498 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.360457 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-tls\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.431808 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.431775 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ff8bb8789-mkzls"] Jul 06 19:34:59.435189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.435164 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.460488 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.460458 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff8bb8789-mkzls"] Jul 06 19:34:59.460972 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.460948 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9k9g\" (UniqueName: \"kubernetes.io/projected/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-kube-api-access-f9k9g\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461055 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.460988 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-tls\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461055 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461044 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461174 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-metrics-client-ca\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461174 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461103 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461363 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461337 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461479 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461409 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461479 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461436 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-grpc-tls\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.461921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.461895 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-metrics-client-ca\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.464932 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.464645 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.464932 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.464888 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.465065 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.464938 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:34:59.465065 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.464983 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.465183 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.465125 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-tls\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.466224 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.466202 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-grpc-tls\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.467042 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.466995 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.486715 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.486644 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9k9g\" (UniqueName: \"kubernetes.io/projected/a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86-kube-api-access-f9k9g\") pod \"thanos-querier-bc569dc4c-jxspt\" (UID: \"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86\") " pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.540123 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.540059 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:34:59.562496 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-oauth-config\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.562631 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562518 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-oauth-serving-cert\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.562631 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562575 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-service-ca\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.562631 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562610 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-trusted-ca-bundle\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.562768 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562634 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-console-config\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.562768 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ngjz\" (UniqueName: \"kubernetes.io/projected/26efdeb5-73fd-44d3-abe1-9215fabed677-kube-api-access-6ngjz\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.562768 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.562696 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-serving-cert\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.663742 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.663704 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-oauth-serving-cert\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.663922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.663767 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-service-ca\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.663922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.663799 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-trusted-ca-bundle\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.663922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.663824 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-console-config\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.663922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.663853 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ngjz\" (UniqueName: \"kubernetes.io/projected/26efdeb5-73fd-44d3-abe1-9215fabed677-kube-api-access-6ngjz\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.664093 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.664024 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-serving-cert\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.664143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.664115 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-oauth-config\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.664630 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.664573 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-oauth-serving-cert\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.664630 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.664607 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-service-ca\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.664801 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.664771 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-trusted-ca-bundle\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.664950 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.664928 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-console-config\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.666742 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.666720 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-oauth-config\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.666856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.666758 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-serving-cert\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.679398 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.679377 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ngjz\" (UniqueName: \"kubernetes.io/projected/26efdeb5-73fd-44d3-abe1-9215fabed677-kube-api-access-6ngjz\") pod \"console-7ff8bb8789-mkzls\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:34:59.746034 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:34:59.745934 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:01.078925 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.078885 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:35:01.081377 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.081351 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f747e-ba5b-4fe8-aeda-e2e344c42f6b-metrics-certs\") pod \"network-metrics-daemon-xpfb4\" (UID: \"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b\") " pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:35:01.382232 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.382134 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9cds\"" Jul 06 19:35:01.389897 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.389870 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpfb4" Jul 06 19:35:01.516797 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.516768 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7668d6f949-9vmld"] Jul 06 19:35:01.519953 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.519933 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.524176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.523872 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:35:01.524176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.523954 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:35:01.524176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.523966 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6bmxv\"" Jul 06 19:35:01.524176 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.524025 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:35:01.524454 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.524200 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9dekustk11a17\"" Jul 06 19:35:01.524454 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.524417 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:35:01.532677 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.532655 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7668d6f949-9vmld"] Jul 06 19:35:01.582746 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.582713 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0fd4e780-977c-4fe7-9783-9c0496e3c450-audit-log\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.582936 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.582769 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0fd4e780-977c-4fe7-9783-9c0496e3c450-metrics-server-audit-profiles\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.582936 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.582856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-secret-metrics-server-tls\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.583050 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.582930 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-secret-metrics-server-client-certs\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.583050 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.582963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd4e780-977c-4fe7-9783-9c0496e3c450-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.583050 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.582989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzngw\" (UniqueName: \"kubernetes.io/projected/0fd4e780-977c-4fe7-9783-9c0496e3c450-kube-api-access-wzngw\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.583218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.583047 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-client-ca-bundle\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-secret-metrics-server-client-certs\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684564 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd4e780-977c-4fe7-9783-9c0496e3c450-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684696 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzngw\" (UniqueName: \"kubernetes.io/projected/0fd4e780-977c-4fe7-9783-9c0496e3c450-kube-api-access-wzngw\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684865 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684756 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-client-ca-bundle\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684865 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684832 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0fd4e780-977c-4fe7-9783-9c0496e3c450-audit-log\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684959 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684880 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0fd4e780-977c-4fe7-9783-9c0496e3c450-metrics-server-audit-profiles\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.684959 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.684920 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-secret-metrics-server-tls\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.685324 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.685269 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0fd4e780-977c-4fe7-9783-9c0496e3c450-audit-log\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.685446 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.685410 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd4e780-977c-4fe7-9783-9c0496e3c450-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.685850 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.685827 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0fd4e780-977c-4fe7-9783-9c0496e3c450-metrics-server-audit-profiles\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.687511 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.687467 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-secret-metrics-server-client-certs\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.687856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.687838 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-secret-metrics-server-tls\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.687928 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.687887 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd4e780-977c-4fe7-9783-9c0496e3c450-client-ca-bundle\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.693487 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.693465 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzngw\" (UniqueName: \"kubernetes.io/projected/0fd4e780-977c-4fe7-9783-9c0496e3c450-kube-api-access-wzngw\") pod \"metrics-server-7668d6f949-9vmld\" (UID: \"0fd4e780-977c-4fe7-9783-9c0496e3c450\") " pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:01.832187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:01.832137 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:03.032949 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.032917 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5bd84566-7kt6b"] Jul 06 19:35:03.586060 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.586023 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:35:03.601544 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.601474 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.606688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.604955 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cabubo0v6ghfs\"" Jul 06 19:35:03.606688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.606289 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:35:03.606688 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.606318 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:35:03.607010 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.606738 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:35:03.607010 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.606787 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:35:03.607119 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607022 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:35:03.607442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607217 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:35:03.607442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607282 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:35:03.607442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607303 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:35:03.607442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607307 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ktnnf\"" Jul 06 19:35:03.607442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607286 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:35:03.607442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607399 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:35:03.607834 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607534 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:35:03.607834 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607672 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:35:03.607946 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.607850 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:35:03.610026 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.610003 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:35:03.613191 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.613143 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:35:03.703018 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.702980 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703221 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703027 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703221 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703058 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703221 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703115 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703221 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703196 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703231 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703258 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703274 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703357 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703383 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703403 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703419 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703460 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703491 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhn9\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-kube-api-access-rnhn9\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703534 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703556 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703578 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703592 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703614 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.703752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.703689 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805118 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805081 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805118 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805121 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805190 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805217 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805243 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805266 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805295 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhn9\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-kube-api-access-rnhn9\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805360 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805843 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805384 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805843 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805418 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.805843 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805448 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806004 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.805952 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806066 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806009 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806123 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806110 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806200 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806183 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806255 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806221 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806305 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806305 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806413 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806338 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.806997 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.806933 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.807741 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.807713 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.808506 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.808196 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.808506 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.808365 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.808667 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.808549 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.809070 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.809035 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.809421 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.809299 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.809863 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.809837 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.810598 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.810289 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.811050 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.810759 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.811050 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.810794 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.811050 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.810911 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.811787 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.811697 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.811787 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.811712 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.813254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.812557 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.813254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.813129 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.813254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.813237 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.813754 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.813733 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.817014 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.816989 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhn9\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-kube-api-access-rnhn9\") pod \"prometheus-k8s-0\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:03.919331 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:03.919288 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:04.813386 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:04.813352 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf99c7d9-j8lt9" Jul 06 19:35:05.437124 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:35:05.437089 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63898b7_9382_4b5c_8548_ca8cbdd9c567.slice/crio-b349c36475cbe6d91e4c96c1bdbc742b611e872e4480a02f1dee7bca3fdd87ff WatchSource:0}: Error finding container b349c36475cbe6d91e4c96c1bdbc742b611e872e4480a02f1dee7bca3fdd87ff: Status 404 returned error can't find the container with id b349c36475cbe6d91e4c96c1bdbc742b611e872e4480a02f1dee7bca3fdd87ff Jul 06 19:35:05.680738 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.673781 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7668d6f949-9vmld"] Jul 06 19:35:05.695573 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:35:05.695520 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd4e780_977c_4fe7_9783_9c0496e3c450.slice/crio-5fcd061a429a754ff7b5f589da373c67832d5069ca9290271babae9bb254a126 WatchSource:0}: Error finding container 5fcd061a429a754ff7b5f589da373c67832d5069ca9290271babae9bb254a126: Status 404 returned error can't find the container with id 5fcd061a429a754ff7b5f589da373c67832d5069ca9290271babae9bb254a126 Jul 06 19:35:05.723372 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.718577 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff8bb8789-mkzls"] Jul 06 19:35:05.723704 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:35:05.723675 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26efdeb5_73fd_44d3_abe1_9215fabed677.slice/crio-23c4d8ee69779eb8395bc2c686ed91ddc0af9ed391765b71d38d95dc32f1961b WatchSource:0}: Error finding container 23c4d8ee69779eb8395bc2c686ed91ddc0af9ed391765b71d38d95dc32f1961b: Status 404 returned error can't find the container with id 23c4d8ee69779eb8395bc2c686ed91ddc0af9ed391765b71d38d95dc32f1961b Jul 06 19:35:05.745573 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.745500 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xpfb4"] Jul 06 19:35:05.747501 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:35:05.747425 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34f747e_ba5b_4fe8_aeda_e2e344c42f6b.slice/crio-a6cef2528ccaaebaec13e225e4d3c8b9b2f7bf71ea2940ab35c305636b39b61a WatchSource:0}: Error finding container a6cef2528ccaaebaec13e225e4d3c8b9b2f7bf71ea2940ab35c305636b39b61a: Status 404 returned error can't find the container with id a6cef2528ccaaebaec13e225e4d3c8b9b2f7bf71ea2940ab35c305636b39b61a Jul 06 19:35:05.911761 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.911721 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5dj27" event={"ID":"9eb87134-db89-491b-aa77-a155e61e2fc1","Type":"ContainerStarted","Data":"e8a221950c3590fd15e9d0412ec81b89813bdd0ea6a96dffb0564cc63d504ee7"} Jul 06 19:35:05.912224 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.911921 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:35:05.913218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.913180 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" event={"ID":"0fd4e780-977c-4fe7-9783-9c0496e3c450","Type":"ContainerStarted","Data":"5fcd061a429a754ff7b5f589da373c67832d5069ca9290271babae9bb254a126"} Jul 06 19:35:05.913826 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.913795 2585 patch_prober.go:28] interesting pod/downloads-685bfb5f64-5dj27 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body= Jul 06 19:35:05.913946 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.913848 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-5dj27" podUID="9eb87134-db89-491b-aa77-a155e61e2fc1" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" Jul 06 19:35:05.915032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.915004 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff8bb8789-mkzls" event={"ID":"26efdeb5-73fd-44d3-abe1-9215fabed677","Type":"ContainerStarted","Data":"705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68"} Jul 06 19:35:05.915181 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.915051 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff8bb8789-mkzls" event={"ID":"26efdeb5-73fd-44d3-abe1-9215fabed677","Type":"ContainerStarted","Data":"23c4d8ee69779eb8395bc2c686ed91ddc0af9ed391765b71d38d95dc32f1961b"} Jul 06 19:35:05.916812 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.916787 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5bd84566-7kt6b" event={"ID":"8b298e35-18f5-4aa3-beec-2278a2f1b9fe","Type":"ContainerStarted","Data":"13c4179b8a4f90aaea3bc6f193a830af9434d9299c0da0c1a3aee6921c4e1f95"} Jul 06 19:35:05.918207 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.918184 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpfb4" event={"ID":"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b","Type":"ContainerStarted","Data":"a6cef2528ccaaebaec13e225e4d3c8b9b2f7bf71ea2940ab35c305636b39b61a"} Jul 06 19:35:05.919487 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.919466 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrxpz" event={"ID":"d63898b7-9382-4b5c-8548-ca8cbdd9c567","Type":"ContainerStarted","Data":"b349c36475cbe6d91e4c96c1bdbc742b611e872e4480a02f1dee7bca3fdd87ff"} Jul 06 19:35:05.937103 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.937006 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5dj27" podStartSLOduration=1.931678421 podStartE2EDuration="23.936991938s" totalImagesPullingTime="22.005313517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:05.934933663 +0000 UTC m=+138.234343111" watchObservedRunningTime="2026-07-06 19:35:05.936991938 +0000 UTC m=+138.236401383" Jul 06 19:35:05.962096 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.962061 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:35:05.964003 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.963959 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5bd84566-7kt6b" podStartSLOduration=2.326843155 podStartE2EDuration="12.963940716s" totalImagesPullingTime="10.637097561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:05.962705603 +0000 UTC m=+138.262115050" watchObservedRunningTime="2026-07-06 19:35:05.963940716 +0000 UTC m=+138.263350164" Jul 06 19:35:05.966348 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.966325 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bc569dc4c-jxspt"] Jul 06 19:35:05.967666 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:35:05.967637 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f20d47a_4fb1_4bd2_abbd_b8f4b388ecf4.slice/crio-8e6135de1ef7775becbc269bb41d554c5602c53320953d3281b8504a8f02a459 WatchSource:0}: Error finding container 8e6135de1ef7775becbc269bb41d554c5602c53320953d3281b8504a8f02a459: Status 404 returned error can't find the container with id 8e6135de1ef7775becbc269bb41d554c5602c53320953d3281b8504a8f02a459 Jul 06 19:35:05.969352 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:35:05.969311 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ebb3d8_3b20_48a9_9e1b_b144e0a1cd86.slice/crio-f3763a9d33266e87e6576a9e75804550ae27f7c833b71479bae4b2d6a97be024 WatchSource:0}: Error finding container f3763a9d33266e87e6576a9e75804550ae27f7c833b71479bae4b2d6a97be024: Status 404 returned error can't find the container with id f3763a9d33266e87e6576a9e75804550ae27f7c833b71479bae4b2d6a97be024 Jul 06 19:35:05.989388 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:05.989345 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ff8bb8789-mkzls" podStartSLOduration=6.989328469 podStartE2EDuration="6.989328469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:05.988222451 +0000 UTC m=+138.287631898" watchObservedRunningTime="2026-07-06 19:35:05.989328469 +0000 UTC m=+138.288737914" Jul 06 19:35:06.935426 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:06.935314 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"f3763a9d33266e87e6576a9e75804550ae27f7c833b71479bae4b2d6a97be024"} Jul 06 19:35:06.939777 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:06.938927 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"8e6135de1ef7775becbc269bb41d554c5602c53320953d3281b8504a8f02a459"} Jul 06 19:35:06.950382 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:06.950139 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5dj27" Jul 06 19:35:09.746733 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:09.746683 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:09.747227 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:09.746777 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:09.752194 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:09.752165 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:09.958896 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:09.958800 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:10.961066 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.961028 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" event={"ID":"0fd4e780-977c-4fe7-9783-9c0496e3c450","Type":"ContainerStarted","Data":"98d58af1eaa45fb3402810d8c636b99c2f0e5a203c453c11bd36533841d5e523"} Jul 06 19:35:10.963275 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.963244 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84" exitCode=0 Jul 06 19:35:10.963413 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.963336 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84"} Jul 06 19:35:10.966132 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.966105 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpfb4" event={"ID":"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b","Type":"ContainerStarted","Data":"fc96555f9d860c32b3832a87cc7205af62c3292599d736b322ce5f0f1376a695"} Jul 06 19:35:10.966256 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.966205 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpfb4" event={"ID":"e34f747e-ba5b-4fe8-aeda-e2e344c42f6b","Type":"ContainerStarted","Data":"08f5066f8057e6af4ffc735cc55a49efdbdcf424880829fb7fd0de83fb7b98d6"} Jul 06 19:35:10.968120 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.968097 2585 generic.go:356] "Generic (PLEG): container finished" podID="d63898b7-9382-4b5c-8548-ca8cbdd9c567" containerID="183929767bf4e9ede35ca56d0df40c07a793a2b5cdd92d8f4b2f788da1ac45de" exitCode=0 Jul 06 19:35:10.968227 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.968189 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrxpz" event={"ID":"d63898b7-9382-4b5c-8548-ca8cbdd9c567","Type":"ContainerDied","Data":"183929767bf4e9ede35ca56d0df40c07a793a2b5cdd92d8f4b2f788da1ac45de"} Jul 06 19:35:10.971556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.971013 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"690fb2f900aa6802cf22c3de366188ffa525da94b001807d3c00a06ddbc8c7cc"} Jul 06 19:35:10.971556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.971093 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"a4837675dc3c378160f18da7cd30c3bf7148b8d8d1abaec9d27e3e8ee5035a7b"} Jul 06 19:35:10.971556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.971137 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"cc84af00d135ee749f9089cc609e80fbd07861d1e13dbad1b032fd543ae2d472"} Jul 06 19:35:10.981453 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:10.981400 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" podStartSLOduration=5.632196414 podStartE2EDuration="9.981380014s" totalImagesPullingTime="4.3491836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:10.981137066 +0000 UTC m=+143.280546514" watchObservedRunningTime="2026-07-06 19:35:10.981380014 +0000 UTC m=+143.280789461" Jul 06 19:35:11.060486 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:11.060412 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xpfb4" podStartSLOduration=136.763461913 podStartE2EDuration="2m21.060385721s" totalImagesPullingTime="4.296923808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:11.058528531 +0000 UTC m=+143.357937979" watchObservedRunningTime="2026-07-06 19:35:11.060385721 +0000 UTC m=+143.359795168" Jul 06 19:35:11.981907 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:11.981872 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrxpz" event={"ID":"d63898b7-9382-4b5c-8548-ca8cbdd9c567","Type":"ContainerStarted","Data":"c3ab9ad5b1dc3103139d837f6f8c9ac14d75ee495c225be68c79d2c6c68aed73"} Jul 06 19:35:11.982463 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:11.981928 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrxpz" event={"ID":"d63898b7-9382-4b5c-8548-ca8cbdd9c567","Type":"ContainerStarted","Data":"162751b8744ece335898a7f9b7e1d790575e28eed0d47fb2717c50854bfe3773"} Jul 06 19:35:12.007288 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:12.007220 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qrxpz" podStartSLOduration=10.62146367 podStartE2EDuration="15.007195905s" totalImagesPullingTime="4.256618638s" totalInitContainerRuntime="129.113597ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:12.005101033 +0000 UTC m=+144.304510502" watchObservedRunningTime="2026-07-06 19:35:12.007195905 +0000 UTC m=+144.306605352" Jul 06 19:35:12.990097 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:12.990053 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"893cf377c62515943ff76d7271b26ed732b7d7c593ca3f0c2e5def573eb9bd80"} Jul 06 19:35:12.990583 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:12.990142 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"aa6978ef8c461c78304ad16b4f69f22698a587a57a0fb5958a1e036c587864ef"} Jul 06 19:35:12.990583 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:12.990212 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" event={"ID":"a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86","Type":"ContainerStarted","Data":"bba1042d383a0c7517716b750fbf5b281be7b1f342ddde7cefc47b06a9624423"} Jul 06 19:35:12.990583 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:12.990484 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:35:13.020441 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:13.020378 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" podStartSLOduration=8.287007413 podStartE2EDuration="14.020354203s" totalImagesPullingTime="5.73334679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:13.019331807 +0000 UTC m=+145.318741282" watchObservedRunningTime="2026-07-06 19:35:13.020354203 +0000 UTC m=+145.319763652" Jul 06 19:35:13.515891 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:13.515823 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff8bb8789-mkzls"] Jul 06 19:35:14.340026 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:14.339995 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:35:16.026475 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:16.026393 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16"} Jul 06 19:35:16.026856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:16.026480 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f"} Jul 06 19:35:16.026856 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:16.026522 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104"} Jul 06 19:35:17.033492 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:17.033453 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487"} Jul 06 19:35:17.033972 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:17.033519 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe"} Jul 06 19:35:17.033972 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:17.033552 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerStarted","Data":"45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f"} Jul 06 19:35:17.077245 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:17.077174 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.372068282 podStartE2EDuration="14.077132032s" totalImagesPullingTime="8.665072376s" totalInitContainerRuntime="39.991374ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:17.074715594 +0000 UTC m=+149.374125040" watchObservedRunningTime="2026-07-06 19:35:17.077132032 +0000 UTC m=+149.376541479" Jul 06 19:35:18.919660 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:18.919622 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:35:19.021486 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:19.021457 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-bc569dc4c-jxspt" Jul 06 19:35:21.832475 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:21.832435 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:21.832840 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:21.832495 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:30.938816 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:30.938775 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f5bd84566-7kt6b" podUID="8b298e35-18f5-4aa3-beec-2278a2f1b9fe" containerName="console" containerID="cri-o://13c4179b8a4f90aaea3bc6f193a830af9434d9299c0da0c1a3aee6921c4e1f95" gracePeriod=15 Jul 06 19:35:31.096972 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.096943 2585 generic.go:356] "Generic (PLEG): container finished" podID="8b298e35-18f5-4aa3-beec-2278a2f1b9fe" containerID="13c4179b8a4f90aaea3bc6f193a830af9434d9299c0da0c1a3aee6921c4e1f95" exitCode=0 Jul 06 19:35:31.097101 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.097019 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5bd84566-7kt6b" event={"ID":"8b298e35-18f5-4aa3-beec-2278a2f1b9fe","Type":"ContainerDied","Data":"13c4179b8a4f90aaea3bc6f193a830af9434d9299c0da0c1a3aee6921c4e1f95"} Jul 06 19:35:31.218857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.218788 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:35:31.265212 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265185 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-config\") pod \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " Jul 06 19:35:31.265385 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265226 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-service-ca\") pod \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " Jul 06 19:35:31.265385 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265245 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-oauth-config\") pod \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " Jul 06 19:35:31.265385 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265270 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-serving-cert\") pod \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " Jul 06 19:35:31.265385 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265292 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-oauth-serving-cert\") pod \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " Jul 06 19:35:31.265385 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265353 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg7mp\" (UniqueName: \"kubernetes.io/projected/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-kube-api-access-pg7mp\") pod \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\" (UID: \"8b298e35-18f5-4aa3-beec-2278a2f1b9fe\") " Jul 06 19:35:31.265681 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265642 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b298e35-18f5-4aa3-beec-2278a2f1b9fe" (UID: "8b298e35-18f5-4aa3-beec-2278a2f1b9fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:31.265748 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265654 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-config" (OuterVolumeSpecName: "console-config") pod "8b298e35-18f5-4aa3-beec-2278a2f1b9fe" (UID: "8b298e35-18f5-4aa3-beec-2278a2f1b9fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:31.265806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.265756 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b298e35-18f5-4aa3-beec-2278a2f1b9fe" (UID: "8b298e35-18f5-4aa3-beec-2278a2f1b9fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:31.267568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.267534 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b298e35-18f5-4aa3-beec-2278a2f1b9fe" (UID: "8b298e35-18f5-4aa3-beec-2278a2f1b9fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:35:31.267687 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.267587 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b298e35-18f5-4aa3-beec-2278a2f1b9fe" (UID: "8b298e35-18f5-4aa3-beec-2278a2f1b9fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:35:31.267687 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.267649 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-kube-api-access-pg7mp" (OuterVolumeSpecName: "kube-api-access-pg7mp") pod "8b298e35-18f5-4aa3-beec-2278a2f1b9fe" (UID: "8b298e35-18f5-4aa3-beec-2278a2f1b9fe"). InnerVolumeSpecName "kube-api-access-pg7mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:31.365929 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.365901 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-config\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:31.365929 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.365926 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-service-ca\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:31.366079 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.365937 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-oauth-config\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:31.366079 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.365951 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-console-serving-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:31.366079 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.365963 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-oauth-serving-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:31.366079 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:31.365974 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg7mp\" (UniqueName: \"kubernetes.io/projected/8b298e35-18f5-4aa3-beec-2278a2f1b9fe-kube-api-access-pg7mp\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:32.107061 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:32.107032 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5bd84566-7kt6b" Jul 06 19:35:32.107447 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:32.107034 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5bd84566-7kt6b" event={"ID":"8b298e35-18f5-4aa3-beec-2278a2f1b9fe","Type":"ContainerDied","Data":"4656027bea9e0c76418549c4e9ecd9ceec1822fb8adb949298e96d034ad83bb2"} Jul 06 19:35:32.107447 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:32.107197 2585 scope.go:117] "RemoveContainer" containerID="13c4179b8a4f90aaea3bc6f193a830af9434d9299c0da0c1a3aee6921c4e1f95" Jul 06 19:35:32.129498 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:32.129476 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5bd84566-7kt6b"] Jul 06 19:35:32.133088 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:32.133067 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5bd84566-7kt6b"] Jul 06 19:35:32.336740 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:32.336706 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b298e35-18f5-4aa3-beec-2278a2f1b9fe" path="/var/lib/kubelet/pods/8b298e35-18f5-4aa3-beec-2278a2f1b9fe/volumes" Jul 06 19:35:38.545283 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.545241 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ff8bb8789-mkzls" podUID="26efdeb5-73fd-44d3-abe1-9215fabed677" containerName="console" containerID="cri-o://705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68" gracePeriod=15 Jul 06 19:35:38.838397 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.838368 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:38.931542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931506 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-trusted-ca-bundle\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.931542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931541 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-oauth-serving-cert\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.931774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931573 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-console-config\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.931774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931596 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ngjz\" (UniqueName: \"kubernetes.io/projected/26efdeb5-73fd-44d3-abe1-9215fabed677-kube-api-access-6ngjz\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.931774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931638 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-oauth-config\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.931774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931664 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-serving-cert\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.931774 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931693 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-service-ca\") pod \"26efdeb5-73fd-44d3-abe1-9215fabed677\" (UID: \"26efdeb5-73fd-44d3-abe1-9215fabed677\") " Jul 06 19:35:38.932032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.931966 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:38.932090 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.932033 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-console-config" (OuterVolumeSpecName: "console-config") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:38.932258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.932233 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-service-ca" (OuterVolumeSpecName: "service-ca") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:38.932394 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.932373 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:38.933807 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.933775 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:35:38.934253 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.934224 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:35:38.934347 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:38.934253 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26efdeb5-73fd-44d3-abe1-9215fabed677-kube-api-access-6ngjz" (OuterVolumeSpecName: "kube-api-access-6ngjz") pod "26efdeb5-73fd-44d3-abe1-9215fabed677" (UID: "26efdeb5-73fd-44d3-abe1-9215fabed677"). InnerVolumeSpecName "kube-api-access-6ngjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:39.033325 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033292 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-console-config\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.033325 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033323 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ngjz\" (UniqueName: \"kubernetes.io/projected/26efdeb5-73fd-44d3-abe1-9215fabed677-kube-api-access-6ngjz\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.033545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033337 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-oauth-config\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.033545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033349 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efdeb5-73fd-44d3-abe1-9215fabed677-console-serving-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.033545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033360 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-service-ca\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.033545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033373 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-trusted-ca-bundle\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.033545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.033384 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efdeb5-73fd-44d3-abe1-9215fabed677-oauth-serving-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:35:39.135580 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.135479 2585 generic.go:356] "Generic (PLEG): container finished" podID="26efdeb5-73fd-44d3-abe1-9215fabed677" containerID="705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68" exitCode=0 Jul 06 19:35:39.135580 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.135523 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff8bb8789-mkzls" Jul 06 19:35:39.135580 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.135530 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff8bb8789-mkzls" event={"ID":"26efdeb5-73fd-44d3-abe1-9215fabed677","Type":"ContainerDied","Data":"705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68"} Jul 06 19:35:39.135785 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.135593 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff8bb8789-mkzls" event={"ID":"26efdeb5-73fd-44d3-abe1-9215fabed677","Type":"ContainerDied","Data":"23c4d8ee69779eb8395bc2c686ed91ddc0af9ed391765b71d38d95dc32f1961b"} Jul 06 19:35:39.135785 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.135613 2585 scope.go:117] "RemoveContainer" containerID="705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68" Jul 06 19:35:39.144349 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.144331 2585 scope.go:117] "RemoveContainer" containerID="705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68" Jul 06 19:35:39.144606 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:35:39.144587 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68\": container with ID starting with 705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68 not found: ID does not exist" containerID="705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68" Jul 06 19:35:39.144649 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.144615 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68"} err="failed to get container status \"705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68\": rpc error: code = NotFound desc = could not find container \"705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68\": container with ID starting with 705dfbbc90cae4bb7f3350d5cb6afba0f12e822a16dbe00b878920d367d61d68 not found: ID does not exist" Jul 06 19:35:39.157704 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.157679 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff8bb8789-mkzls"] Jul 06 19:35:39.158948 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:39.158924 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ff8bb8789-mkzls"] Jul 06 19:35:40.337481 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:40.337450 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26efdeb5-73fd-44d3-abe1-9215fabed677" path="/var/lib/kubelet/pods/26efdeb5-73fd-44d3-abe1-9215fabed677/volumes" Jul 06 19:35:41.838304 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:41.838276 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:35:41.841990 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:35:41.841968 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7668d6f949-9vmld" Jul 06 19:36:03.920354 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:03.920322 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:03.936007 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:03.935982 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:04.272335 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:04.272256 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:22.025045 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.025004 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:36:22.026024 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.025972 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="prometheus" containerID="cri-o://f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104" gracePeriod=600 Jul 06 19:36:22.026210 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.025995 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="thanos-sidecar" containerID="cri-o://19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16" gracePeriod=600 Jul 06 19:36:22.026307 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.026023 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-web" containerID="cri-o://45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f" gracePeriod=600 Jul 06 19:36:22.026367 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.026007 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy" containerID="cri-o://4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe" gracePeriod=600 Jul 06 19:36:22.026430 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.026039 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487" gracePeriod=600 Jul 06 19:36:22.026488 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.026020 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="config-reloader" containerID="cri-o://0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f" gracePeriod=600 Jul 06 19:36:22.316804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316721 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487" exitCode=0 Jul 06 19:36:22.316804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316746 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe" exitCode=0 Jul 06 19:36:22.316804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316754 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16" exitCode=0 Jul 06 19:36:22.316804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316761 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f" exitCode=0 Jul 06 19:36:22.316804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316767 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104" exitCode=0 Jul 06 19:36:22.316804 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316791 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487"} Jul 06 19:36:22.317088 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316884 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe"} Jul 06 19:36:22.317088 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316914 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16"} Jul 06 19:36:22.317088 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316937 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f"} Jul 06 19:36:22.317088 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:22.316961 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104"} Jul 06 19:36:23.274767 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.274739 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.310089 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310068 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-web-config\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310215 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310096 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310215 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310132 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-metrics-client-certs\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310215 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310169 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310291 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-0\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310338 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310473 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310366 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-kube-rbac-proxy\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310651 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310626 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-kubelet-serving-ca-bundle\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310736 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310672 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-tls-assets\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310736 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310715 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-2\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.310840 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.310745 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-trusted-ca-bundle\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311657 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config-out\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311703 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-serving-certs-ca-bundle\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311733 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-thanos-prometheus-http-client-file\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311761 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-db\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311794 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-1\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311814 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311829 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnhn9\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-kube-api-access-rnhn9\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311883 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-grpc-tls\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311913 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-tls\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.311949 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-metrics-client-ca\") pod \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\" (UID: \"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4\") " Jul 06 19:36:23.313342 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.312387 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.313921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.313484 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.313921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.313519 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.313921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.313543 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.313921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.313860 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.314732 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.314244 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.315122 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.314965 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.315122 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.315034 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config" (OuterVolumeSpecName: "config") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.315122 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.315110 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:36:23.315434 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.315190 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.315594 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.315570 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:23.316274 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.316237 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:36:23.316617 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.316588 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config-out" (OuterVolumeSpecName: "config-out") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:36:23.316724 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.316595 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.317185 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.317070 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.317185 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.317090 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.317185 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.317132 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.318185 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.318010 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.318185 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.318128 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.319664 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.318987 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-kube-api-access-rnhn9" (OuterVolumeSpecName: "kube-api-access-rnhn9") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "kube-api-access-rnhn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:36:23.327713 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.327683 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerID="45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f" exitCode=0 Jul 06 19:36:23.327866 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.327746 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.327866 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.327839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f"} Jul 06 19:36:23.328030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.327919 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4","Type":"ContainerDied","Data":"8e6135de1ef7775becbc269bb41d554c5602c53320953d3281b8504a8f02a459"} Jul 06 19:36:23.328030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.327979 2585 scope.go:117] "RemoveContainer" containerID="df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487" Jul 06 19:36:23.329593 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.329566 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-web-config" (OuterVolumeSpecName: "web-config") pod "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" (UID: "5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:23.338073 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.338055 2585 scope.go:117] "RemoveContainer" containerID="4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe" Jul 06 19:36:23.346325 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.346309 2585 scope.go:117] "RemoveContainer" containerID="45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f" Jul 06 19:36:23.353253 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.353231 2585 scope.go:117] "RemoveContainer" containerID="19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16" Jul 06 19:36:23.359587 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.359571 2585 scope.go:117] "RemoveContainer" containerID="0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f" Jul 06 19:36:23.366268 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.366250 2585 scope.go:117] "RemoveContainer" containerID="f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104" Jul 06 19:36:23.373437 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.373420 2585 scope.go:117] "RemoveContainer" containerID="c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84" Jul 06 19:36:23.379594 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.379577 2585 scope.go:117] "RemoveContainer" containerID="df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487" Jul 06 19:36:23.379832 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.379813 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487\": container with ID starting with df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487 not found: ID does not exist" containerID="df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487" Jul 06 19:36:23.379878 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.379841 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487"} err="failed to get container status \"df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487\": rpc error: code = NotFound desc = could not find container \"df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487\": container with ID starting with df088085ff16b2a80bf802ca57f46214e0cd5640f32e9b9eed85a745fe1f1487 not found: ID does not exist" Jul 06 19:36:23.379878 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.379863 2585 scope.go:117] "RemoveContainer" containerID="4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe" Jul 06 19:36:23.380104 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.380086 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe\": container with ID starting with 4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe not found: ID does not exist" containerID="4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe" Jul 06 19:36:23.380183 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380113 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe"} err="failed to get container status \"4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe\": rpc error: code = NotFound desc = could not find container \"4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe\": container with ID starting with 4525de291c37917394c39d4bb88a308321e8978f2c855516a35e8c03b80afbbe not found: ID does not exist" Jul 06 19:36:23.380183 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380135 2585 scope.go:117] "RemoveContainer" containerID="45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f" Jul 06 19:36:23.380375 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.380356 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f\": container with ID starting with 45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f not found: ID does not exist" containerID="45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f" Jul 06 19:36:23.380412 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380380 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f"} err="failed to get container status \"45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f\": rpc error: code = NotFound desc = could not find container \"45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f\": container with ID starting with 45870f036423cd4099f15f6bf51f54e50baf436ac3f057137c5afba862c8954f not found: ID does not exist" Jul 06 19:36:23.380412 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380394 2585 scope.go:117] "RemoveContainer" containerID="19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16" Jul 06 19:36:23.380587 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.380570 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16\": container with ID starting with 19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16 not found: ID does not exist" containerID="19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16" Jul 06 19:36:23.380652 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380594 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16"} err="failed to get container status \"19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16\": rpc error: code = NotFound desc = could not find container \"19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16\": container with ID starting with 19c450e019fc6c950534d05178c3ba7267ee6d93f778b9b19acbebd5461ebf16 not found: ID does not exist" Jul 06 19:36:23.380652 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380614 2585 scope.go:117] "RemoveContainer" containerID="0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f" Jul 06 19:36:23.380833 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.380814 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f\": container with ID starting with 0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f not found: ID does not exist" containerID="0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f" Jul 06 19:36:23.380869 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380837 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f"} err="failed to get container status \"0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f\": rpc error: code = NotFound desc = could not find container \"0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f\": container with ID starting with 0a415d94e998a8ac329a08088061f3f2f590f4d39ba685c1e8130ffd86b5c93f not found: ID does not exist" Jul 06 19:36:23.380869 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.380851 2585 scope.go:117] "RemoveContainer" containerID="f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104" Jul 06 19:36:23.381070 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.381053 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104\": container with ID starting with f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104 not found: ID does not exist" containerID="f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104" Jul 06 19:36:23.381130 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.381076 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104"} err="failed to get container status \"f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104\": rpc error: code = NotFound desc = could not find container \"f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104\": container with ID starting with f6b0f04d293fe27e68f8f811b29823a79513ffc96f18154b3a8ae3251550f104 not found: ID does not exist" Jul 06 19:36:23.381130 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.381094 2585 scope.go:117] "RemoveContainer" containerID="c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84" Jul 06 19:36:23.381369 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:36:23.381353 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84\": container with ID starting with c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84 not found: ID does not exist" containerID="c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84" Jul 06 19:36:23.381410 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.381372 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84"} err="failed to get container status \"c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84\": rpc error: code = NotFound desc = could not find container \"c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84\": container with ID starting with c1c1ed4e53879fc21cb2ab44a88262400797d7f70033075d3482230d7301ca84 not found: ID does not exist" Jul 06 19:36:23.414455 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414432 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414455 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414455 2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config-out\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414465 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414474 2585 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414484 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-db\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414492 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414500 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnhn9\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-kube-api-access-rnhn9\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414508 2585 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-grpc-tls\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414516 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414523 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-metrics-client-ca\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414531 2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-web-config\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414539 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414548 2585 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-metrics-client-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414556 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414557 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414565 2585 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-config\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414572 2585 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-secret-kube-rbac-proxy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414581 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.414887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.414589 2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4-tls-assets\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:36:23.656727 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.656701 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:36:23.662027 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.662006 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:36:23.697366 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697339 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:36:23.697662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697646 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="init-config-reloader" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697665 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="init-config-reloader" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697681 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26efdeb5-73fd-44d3-abe1-9215fabed677" containerName="console" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697689 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="26efdeb5-73fd-44d3-abe1-9215fabed677" containerName="console" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697705 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b298e35-18f5-4aa3-beec-2278a2f1b9fe" containerName="console" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697713 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b298e35-18f5-4aa3-beec-2278a2f1b9fe" containerName="console" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697728 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="config-reloader" Jul 06 19:36:23.697735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697736 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="config-reloader" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697748 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="prometheus" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697756 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="prometheus" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697766 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="thanos-sidecar" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697774 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="thanos-sidecar" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697784 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-thanos" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697792 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-thanos" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697802 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697810 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697825 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-web" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697833 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-web" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697903 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b298e35-18f5-4aa3-beec-2278a2f1b9fe" containerName="console" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697915 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="26efdeb5-73fd-44d3-abe1-9215fabed677" containerName="console" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697925 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="config-reloader" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697936 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="thanos-sidecar" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697945 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-web" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697954 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy-thanos" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697965 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="prometheus" Jul 06 19:36:23.698063 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.697975 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" containerName="kube-rbac-proxy" Jul 06 19:36:23.703738 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.703717 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.707177 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.707136 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ktnnf\"" Jul 06 19:36:23.707521 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.707496 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:36:23.707613 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.707596 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:36:23.707978 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.707963 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:36:23.708032 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.707988 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:36:23.708087 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.707989 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:36:23.708210 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.708197 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:36:23.708324 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.708304 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:36:23.708407 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.708390 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:36:23.708543 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.708530 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:36:23.710198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.710182 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:36:23.710558 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.710533 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cabubo0v6ghfs\"" Jul 06 19:36:23.710651 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.710599 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:36:23.710822 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.710789 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:36:23.712482 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.712464 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:36:23.716591 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.716573 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:36:23.741426 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.741403 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:36:23.817716 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn7z2\" (UniqueName: \"kubernetes.io/projected/3e8da284-4c95-44a6-a295-f056ce109594-kube-api-access-bn7z2\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817716 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817721 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817743 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817764 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817789 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817806 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817835 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-config\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817872 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.817919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817886 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817946 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817972 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.817989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818010 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818052 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818084 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818129 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818121 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e8da284-4c95-44a6-a295-f056ce109594-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818176 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818193 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e8da284-4c95-44a6-a295-f056ce109594-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.818368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.818225 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919234 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919195 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e8da284-4c95-44a6-a295-f056ce109594-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919250 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919277 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7z2\" (UniqueName: \"kubernetes.io/projected/3e8da284-4c95-44a6-a295-f056ce109594-kube-api-access-bn7z2\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919305 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919617 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919438 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919617 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919473 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919617 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919507 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919617 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-config\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919617 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919591 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.919842 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.919617 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.920294 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.920270 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.921076 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.921050 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.921963 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e8da284-4c95-44a6-a295-f056ce109594-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922015 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922048 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922079 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922108 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922174 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922278 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e8da284-4c95-44a6-a295-f056ce109594-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922303 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922311 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922336 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922416 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.922607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.922432 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923318 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923021 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923318 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923072 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923318 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923096 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923318 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923108 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-config\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923508 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923336 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923634 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923650 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.923850 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.923829 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.924500 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.924481 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.924603 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.924527 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8da284-4c95-44a6-a295-f056ce109594-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.925326 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.925300 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e8da284-4c95-44a6-a295-f056ce109594-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.925561 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.925542 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.925722 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.925706 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e8da284-4c95-44a6-a295-f056ce109594-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:23.929059 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:23.929043 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn7z2\" (UniqueName: \"kubernetes.io/projected/3e8da284-4c95-44a6-a295-f056ce109594-kube-api-access-bn7z2\") pod \"prometheus-k8s-0\" (UID: \"3e8da284-4c95-44a6-a295-f056ce109594\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:24.014216 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:24.014186 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:36:24.156359 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:24.156264 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:36:24.158504 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:36:24.158476 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8da284_4c95_44a6_a295_f056ce109594.slice/crio-20ef7258d30e9f86d8082c2e78cc515074b7db54a67a9de9bc4039c12717d975 WatchSource:0}: Error finding container 20ef7258d30e9f86d8082c2e78cc515074b7db54a67a9de9bc4039c12717d975: Status 404 returned error can't find the container with id 20ef7258d30e9f86d8082c2e78cc515074b7db54a67a9de9bc4039c12717d975 Jul 06 19:36:24.335111 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:24.335077 2585 generic.go:356] "Generic (PLEG): container finished" podID="3e8da284-4c95-44a6-a295-f056ce109594" containerID="447f52133ac1a94ee0a707bbd156c5053636ac26a9901327b8740cd8990436d1" exitCode=0 Jul 06 19:36:24.336290 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:24.336266 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4" path="/var/lib/kubelet/pods/5f20d47a-4fb1-4bd2-abbd-b8f4b388ecf4/volumes" Jul 06 19:36:24.336836 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:24.336814 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerDied","Data":"447f52133ac1a94ee0a707bbd156c5053636ac26a9901327b8740cd8990436d1"} Jul 06 19:36:24.336927 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:24.336876 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"20ef7258d30e9f86d8082c2e78cc515074b7db54a67a9de9bc4039c12717d975"} Jul 06 19:36:25.342316 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.342284 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"45101781ffd59314a72a5f9308eb4ab32f272b02464544a73644ed014742856b"} Jul 06 19:36:25.342662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.342345 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"8f32250cb081b41fad046c40e2b5187801b86c2233f3dacbbe74ec41eb932495"} Jul 06 19:36:25.342662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.342371 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"f1e91d0c5614492c5d36042cf59c7465daac7c0ebe123d32e9255adb260eabed"} Jul 06 19:36:25.342662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.342395 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"4491054a67b69c1be8967f4ea8a03ce1d7336a25220419c4d5b87b4d4c727dae"} Jul 06 19:36:25.342662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.342422 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"902e706b1cdfa9dd144517ae526568fbdd3c6d3c786a3db84e0a68b011954017"} Jul 06 19:36:25.342662 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.342462 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e8da284-4c95-44a6-a295-f056ce109594","Type":"ContainerStarted","Data":"f647a8bc7b829587e9a1c6b9fbd366a3fd792ec4a7d4e5e136bca9ab441acfeb"} Jul 06 19:36:25.393554 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:25.393447 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.371137417 podStartE2EDuration="2.393426291s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.288874ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:25.377334774 +0000 UTC m=+217.676744219" watchObservedRunningTime="2026-07-06 19:36:25.393426291 +0000 UTC m=+217.692835738" Jul 06 19:36:29.014438 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:36:29.014406 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:37:24.014902 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:24.014818 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:37:24.030027 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:24.030005 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:37:24.580660 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:24.580635 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:37:48.132505 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:48.132476 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:37:48.139344 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:48.139324 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:37:48.139925 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:48.139908 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:37:48.142331 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:48.142309 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:37:48.146766 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:37:48.146750 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:39:32.205542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.205502 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8"] Jul 06 19:39:32.207989 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.207966 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.212209 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.212185 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:39:32.212209 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.212203 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:39:32.212872 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.212855 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:39:32.213124 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.213111 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:39:32.214140 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.214121 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jxxt7\"" Jul 06 19:39:32.227203 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.227140 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8"] Jul 06 19:39:32.320916 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.320886 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-tmp\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.321082 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.320924 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-manifests\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.321082 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.320952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xhbb\" (UniqueName: \"kubernetes.io/projected/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-kube-api-access-2xhbb\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.321082 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.321053 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.321263 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.321108 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.421527 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.421490 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-tmp\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.421723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.421536 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-manifests\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.421723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.421566 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xhbb\" (UniqueName: \"kubernetes.io/projected/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-kube-api-access-2xhbb\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.421723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.421584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.421723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.421621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.421929 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.421890 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-manifests\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.423851 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.423823 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-tmp\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.423981 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.423951 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.424105 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.424086 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.434121 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.434096 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xhbb\" (UniqueName: \"kubernetes.io/projected/a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d-kube-api-access-2xhbb\") pod \"opendatahub-operator-controller-manager-f6756874-zrpk8\" (UID: \"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.518012 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.517934 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:32.656945 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.656918 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8"] Jul 06 19:39:32.659803 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:39:32.659782 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d6af6b_1fcf_4f13_b7f0_057a9e1aa29d.slice/crio-eaff180f3bc6b9a1adba6e331bdf2563475a53406c6bfb41083b6ff9070c40b9 WatchSource:0}: Error finding container eaff180f3bc6b9a1adba6e331bdf2563475a53406c6bfb41083b6ff9070c40b9: Status 404 returned error can't find the container with id eaff180f3bc6b9a1adba6e331bdf2563475a53406c6bfb41083b6ff9070c40b9 Jul 06 19:39:32.661572 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:32.661554 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:39:33.036111 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:33.036076 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" event={"ID":"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d","Type":"ContainerStarted","Data":"eaff180f3bc6b9a1adba6e331bdf2563475a53406c6bfb41083b6ff9070c40b9"} Jul 06 19:39:36.051693 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:36.051652 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" event={"ID":"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d","Type":"ContainerStarted","Data":"39ad8900b63234c224fe9c1d553c04bc1bc5a9af39fcca17cfb91888b400b605"} Jul 06 19:39:37.058115 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:37.058078 2585 generic.go:356] "Generic (PLEG): container finished" podID="a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d" containerID="39ad8900b63234c224fe9c1d553c04bc1bc5a9af39fcca17cfb91888b400b605" exitCode=0 Jul 06 19:39:37.058558 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:37.058182 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" event={"ID":"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d","Type":"ContainerDied","Data":"39ad8900b63234c224fe9c1d553c04bc1bc5a9af39fcca17cfb91888b400b605"} Jul 06 19:39:38.064124 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:38.064084 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" event={"ID":"a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d","Type":"ContainerStarted","Data":"c13349ca5dbb17b34768e19757f75b6b75cef5f19c22a73954f14bcdd4808be1"} Jul 06 19:39:38.064519 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:38.064306 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:39:38.089602 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:38.089546 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" podStartSLOduration=1.93466813 podStartE2EDuration="6.089532296s" totalImagesPullingTime="3.132394986s" totalInitContainerRuntime="1.02246918s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:38.088123375 +0000 UTC m=+410.387532821" watchObservedRunningTime="2026-07-06 19:39:38.089532296 +0000 UTC m=+410.388941742" Jul 06 19:39:49.070938 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:39:49.070908 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-zrpk8" Jul 06 19:40:00.425126 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.425091 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq"] Jul 06 19:40:00.434338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.434318 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.439495 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.439473 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lzrb6\"" Jul 06 19:40:00.439619 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.439515 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:40:00.444516 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.444497 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:40:00.444608 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.444499 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:40:00.444872 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.444856 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:40:00.445492 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.445480 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:40:00.453773 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.453752 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq"] Jul 06 19:40:00.551576 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.551539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-metrics-cert\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.551723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.551585 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-manager-config\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.551723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.551661 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-cert\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.551723 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.551682 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97cbl\" (UniqueName: \"kubernetes.io/projected/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-kube-api-access-97cbl\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.652110 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.652062 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-metrics-cert\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.652297 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.652126 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-manager-config\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.652297 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.652201 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-cert\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.652297 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.652229 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97cbl\" (UniqueName: \"kubernetes.io/projected/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-kube-api-access-97cbl\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.652809 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.652777 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-manager-config\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.654499 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.654478 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-cert\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.654626 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.654606 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-metrics-cert\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.661471 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.661448 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97cbl\" (UniqueName: \"kubernetes.io/projected/c114c834-d6c4-42c2-ac9e-ecaa006fd9e3-kube-api-access-97cbl\") pod \"lws-controller-manager-fdd95bb87-x86wq\" (UID: \"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.743368 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.743288 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:00.900791 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:00.900763 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq"] Jul 06 19:40:00.901503 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:40:00.901474 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc114c834_d6c4_42c2_ac9e_ecaa006fd9e3.slice/crio-0e6921ef09740d17a3db3086675870920cae3bbe2711528690a409982ba51561 WatchSource:0}: Error finding container 0e6921ef09740d17a3db3086675870920cae3bbe2711528690a409982ba51561: Status 404 returned error can't find the container with id 0e6921ef09740d17a3db3086675870920cae3bbe2711528690a409982ba51561 Jul 06 19:40:01.164409 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:01.164369 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" event={"ID":"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3","Type":"ContainerStarted","Data":"0e6921ef09740d17a3db3086675870920cae3bbe2711528690a409982ba51561"} Jul 06 19:40:11.892551 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:11.892474 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9"] Jul 06 19:40:11.894735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:11.894719 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:11.905121 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:11.905102 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cbrjf\"" Jul 06 19:40:11.908599 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:11.908584 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:40:11.919190 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:11.919141 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9"] Jul 06 19:40:12.048366 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048332 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048529 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048375 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l94xl\" (UniqueName: \"kubernetes.io/projected/067012df-ac43-4376-a5b3-4e69199afed3-kube-api-access-l94xl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048529 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048398 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048529 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048437 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048529 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048480 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048663 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048538 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048663 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048561 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067012df-ac43-4376-a5b3-4e69199afed3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048663 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048580 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067012df-ac43-4376-a5b3-4e69199afed3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.048663 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.048610 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067012df-ac43-4376-a5b3-4e69199afed3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149112 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149112 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149078 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l94xl\" (UniqueName: \"kubernetes.io/projected/067012df-ac43-4376-a5b3-4e69199afed3-kube-api-access-l94xl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149116 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149132 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067012df-ac43-4376-a5b3-4e69199afed3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149266 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067012df-ac43-4376-a5b3-4e69199afed3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149322 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149312 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067012df-ac43-4376-a5b3-4e69199afed3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149724 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149477 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149724 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149525 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149724 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149706 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.149954 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.149927 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.150094 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.150079 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067012df-ac43-4376-a5b3-4e69199afed3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.151541 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.151518 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067012df-ac43-4376-a5b3-4e69199afed3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.151876 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.151850 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067012df-ac43-4376-a5b3-4e69199afed3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.164611 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.164584 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067012df-ac43-4376-a5b3-4e69199afed3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.164751 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.164682 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l94xl\" (UniqueName: \"kubernetes.io/projected/067012df-ac43-4376-a5b3-4e69199afed3-kube-api-access-l94xl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r2kh9\" (UID: \"067012df-ac43-4376-a5b3-4e69199afed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.204616 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.204583 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:12.395024 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:12.394998 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9"] Jul 06 19:40:12.396910 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:40:12.396883 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067012df_ac43_4376_a5b3_4e69199afed3.slice/crio-cef2f1df551081f8ead320d4a6572c98de58a440b82e550aa283a16984622169 WatchSource:0}: Error finding container cef2f1df551081f8ead320d4a6572c98de58a440b82e550aa283a16984622169: Status 404 returned error can't find the container with id cef2f1df551081f8ead320d4a6572c98de58a440b82e550aa283a16984622169 Jul 06 19:40:13.219096 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:13.219055 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" event={"ID":"067012df-ac43-4376-a5b3-4e69199afed3","Type":"ContainerStarted","Data":"cef2f1df551081f8ead320d4a6572c98de58a440b82e550aa283a16984622169"} Jul 06 19:40:17.239266 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:17.239230 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" event={"ID":"c114c834-d6c4-42c2-ac9e-ecaa006fd9e3","Type":"ContainerStarted","Data":"f1e677a37169fd8107c6380a3fb9af2e9d9a4c3f8adff9321c8015af11a2db0a"} Jul 06 19:40:17.239796 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:17.239360 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:17.313772 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:17.313720 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" podStartSLOduration=1.450112021 podStartE2EDuration="17.313703018s" totalImagesPullingTime="15.863590997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:17.311588975 +0000 UTC m=+449.610998420" watchObservedRunningTime="2026-07-06 19:40:17.313703018 +0000 UTC m=+449.613112464" Jul 06 19:40:28.097515 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:28.097478 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:28.097782 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:28.097569 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:28.097782 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:28.097604 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:28.244958 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:28.244927 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-x86wq" Jul 06 19:40:28.291484 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:28.291451 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" event={"ID":"067012df-ac43-4376-a5b3-4e69199afed3","Type":"ContainerStarted","Data":"12a8491126efb0abd2d087198d6b1e999bb8e9068625e600334aa723833f2706"} Jul 06 19:40:29.205255 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:29.205221 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:29.210013 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:29.209989 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:29.239011 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:29.238962 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" podStartSLOduration=2.540469577 podStartE2EDuration="18.238948455s" totalImagesPullingTime="15.698478878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:28.33972837 +0000 UTC m=+460.639137826" watchObservedRunningTime="2026-07-06 19:40:29.238948455 +0000 UTC m=+461.538357900" Jul 06 19:40:29.300654 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:29.300561 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:29.301436 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:29.301416 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r2kh9" Jul 06 19:40:52.876430 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.876390 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r22h7"] Jul 06 19:40:52.884633 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.884607 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:52.890326 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.890292 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5mwmk\"" Jul 06 19:40:52.890469 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.890330 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:40:52.893242 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.893223 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:40:52.909401 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.909372 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r22h7"] Jul 06 19:40:52.990892 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:52.990851 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkxp\" (UniqueName: \"kubernetes.io/projected/78f83400-affc-4ba2-b97a-08e7fe43b707-kube-api-access-drkxp\") pod \"kuadrant-operator-catalog-r22h7\" (UID: \"78f83400-affc-4ba2-b97a-08e7fe43b707\") " pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:53.091968 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.091937 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkxp\" (UniqueName: \"kubernetes.io/projected/78f83400-affc-4ba2-b97a-08e7fe43b707-kube-api-access-drkxp\") pod \"kuadrant-operator-catalog-r22h7\" (UID: \"78f83400-affc-4ba2-b97a-08e7fe43b707\") " pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:53.103779 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.103746 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkxp\" (UniqueName: \"kubernetes.io/projected/78f83400-affc-4ba2-b97a-08e7fe43b707-kube-api-access-drkxp\") pod \"kuadrant-operator-catalog-r22h7\" (UID: \"78f83400-affc-4ba2-b97a-08e7fe43b707\") " pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:53.194111 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.194081 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:53.215586 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.215556 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r22h7"] Jul 06 19:40:53.331469 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.331448 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r22h7"] Jul 06 19:40:53.333680 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:40:53.333657 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f83400_affc_4ba2_b97a_08e7fe43b707.slice/crio-db61f3838e098ddebde5566a96dcf19157b01fecbd95936bebdc694399a5eb74 WatchSource:0}: Error finding container db61f3838e098ddebde5566a96dcf19157b01fecbd95936bebdc694399a5eb74: Status 404 returned error can't find the container with id db61f3838e098ddebde5566a96dcf19157b01fecbd95936bebdc694399a5eb74 Jul 06 19:40:53.404354 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.404310 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" event={"ID":"78f83400-affc-4ba2-b97a-08e7fe43b707","Type":"ContainerStarted","Data":"db61f3838e098ddebde5566a96dcf19157b01fecbd95936bebdc694399a5eb74"} Jul 06 19:40:53.433291 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.433253 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cnpxv"] Jul 06 19:40:53.438218 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.438196 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:40:53.452091 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.452068 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cnpxv"] Jul 06 19:40:53.597577 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.597548 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xvt\" (UniqueName: \"kubernetes.io/projected/f04477ec-53cd-4d7a-b4be-348332884886-kube-api-access-78xvt\") pod \"kuadrant-operator-catalog-cnpxv\" (UID: \"f04477ec-53cd-4d7a-b4be-348332884886\") " pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:40:53.698267 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.698186 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xvt\" (UniqueName: \"kubernetes.io/projected/f04477ec-53cd-4d7a-b4be-348332884886-kube-api-access-78xvt\") pod \"kuadrant-operator-catalog-cnpxv\" (UID: \"f04477ec-53cd-4d7a-b4be-348332884886\") " pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:40:53.708386 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.708362 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xvt\" (UniqueName: \"kubernetes.io/projected/f04477ec-53cd-4d7a-b4be-348332884886-kube-api-access-78xvt\") pod \"kuadrant-operator-catalog-cnpxv\" (UID: \"f04477ec-53cd-4d7a-b4be-348332884886\") " pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:40:53.747210 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.747178 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:40:53.892442 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:53.892416 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cnpxv"] Jul 06 19:40:53.895113 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:40:53.895087 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04477ec_53cd_4d7a_b4be_348332884886.slice/crio-fd58a6d8742855d83e26aab1f1a608d638232df052cf4037d3710ec221f8ca70 WatchSource:0}: Error finding container fd58a6d8742855d83e26aab1f1a608d638232df052cf4037d3710ec221f8ca70: Status 404 returned error can't find the container with id fd58a6d8742855d83e26aab1f1a608d638232df052cf4037d3710ec221f8ca70 Jul 06 19:40:54.411538 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:54.411500 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" event={"ID":"f04477ec-53cd-4d7a-b4be-348332884886","Type":"ContainerStarted","Data":"fd58a6d8742855d83e26aab1f1a608d638232df052cf4037d3710ec221f8ca70"} Jul 06 19:40:56.427745 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.427699 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" event={"ID":"78f83400-affc-4ba2-b97a-08e7fe43b707","Type":"ContainerStarted","Data":"63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac"} Jul 06 19:40:56.428257 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.427785 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" podUID="78f83400-affc-4ba2-b97a-08e7fe43b707" containerName="registry-server" containerID="cri-o://63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac" gracePeriod=2 Jul 06 19:40:56.429505 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.429474 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" event={"ID":"f04477ec-53cd-4d7a-b4be-348332884886","Type":"ContainerStarted","Data":"ea184f34c0d0338bd3857419049abb19755eecd5b0dcc477b99665940915462a"} Jul 06 19:40:56.473082 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.473026 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" podStartSLOduration=1.7848917979999999 podStartE2EDuration="3.473010685s" totalImagesPullingTime="1.688118887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:56.472180904 +0000 UTC m=+488.771590350" watchObservedRunningTime="2026-07-06 19:40:56.473010685 +0000 UTC m=+488.772420131" Jul 06 19:40:56.473398 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.473376 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" podStartSLOduration=2.224067469 podStartE2EDuration="4.473370408s" totalImagesPullingTime="2.249302939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:56.452131584 +0000 UTC m=+488.751541030" watchObservedRunningTime="2026-07-06 19:40:56.473370408 +0000 UTC m=+488.772779854" Jul 06 19:40:56.672936 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.672912 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:56.830064 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.829987 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drkxp\" (UniqueName: \"kubernetes.io/projected/78f83400-affc-4ba2-b97a-08e7fe43b707-kube-api-access-drkxp\") pod \"78f83400-affc-4ba2-b97a-08e7fe43b707\" (UID: \"78f83400-affc-4ba2-b97a-08e7fe43b707\") " Jul 06 19:40:56.832077 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.832046 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f83400-affc-4ba2-b97a-08e7fe43b707-kube-api-access-drkxp" (OuterVolumeSpecName: "kube-api-access-drkxp") pod "78f83400-affc-4ba2-b97a-08e7fe43b707" (UID: "78f83400-affc-4ba2-b97a-08e7fe43b707"). InnerVolumeSpecName "kube-api-access-drkxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:56.931582 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:56.931552 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drkxp\" (UniqueName: \"kubernetes.io/projected/78f83400-affc-4ba2-b97a-08e7fe43b707-kube-api-access-drkxp\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:40:57.435160 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.435123 2585 generic.go:356] "Generic (PLEG): container finished" podID="78f83400-affc-4ba2-b97a-08e7fe43b707" containerID="63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac" exitCode=0 Jul 06 19:40:57.435620 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.435185 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" Jul 06 19:40:57.435620 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.435210 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" event={"ID":"78f83400-affc-4ba2-b97a-08e7fe43b707","Type":"ContainerDied","Data":"63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac"} Jul 06 19:40:57.435620 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.435258 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r22h7" event={"ID":"78f83400-affc-4ba2-b97a-08e7fe43b707","Type":"ContainerDied","Data":"db61f3838e098ddebde5566a96dcf19157b01fecbd95936bebdc694399a5eb74"} Jul 06 19:40:57.435620 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.435278 2585 scope.go:117] "RemoveContainer" containerID="63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac" Jul 06 19:40:57.444595 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.444578 2585 scope.go:117] "RemoveContainer" containerID="63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac" Jul 06 19:40:57.444847 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:40:57.444830 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac\": container with ID starting with 63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac not found: ID does not exist" containerID="63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac" Jul 06 19:40:57.444908 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.444859 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac"} err="failed to get container status \"63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac\": rpc error: code = NotFound desc = could not find container \"63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac\": container with ID starting with 63c8ec5581683779d14fb2dc9a2abda255b3ee4d5e3c67e2c8949011a5f84fac not found: ID does not exist" Jul 06 19:40:57.460276 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.460252 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r22h7"] Jul 06 19:40:57.466189 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:57.466168 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r22h7"] Jul 06 19:40:58.337806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:40:58.337764 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f83400-affc-4ba2-b97a-08e7fe43b707" path="/var/lib/kubelet/pods/78f83400-affc-4ba2-b97a-08e7fe43b707/volumes" Jul 06 19:41:03.747886 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:03.747844 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:41:03.748379 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:03.747908 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:41:03.770433 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:03.770407 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:41:04.487519 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:04.487488 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cnpxv" Jul 06 19:41:21.671135 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.671098 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd"] Jul 06 19:41:21.671538 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.671465 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f83400-affc-4ba2-b97a-08e7fe43b707" containerName="registry-server" Jul 06 19:41:21.671538 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.671477 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f83400-affc-4ba2-b97a-08e7fe43b707" containerName="registry-server" Jul 06 19:41:21.671538 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.671526 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f83400-affc-4ba2-b97a-08e7fe43b707" containerName="registry-server" Jul 06 19:41:21.674028 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.674012 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.677466 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.677447 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-967bv\"" Jul 06 19:41:21.698045 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.698015 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd"] Jul 06 19:41:21.752527 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.752498 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-kube-api-access-r7d8r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.752654 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.752534 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.853820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.853781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-kube-api-access-r7d8r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.853971 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.853832 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.854300 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.854282 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.866072 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.866051 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-kube-api-access-r7d8r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:21.983954 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:21.983858 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:22.126607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:22.126554 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd"] Jul 06 19:41:22.128953 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:41:22.128924 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf78f9ae_fd92_4bc1_83cc_1bfb8bac95c4.slice/crio-f73ad9ba14b948c9f02c61ad1ec218035bf35e352c8a9e0c9ae74748ae3a29ed WatchSource:0}: Error finding container f73ad9ba14b948c9f02c61ad1ec218035bf35e352c8a9e0c9ae74748ae3a29ed: Status 404 returned error can't find the container with id f73ad9ba14b948c9f02c61ad1ec218035bf35e352c8a9e0c9ae74748ae3a29ed Jul 06 19:41:22.546100 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:22.546064 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" event={"ID":"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4","Type":"ContainerStarted","Data":"f73ad9ba14b948c9f02c61ad1ec218035bf35e352c8a9e0c9ae74748ae3a29ed"} Jul 06 19:41:23.695830 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.695799 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q"] Jul 06 19:41:23.699090 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.699074 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:23.702134 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.702112 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2vzd9\"" Jul 06 19:41:23.712249 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.712227 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q"] Jul 06 19:41:23.773160 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.773105 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khqbb\" (UniqueName: \"kubernetes.io/projected/a96f9f67-ee15-4cad-a084-abc274e5222f-kube-api-access-khqbb\") pod \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" (UID: \"a96f9f67-ee15-4cad-a084-abc274e5222f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:23.874696 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.874665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khqbb\" (UniqueName: \"kubernetes.io/projected/a96f9f67-ee15-4cad-a084-abc274e5222f-kube-api-access-khqbb\") pod \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" (UID: \"a96f9f67-ee15-4cad-a084-abc274e5222f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:23.906042 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:23.906017 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khqbb\" (UniqueName: \"kubernetes.io/projected/a96f9f67-ee15-4cad-a084-abc274e5222f-kube-api-access-khqbb\") pod \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" (UID: \"a96f9f67-ee15-4cad-a084-abc274e5222f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:24.009902 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:24.009823 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:24.164119 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:24.164083 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q"] Jul 06 19:41:24.168997 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:41:24.168969 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96f9f67_ee15_4cad_a084_abc274e5222f.slice/crio-6ce67d95de700bf53ebd3960ab9c6475a594dbd27e60c140ea2c5149171fb175 WatchSource:0}: Error finding container 6ce67d95de700bf53ebd3960ab9c6475a594dbd27e60c140ea2c5149171fb175: Status 404 returned error can't find the container with id 6ce67d95de700bf53ebd3960ab9c6475a594dbd27e60c140ea2c5149171fb175 Jul 06 19:41:24.565921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:24.565882 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" event={"ID":"a96f9f67-ee15-4cad-a084-abc274e5222f","Type":"ContainerStarted","Data":"6ce67d95de700bf53ebd3960ab9c6475a594dbd27e60c140ea2c5149171fb175"} Jul 06 19:41:25.572369 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:25.572336 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" event={"ID":"a96f9f67-ee15-4cad-a084-abc274e5222f","Type":"ContainerStarted","Data":"7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf"} Jul 06 19:41:25.572821 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:25.572476 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:25.603400 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:25.603352 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" podStartSLOduration=1.301277318 podStartE2EDuration="2.603337039s" totalImagesPullingTime="1.302059721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:25.601870514 +0000 UTC m=+517.901279986" watchObservedRunningTime="2026-07-06 19:41:25.603337039 +0000 UTC m=+517.902746484" Jul 06 19:41:27.586440 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:27.586409 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" event={"ID":"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4","Type":"ContainerStarted","Data":"5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e"} Jul 06 19:41:27.586855 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:27.586651 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:30.413554 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.413507 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" podStartSLOduration=4.606920174 podStartE2EDuration="9.413489516s" totalImagesPullingTime="4.806569342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:27.654306646 +0000 UTC m=+519.953716092" watchObservedRunningTime="2026-07-06 19:41:30.413489516 +0000 UTC m=+522.712898962" Jul 06 19:41:30.414502 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.414484 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw"] Jul 06 19:41:30.422996 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.422977 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:30.426665 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.426646 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n8jz2\"" Jul 06 19:41:30.428305 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.428287 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 19:41:30.456460 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.456440 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw"] Jul 06 19:41:30.532025 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.532000 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsql8\" (UniqueName: \"kubernetes.io/projected/5efe7e30-4ab7-4e5d-bc46-5228c407c142-kube-api-access-jsql8\") pod \"dns-operator-controller-manager-864dd78c4c-drdjw\" (UID: \"5efe7e30-4ab7-4e5d-bc46-5228c407c142\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:30.633437 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.633414 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsql8\" (UniqueName: \"kubernetes.io/projected/5efe7e30-4ab7-4e5d-bc46-5228c407c142-kube-api-access-jsql8\") pod \"dns-operator-controller-manager-864dd78c4c-drdjw\" (UID: \"5efe7e30-4ab7-4e5d-bc46-5228c407c142\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:30.673015 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.672960 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsql8\" (UniqueName: \"kubernetes.io/projected/5efe7e30-4ab7-4e5d-bc46-5228c407c142-kube-api-access-jsql8\") pod \"dns-operator-controller-manager-864dd78c4c-drdjw\" (UID: \"5efe7e30-4ab7-4e5d-bc46-5228c407c142\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:30.733558 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.733521 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:30.881388 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:41:30.881359 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efe7e30_4ab7_4e5d_bc46_5228c407c142.slice/crio-529014d48e7636a71953c0ad8e3ddea40ebdb9ebf8025cdbc8339a4b47a9da1a WatchSource:0}: Error finding container 529014d48e7636a71953c0ad8e3ddea40ebdb9ebf8025cdbc8339a4b47a9da1a: Status 404 returned error can't find the container with id 529014d48e7636a71953c0ad8e3ddea40ebdb9ebf8025cdbc8339a4b47a9da1a Jul 06 19:41:30.882689 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:30.882665 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw"] Jul 06 19:41:31.603691 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:31.603658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" event={"ID":"5efe7e30-4ab7-4e5d-bc46-5228c407c142","Type":"ContainerStarted","Data":"529014d48e7636a71953c0ad8e3ddea40ebdb9ebf8025cdbc8339a4b47a9da1a"} Jul 06 19:41:33.615834 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:33.615793 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" event={"ID":"5efe7e30-4ab7-4e5d-bc46-5228c407c142","Type":"ContainerStarted","Data":"681bd8292ecc6003d540a9d65412760e92a766b0ad762aee4d49bb8d63edb876"} Jul 06 19:41:33.616243 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:33.615924 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:33.637117 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:33.637069 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" podStartSLOduration=1.854782355 podStartE2EDuration="3.637053626s" totalImagesPullingTime="1.782271271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:33.636536194 +0000 UTC m=+525.935945641" watchObservedRunningTime="2026-07-06 19:41:33.637053626 +0000 UTC m=+525.936463073" Jul 06 19:41:36.580093 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:36.580063 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:38.592140 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:38.592110 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:40.761713 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.761635 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd"] Jul 06 19:41:40.762088 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.761802 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" containerName="manager" containerID="cri-o://5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e" gracePeriod=2 Jul 06 19:41:40.778275 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.778247 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd"] Jul 06 19:41:40.817911 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.817880 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q"] Jul 06 19:41:40.818179 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.818136 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" containerName="manager" containerID="cri-o://7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf" gracePeriod=2 Jul 06 19:41:40.822045 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:40.821986 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:40.824028 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.824007 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv"] Jul 06 19:41:40.824458 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.824418 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" containerName="manager" Jul 06 19:41:40.824458 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.824439 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" containerName="manager" Jul 06 19:41:40.824607 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.824522 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" containerName="manager" Jul 06 19:41:40.827636 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.827620 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:40.833687 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.833665 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q"] Jul 06 19:41:40.867012 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.866987 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv"] Jul 06 19:41:40.868947 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.868910 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9"] Jul 06 19:41:40.869409 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.869390 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" containerName="manager" Jul 06 19:41:40.869516 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.869481 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" containerName="manager" Jul 06 19:41:40.869602 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.869589 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" containerName="manager" Jul 06 19:41:40.873615 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.873594 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:40.889073 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.889048 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9"] Jul 06 19:41:40.905736 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:40.905699 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:40.908092 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:40.908066 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:40.910390 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:40.910363 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:40.913381 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:40.913358 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:40.926940 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.926918 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv58h\" (UniqueName: \"kubernetes.io/projected/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-kube-api-access-wv58h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x96kv\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:40.927031 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:40.926973 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x96kv\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.028023 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.027961 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv58h\" (UniqueName: \"kubernetes.io/projected/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-kube-api-access-wv58h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x96kv\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.028023 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.028020 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt66t\" (UniqueName: \"kubernetes.io/projected/f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9-kube-api-access-kt66t\") pod \"limitador-operator-controller-manager-859d7b78bd-9rvd9\" (UID: \"f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:41.028241 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.028053 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x96kv\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.028410 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.028391 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x96kv\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.046964 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.046936 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv58h\" (UniqueName: \"kubernetes.io/projected/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-kube-api-access-wv58h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x96kv\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.069059 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.069031 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.072536 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.072510 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.077857 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.077833 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:41.083168 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.083133 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:41.090353 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.090330 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.094336 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.094317 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:41.128902 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.128876 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt66t\" (UniqueName: \"kubernetes.io/projected/f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9-kube-api-access-kt66t\") pod \"limitador-operator-controller-manager-859d7b78bd-9rvd9\" (UID: \"f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:41.149725 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.149704 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt66t\" (UniqueName: \"kubernetes.io/projected/f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9-kube-api-access-kt66t\") pod \"limitador-operator-controller-manager-859d7b78bd-9rvd9\" (UID: \"f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:41.201701 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.201679 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.218629 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.218610 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:41.229740 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.229718 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khqbb\" (UniqueName: \"kubernetes.io/projected/a96f9f67-ee15-4cad-a084-abc274e5222f-kube-api-access-khqbb\") pod \"a96f9f67-ee15-4cad-a084-abc274e5222f\" (UID: \"a96f9f67-ee15-4cad-a084-abc274e5222f\") " Jul 06 19:41:41.229843 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.229771 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-kube-api-access-r7d8r\") pod \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " Jul 06 19:41:41.229901 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.229889 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-extensions-socket-volume\") pod \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\" (UID: \"cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4\") " Jul 06 19:41:41.230439 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.230410 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" (UID: "cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:41:41.231985 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.231963 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-kube-api-access-r7d8r" (OuterVolumeSpecName: "kube-api-access-r7d8r") pod "cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" (UID: "cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4"). InnerVolumeSpecName "kube-api-access-r7d8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:41:41.232099 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.232023 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96f9f67-ee15-4cad-a084-abc274e5222f-kube-api-access-khqbb" (OuterVolumeSpecName: "kube-api-access-khqbb") pod "a96f9f67-ee15-4cad-a084-abc274e5222f" (UID: "a96f9f67-ee15-4cad-a084-abc274e5222f"). InnerVolumeSpecName "kube-api-access-khqbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:41:41.330887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.330849 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-extensions-socket-volume\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:41:41.330887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.330889 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khqbb\" (UniqueName: \"kubernetes.io/projected/a96f9f67-ee15-4cad-a084-abc274e5222f-kube-api-access-khqbb\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:41:41.331057 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.330905 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4-kube-api-access-r7d8r\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:41:41.354727 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.354675 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv"] Jul 06 19:41:41.357174 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:41:41.357133 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec5f063_5443_4ac8_a3ef_07cfbef2440e.slice/crio-aed4756101d299cd1fe02376244ece3eda33e95b80786c22c2787901775ea1cd WatchSource:0}: Error finding container aed4756101d299cd1fe02376244ece3eda33e95b80786c22c2787901775ea1cd: Status 404 returned error can't find the container with id aed4756101d299cd1fe02376244ece3eda33e95b80786c22c2787901775ea1cd Jul 06 19:41:41.387346 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.387323 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9"] Jul 06 19:41:41.397236 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:41:41.397213 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e0a524_dfb2_4c93_a2a1_b8754a6b67d9.slice/crio-38710826c017b6faa4e1e16dcd891c1f3633138aa7070c9c5815dcd69e4e6582 WatchSource:0}: Error finding container 38710826c017b6faa4e1e16dcd891c1f3633138aa7070c9c5815dcd69e4e6582: Status 404 returned error can't find the container with id 38710826c017b6faa4e1e16dcd891c1f3633138aa7070c9c5815dcd69e4e6582 Jul 06 19:41:41.656027 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.655940 2585 generic.go:356] "Generic (PLEG): container finished" podID="a96f9f67-ee15-4cad-a084-abc274e5222f" containerID="7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf" exitCode=0 Jul 06 19:41:41.656027 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.655987 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:41.656272 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.656028 2585 scope.go:117] "RemoveContainer" containerID="7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf" Jul 06 19:41:41.657801 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.657774 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" event={"ID":"f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9","Type":"ContainerStarted","Data":"1453130e45d8c59681801197acd21c26495e91e6e73db8a557972733bc8665ca"} Jul 06 19:41:41.657922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.657826 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:41.657922 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.657847 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" event={"ID":"f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9","Type":"ContainerStarted","Data":"38710826c017b6faa4e1e16dcd891c1f3633138aa7070c9c5815dcd69e4e6582"} Jul 06 19:41:41.658750 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.658722 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.659295 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.659274 2585 generic.go:356] "Generic (PLEG): container finished" podID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" containerID="5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e" exitCode=0 Jul 06 19:41:41.659393 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.659307 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.661258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.661130 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" event={"ID":"4ec5f063-5443-4ac8-a3ef-07cfbef2440e","Type":"ContainerStarted","Data":"56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d"} Jul 06 19:41:41.661258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.661194 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" event={"ID":"4ec5f063-5443-4ac8-a3ef-07cfbef2440e","Type":"ContainerStarted","Data":"aed4756101d299cd1fe02376244ece3eda33e95b80786c22c2787901775ea1cd"} Jul 06 19:41:41.661258 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.661225 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:41.662302 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.662277 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:41.665792 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.665778 2585 scope.go:117] "RemoveContainer" containerID="7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf" Jul 06 19:41:41.666040 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.666019 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf\": container with ID starting with 7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf not found: ID does not exist" containerID="7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf" Jul 06 19:41:41.666092 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.666047 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf"} err="failed to get container status \"7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf\": rpc error: code = NotFound desc = could not find container \"7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf\": container with ID starting with 7f48605d47a5a6e027481580735a07ce40f4e06b7355c2da234b3370197b02cf not found: ID does not exist" Jul 06 19:41:41.666092 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.666062 2585 scope.go:117] "RemoveContainer" containerID="5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e" Jul 06 19:41:41.673484 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.673468 2585 scope.go:117] "RemoveContainer" containerID="5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e" Jul 06 19:41:41.673716 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.673698 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e\": container with ID starting with 5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e not found: ID does not exist" containerID="5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e" Jul 06 19:41:41.673764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.673720 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e"} err="failed to get container status \"5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e\": rpc error: code = NotFound desc = could not find container \"5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e\": container with ID starting with 5e46b3075fc856a1087eeecb7ae84c43c7742991c8305f2f13ef486535e9036e not found: ID does not exist" Jul 06 19:41:41.713503 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.713433 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" podStartSLOduration=1.713420935 podStartE2EDuration="1.713420935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:41.711691641 +0000 UTC m=+534.011101079" watchObservedRunningTime="2026-07-06 19:41:41.713420935 +0000 UTC m=+534.012830381" Jul 06 19:41:41.763783 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:41.763711 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" podStartSLOduration=1.763693629 podStartE2EDuration="1.763693629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:41.763201494 +0000 UTC m=+534.062610960" watchObservedRunningTime="2026-07-06 19:41:41.763693629 +0000 UTC m=+534.063103075" Jul 06 19:41:41.767521 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.767489 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.769723 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.769700 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:41.773369 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.773342 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74jvd\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74jvd" Jul 06 19:41:41.777482 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:41.777454 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l6z2q\" is forbidden: User \"system:node:ip-10-0-128-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-14.ec2.internal' and this object" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l6z2q" Jul 06 19:41:42.337254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:42.337220 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96f9f67-ee15-4cad-a084-abc274e5222f" path="/var/lib/kubelet/pods/a96f9f67-ee15-4cad-a084-abc274e5222f/volumes" Jul 06 19:41:42.337576 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:42.337563 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4" path="/var/lib/kubelet/pods/cf78f9ae-fd92-4bc1-83cc-1bfb8bac95c4/volumes" Jul 06 19:41:42.909508 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:42.909477 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h"] Jul 06 19:41:42.914252 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:42.914231 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:42.930944 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:42.930922 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h"] Jul 06 19:41:43.047260 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.047226 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdxv\" (UniqueName: \"kubernetes.io/projected/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-kube-api-access-4hdxv\") pod \"kuadrant-operator-controller-manager-86878c769f-g7h5h\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.047413 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.047354 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g7h5h\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.148552 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.148520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g7h5h\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.148689 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.148567 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdxv\" (UniqueName: \"kubernetes.io/projected/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-kube-api-access-4hdxv\") pod \"kuadrant-operator-controller-manager-86878c769f-g7h5h\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.148891 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.148871 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g7h5h\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.161549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.161486 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdxv\" (UniqueName: \"kubernetes.io/projected/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-kube-api-access-4hdxv\") pod \"kuadrant-operator-controller-manager-86878c769f-g7h5h\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.223647 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.223613 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.366009 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.365985 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h"] Jul 06 19:41:43.367776 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:41:43.367751 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8aa357_6f53_4cb7_a12f_528cd4676b4d.slice/crio-3a1695a885f5961950d7ea619daf82669674e45fbb49bc79a428b9948c0006a4 WatchSource:0}: Error finding container 3a1695a885f5961950d7ea619daf82669674e45fbb49bc79a428b9948c0006a4: Status 404 returned error can't find the container with id 3a1695a885f5961950d7ea619daf82669674e45fbb49bc79a428b9948c0006a4 Jul 06 19:41:43.674794 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.674712 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" event={"ID":"ed8aa357-6f53-4cb7-a12f-528cd4676b4d","Type":"ContainerStarted","Data":"6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3"} Jul 06 19:41:43.674794 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.674761 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" event={"ID":"ed8aa357-6f53-4cb7-a12f-528cd4676b4d","Type":"ContainerStarted","Data":"3a1695a885f5961950d7ea619daf82669674e45fbb49bc79a428b9948c0006a4"} Jul 06 19:41:43.674973 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.674803 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:43.711701 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:43.711656 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" podStartSLOduration=1.711642213 podStartE2EDuration="1.711642213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:43.706407393 +0000 UTC m=+536.005816858" watchObservedRunningTime="2026-07-06 19:41:43.711642213 +0000 UTC m=+536.011051658" Jul 06 19:41:44.623396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:44.623367 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-drdjw" Jul 06 19:41:52.670895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:52.670860 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:52.676806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:52.671423 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rvd9" Jul 06 19:41:54.682731 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:54.682696 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:41:54.764604 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:54.764576 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv"] Jul 06 19:41:54.764806 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:54.764783 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" podUID="4ec5f063-5443-4ac8-a3ef-07cfbef2440e" containerName="manager" containerID="cri-o://56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d" gracePeriod=10 Jul 06 19:41:55.024858 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.024833 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:55.051255 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.051227 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv58h\" (UniqueName: \"kubernetes.io/projected/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-kube-api-access-wv58h\") pod \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " Jul 06 19:41:55.051497 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.051453 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-extensions-socket-volume\") pod \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\" (UID: \"4ec5f063-5443-4ac8-a3ef-07cfbef2440e\") " Jul 06 19:41:55.051994 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.051960 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ec5f063-5443-4ac8-a3ef-07cfbef2440e" (UID: "4ec5f063-5443-4ac8-a3ef-07cfbef2440e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:41:55.053571 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.053533 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-kube-api-access-wv58h" (OuterVolumeSpecName: "kube-api-access-wv58h") pod "4ec5f063-5443-4ac8-a3ef-07cfbef2440e" (UID: "4ec5f063-5443-4ac8-a3ef-07cfbef2440e"). InnerVolumeSpecName "kube-api-access-wv58h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:41:55.152133 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.152103 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-extensions-socket-volume\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:41:55.152133 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.152128 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv58h\" (UniqueName: \"kubernetes.io/projected/4ec5f063-5443-4ac8-a3ef-07cfbef2440e-kube-api-access-wv58h\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:41:55.729748 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.729715 2585 generic.go:356] "Generic (PLEG): container finished" podID="4ec5f063-5443-4ac8-a3ef-07cfbef2440e" containerID="56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d" exitCode=0 Jul 06 19:41:55.730143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.729764 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" Jul 06 19:41:55.730143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.729802 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" event={"ID":"4ec5f063-5443-4ac8-a3ef-07cfbef2440e","Type":"ContainerDied","Data":"56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d"} Jul 06 19:41:55.730143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.729860 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv" event={"ID":"4ec5f063-5443-4ac8-a3ef-07cfbef2440e","Type":"ContainerDied","Data":"aed4756101d299cd1fe02376244ece3eda33e95b80786c22c2787901775ea1cd"} Jul 06 19:41:55.730143 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.729889 2585 scope.go:117] "RemoveContainer" containerID="56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d" Jul 06 19:41:55.738914 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.738900 2585 scope.go:117] "RemoveContainer" containerID="56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d" Jul 06 19:41:55.739160 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:41:55.739126 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d\": container with ID starting with 56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d not found: ID does not exist" containerID="56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d" Jul 06 19:41:55.739229 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.739177 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d"} err="failed to get container status \"56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d\": rpc error: code = NotFound desc = could not find container \"56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d\": container with ID starting with 56cbab98be13368986db3d5ce4bdda5ffda306064872b900451ba22d35ab888d not found: ID does not exist" Jul 06 19:41:55.754095 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.754072 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv"] Jul 06 19:41:55.762097 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:55.762078 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x96kv"] Jul 06 19:41:56.337411 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:41:56.337378 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec5f063-5443-4ac8-a3ef-07cfbef2440e" path="/var/lib/kubelet/pods/4ec5f063-5443-4ac8-a3ef-07cfbef2440e/volumes" Jul 06 19:42:11.289885 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.289850 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892"] Jul 06 19:42:11.290338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.290223 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec5f063-5443-4ac8-a3ef-07cfbef2440e" containerName="manager" Jul 06 19:42:11.290338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.290236 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec5f063-5443-4ac8-a3ef-07cfbef2440e" containerName="manager" Jul 06 19:42:11.290338 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.290286 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec5f063-5443-4ac8-a3ef-07cfbef2440e" containerName="manager" Jul 06 19:42:11.293057 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.293041 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.299326 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.299300 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rp9vz\"" Jul 06 19:42:11.324127 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.324094 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892"] Jul 06 19:42:11.380240 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380207 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380405 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380249 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380405 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380272 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380405 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380290 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fv87\" (UniqueName: \"kubernetes.io/projected/e9e128fd-3b1f-480a-aceb-0360abc27da1-kube-api-access-2fv87\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380465 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9e128fd-3b1f-480a-aceb-0360abc27da1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380482 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380542 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380510 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.380685 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.380582 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.481917 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.481879 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.481917 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.481921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.481941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.481975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482046 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fv87\" (UniqueName: \"kubernetes.io/projected/e9e128fd-3b1f-480a-aceb-0360abc27da1-kube-api-access-2fv87\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482120 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9e128fd-3b1f-480a-aceb-0360abc27da1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482543 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482452 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482543 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482498 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482611 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482593 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482683 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482668 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.482887 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.482866 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9e128fd-3b1f-480a-aceb-0360abc27da1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.484212 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.484188 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.484469 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.484451 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.509989 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.509961 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e128fd-3b1f-480a-aceb-0360abc27da1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.571054 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.570988 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fv87\" (UniqueName: \"kubernetes.io/projected/e9e128fd-3b1f-480a-aceb-0360abc27da1-kube-api-access-2fv87\") pod \"maas-default-gateway-openshift-default-56654dcf7-7d892\" (UID: \"e9e128fd-3b1f-480a-aceb-0360abc27da1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.603002 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.602980 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:11.779360 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.779338 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892"] Jul 06 19:42:11.783101 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:42:11.783074 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e128fd_3b1f_480a_aceb_0360abc27da1.slice/crio-fdab5f678f877ff0083f0206da0602263db5965d65256904b0caf066329437a3 WatchSource:0}: Error finding container fdab5f678f877ff0083f0206da0602263db5965d65256904b0caf066329437a3: Status 404 returned error can't find the container with id fdab5f678f877ff0083f0206da0602263db5965d65256904b0caf066329437a3 Jul 06 19:42:11.785597 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.785569 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:42:11.785655 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.785633 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:42:11.785690 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.785657 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:42:11.803917 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:11.803892 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" event={"ID":"e9e128fd-3b1f-480a-aceb-0360abc27da1","Type":"ContainerStarted","Data":"fdab5f678f877ff0083f0206da0602263db5965d65256904b0caf066329437a3"} Jul 06 19:42:12.810021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:12.809984 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" event={"ID":"e9e128fd-3b1f-480a-aceb-0360abc27da1","Type":"ContainerStarted","Data":"2cdd8a7f81da26a06a316fbd67101e013d519a919b37be8899315b02934ad298"} Jul 06 19:42:12.857010 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:12.856964 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" podStartSLOduration=1.8569503410000001 podStartE2EDuration="1.856950341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:12.855117966 +0000 UTC m=+565.154527412" watchObservedRunningTime="2026-07-06 19:42:12.856950341 +0000 UTC m=+565.156359787" Jul 06 19:42:13.603462 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:13.603427 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:13.608777 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:13.608743 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:13.814293 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:13.814262 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:13.815334 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:13.815313 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:42:15.418349 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.418314 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-l9qzk"] Jul 06 19:42:15.421918 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.421903 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:15.425708 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.425682 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4wlsv\"" Jul 06 19:42:15.439612 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.439592 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l9qzk"] Jul 06 19:42:15.517477 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.517450 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n24qx\" (UniqueName: \"kubernetes.io/projected/5ee11727-7869-4399-abb1-5e3aa64ba052-kube-api-access-n24qx\") pod \"authorino-58cd955675-l9qzk\" (UID: \"5ee11727-7869-4399-abb1-5e3aa64ba052\") " pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:15.618811 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.618774 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n24qx\" (UniqueName: \"kubernetes.io/projected/5ee11727-7869-4399-abb1-5e3aa64ba052-kube-api-access-n24qx\") pod \"authorino-58cd955675-l9qzk\" (UID: \"5ee11727-7869-4399-abb1-5e3aa64ba052\") " pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:15.629946 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.629918 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n24qx\" (UniqueName: \"kubernetes.io/projected/5ee11727-7869-4399-abb1-5e3aa64ba052-kube-api-access-n24qx\") pod \"authorino-58cd955675-l9qzk\" (UID: \"5ee11727-7869-4399-abb1-5e3aa64ba052\") " pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:15.747444 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.747360 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:15.816692 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.816660 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7j5xx"] Jul 06 19:42:15.820788 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.820769 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:15.862564 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.862538 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7j5xx"] Jul 06 19:42:15.916199 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:42:15.916170 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ee11727_7869_4399_abb1_5e3aa64ba052.slice/crio-681be57f509c48e10f08ee3c1da8f3db39d86ab71e15f1fdf6af5fa07f426066 WatchSource:0}: Error finding container 681be57f509c48e10f08ee3c1da8f3db39d86ab71e15f1fdf6af5fa07f426066: Status 404 returned error can't find the container with id 681be57f509c48e10f08ee3c1da8f3db39d86ab71e15f1fdf6af5fa07f426066 Jul 06 19:42:15.921533 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.921509 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l9qzk"] Jul 06 19:42:15.921734 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:15.921716 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p26k\" (UniqueName: \"kubernetes.io/projected/eb7b0519-ad5c-4015-808f-00657f9788ed-kube-api-access-4p26k\") pod \"authorino-75d556bd77-7j5xx\" (UID: \"eb7b0519-ad5c-4015-808f-00657f9788ed\") " pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:16.022671 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:16.022610 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p26k\" (UniqueName: \"kubernetes.io/projected/eb7b0519-ad5c-4015-808f-00657f9788ed-kube-api-access-4p26k\") pod \"authorino-75d556bd77-7j5xx\" (UID: \"eb7b0519-ad5c-4015-808f-00657f9788ed\") " pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:16.043800 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:16.043776 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p26k\" (UniqueName: \"kubernetes.io/projected/eb7b0519-ad5c-4015-808f-00657f9788ed-kube-api-access-4p26k\") pod \"authorino-75d556bd77-7j5xx\" (UID: \"eb7b0519-ad5c-4015-808f-00657f9788ed\") " pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:16.130325 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:16.130301 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:16.291976 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:16.291880 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7j5xx"] Jul 06 19:42:16.294530 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:42:16.294504 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb7b0519_ad5c_4015_808f_00657f9788ed.slice/crio-9ff632a4c3a8958288d1ae3242fcd8d06962f42ae5a5948a1d119865f55a56e3 WatchSource:0}: Error finding container 9ff632a4c3a8958288d1ae3242fcd8d06962f42ae5a5948a1d119865f55a56e3: Status 404 returned error can't find the container with id 9ff632a4c3a8958288d1ae3242fcd8d06962f42ae5a5948a1d119865f55a56e3 Jul 06 19:42:16.835801 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:16.835757 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l9qzk" event={"ID":"5ee11727-7869-4399-abb1-5e3aa64ba052","Type":"ContainerStarted","Data":"681be57f509c48e10f08ee3c1da8f3db39d86ab71e15f1fdf6af5fa07f426066"} Jul 06 19:42:16.838120 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:16.838054 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7j5xx" event={"ID":"eb7b0519-ad5c-4015-808f-00657f9788ed","Type":"ContainerStarted","Data":"9ff632a4c3a8958288d1ae3242fcd8d06962f42ae5a5948a1d119865f55a56e3"} Jul 06 19:42:19.858013 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:19.857971 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l9qzk" event={"ID":"5ee11727-7869-4399-abb1-5e3aa64ba052","Type":"ContainerStarted","Data":"c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2"} Jul 06 19:42:19.859455 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:19.859432 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7j5xx" event={"ID":"eb7b0519-ad5c-4015-808f-00657f9788ed","Type":"ContainerStarted","Data":"d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d"} Jul 06 19:42:19.885794 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:19.885750 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-l9qzk" podStartSLOduration=1.466010184 podStartE2EDuration="4.885736659s" totalImagesPullingTime="3.419726475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:19.884204721 +0000 UTC m=+572.183614168" watchObservedRunningTime="2026-07-06 19:42:19.885736659 +0000 UTC m=+572.185146110" Jul 06 19:42:19.985014 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:19.984964 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7j5xx" podStartSLOduration=1.9542397139999999 podStartE2EDuration="4.984947651s" totalImagesPullingTime="3.030707937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:19.926143518 +0000 UTC m=+572.225552966" watchObservedRunningTime="2026-07-06 19:42:19.984947651 +0000 UTC m=+572.284357099" Jul 06 19:42:19.985187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:19.985075 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l9qzk"] Jul 06 19:42:21.868208 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:21.868174 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-l9qzk" podUID="5ee11727-7869-4399-abb1-5e3aa64ba052" containerName="authorino" containerID="cri-o://c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2" gracePeriod=30 Jul 06 19:42:22.117083 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.117060 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:22.184562 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.184538 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n24qx\" (UniqueName: \"kubernetes.io/projected/5ee11727-7869-4399-abb1-5e3aa64ba052-kube-api-access-n24qx\") pod \"5ee11727-7869-4399-abb1-5e3aa64ba052\" (UID: \"5ee11727-7869-4399-abb1-5e3aa64ba052\") " Jul 06 19:42:22.186545 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.186509 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee11727-7869-4399-abb1-5e3aa64ba052-kube-api-access-n24qx" (OuterVolumeSpecName: "kube-api-access-n24qx") pod "5ee11727-7869-4399-abb1-5e3aa64ba052" (UID: "5ee11727-7869-4399-abb1-5e3aa64ba052"). InnerVolumeSpecName "kube-api-access-n24qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:42:22.285280 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.285251 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n24qx\" (UniqueName: \"kubernetes.io/projected/5ee11727-7869-4399-abb1-5e3aa64ba052-kube-api-access-n24qx\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:42:22.873576 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.873545 2585 generic.go:356] "Generic (PLEG): container finished" podID="5ee11727-7869-4399-abb1-5e3aa64ba052" containerID="c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2" exitCode=0 Jul 06 19:42:22.873978 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.873584 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l9qzk" event={"ID":"5ee11727-7869-4399-abb1-5e3aa64ba052","Type":"ContainerDied","Data":"c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2"} Jul 06 19:42:22.873978 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.873590 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l9qzk" Jul 06 19:42:22.873978 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.873609 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l9qzk" event={"ID":"5ee11727-7869-4399-abb1-5e3aa64ba052","Type":"ContainerDied","Data":"681be57f509c48e10f08ee3c1da8f3db39d86ab71e15f1fdf6af5fa07f426066"} Jul 06 19:42:22.873978 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.873625 2585 scope.go:117] "RemoveContainer" containerID="c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2" Jul 06 19:42:22.882020 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.882002 2585 scope.go:117] "RemoveContainer" containerID="c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2" Jul 06 19:42:22.882280 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:42:22.882258 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2\": container with ID starting with c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2 not found: ID does not exist" containerID="c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2" Jul 06 19:42:22.882355 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.882292 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2"} err="failed to get container status \"c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2\": rpc error: code = NotFound desc = could not find container \"c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2\": container with ID starting with c9c5382e57e6c255aaba5c3fa0c94bd852301c154e0b142e092686008e6a51c2 not found: ID does not exist" Jul 06 19:42:22.895306 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.895283 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l9qzk"] Jul 06 19:42:22.899666 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:22.899648 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-l9qzk"] Jul 06 19:42:24.337802 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:24.337759 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee11727-7869-4399-abb1-5e3aa64ba052" path="/var/lib/kubelet/pods/5ee11727-7869-4399-abb1-5e3aa64ba052/volumes" Jul 06 19:42:48.164346 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.164309 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:42:48.168434 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.168416 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:42:48.172199 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.172181 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:42:48.175691 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.175676 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:42:48.873494 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.873454 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7sc5j"] Jul 06 19:42:48.873869 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.873853 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee11727-7869-4399-abb1-5e3aa64ba052" containerName="authorino" Jul 06 19:42:48.873926 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.873871 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee11727-7869-4399-abb1-5e3aa64ba052" containerName="authorino" Jul 06 19:42:48.873972 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.873934 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee11727-7869-4399-abb1-5e3aa64ba052" containerName="authorino" Jul 06 19:42:48.878237 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.878218 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:48.888609 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.888589 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7sc5j"] Jul 06 19:42:48.915775 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:48.915748 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5gnv\" (UniqueName: \"kubernetes.io/projected/7c011959-df43-47b2-92b6-b70b4fe092aa-kube-api-access-x5gnv\") pod \"authorino-5d4b67c446-7sc5j\" (UID: \"7c011959-df43-47b2-92b6-b70b4fe092aa\") " pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:49.017098 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.017064 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5gnv\" (UniqueName: \"kubernetes.io/projected/7c011959-df43-47b2-92b6-b70b4fe092aa-kube-api-access-x5gnv\") pod \"authorino-5d4b67c446-7sc5j\" (UID: \"7c011959-df43-47b2-92b6-b70b4fe092aa\") " pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:49.026919 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.026894 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5gnv\" (UniqueName: \"kubernetes.io/projected/7c011959-df43-47b2-92b6-b70b4fe092aa-kube-api-access-x5gnv\") pod \"authorino-5d4b67c446-7sc5j\" (UID: \"7c011959-df43-47b2-92b6-b70b4fe092aa\") " pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:49.110468 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.110434 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7sc5j"] Jul 06 19:42:49.110749 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.110734 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:49.259198 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.259168 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7sc5j"] Jul 06 19:42:49.262037 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:42:49.262006 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c011959_df43_47b2_92b6_b70b4fe092aa.slice/crio-f9e6591749e01a3c8d7016914b56d8a7884e11eed5ab836749004f712cfe981e WatchSource:0}: Error finding container f9e6591749e01a3c8d7016914b56d8a7884e11eed5ab836749004f712cfe981e: Status 404 returned error can't find the container with id f9e6591749e01a3c8d7016914b56d8a7884e11eed5ab836749004f712cfe981e Jul 06 19:42:49.308352 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.308330 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b9595f9b9-82k4m"] Jul 06 19:42:49.314965 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.314948 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.317817 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.317797 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 19:42:49.319323 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.319303 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1091313e-6d05-47fd-acc1-1c5537da6729-tls-cert\") pod \"authorino-6b9595f9b9-82k4m\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.319409 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.319344 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2zm\" (UniqueName: \"kubernetes.io/projected/1091313e-6d05-47fd-acc1-1c5537da6729-kube-api-access-bv2zm\") pod \"authorino-6b9595f9b9-82k4m\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.323285 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.323263 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b9595f9b9-82k4m"] Jul 06 19:42:49.419854 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.419811 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1091313e-6d05-47fd-acc1-1c5537da6729-tls-cert\") pod \"authorino-6b9595f9b9-82k4m\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.420044 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.419891 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2zm\" (UniqueName: \"kubernetes.io/projected/1091313e-6d05-47fd-acc1-1c5537da6729-kube-api-access-bv2zm\") pod \"authorino-6b9595f9b9-82k4m\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.422393 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.422368 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1091313e-6d05-47fd-acc1-1c5537da6729-tls-cert\") pod \"authorino-6b9595f9b9-82k4m\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.429433 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.429384 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2zm\" (UniqueName: \"kubernetes.io/projected/1091313e-6d05-47fd-acc1-1c5537da6729-kube-api-access-bv2zm\") pod \"authorino-6b9595f9b9-82k4m\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.624735 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.624700 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:42:49.855367 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:49.855336 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b9595f9b9-82k4m"] Jul 06 19:42:49.857756 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:42:49.857728 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1091313e_6d05_47fd_acc1_1c5537da6729.slice/crio-0c3e7cfb04d8ebcd755594e632c5d9d291df58ef01bcc5726b5dfde34db6b09e WatchSource:0}: Error finding container 0c3e7cfb04d8ebcd755594e632c5d9d291df58ef01bcc5726b5dfde34db6b09e: Status 404 returned error can't find the container with id 0c3e7cfb04d8ebcd755594e632c5d9d291df58ef01bcc5726b5dfde34db6b09e Jul 06 19:42:50.000673 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:50.000590 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" event={"ID":"7c011959-df43-47b2-92b6-b70b4fe092aa","Type":"ContainerStarted","Data":"f9e6591749e01a3c8d7016914b56d8a7884e11eed5ab836749004f712cfe981e"} Jul 06 19:42:50.001697 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:50.001676 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" event={"ID":"1091313e-6d05-47fd-acc1-1c5537da6729","Type":"ContainerStarted","Data":"0c3e7cfb04d8ebcd755594e632c5d9d291df58ef01bcc5726b5dfde34db6b09e"} Jul 06 19:42:51.007742 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.007694 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" event={"ID":"1091313e-6d05-47fd-acc1-1c5537da6729","Type":"ContainerStarted","Data":"a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226"} Jul 06 19:42:51.009071 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.009045 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" event={"ID":"7c011959-df43-47b2-92b6-b70b4fe092aa","Type":"ContainerStarted","Data":"ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40"} Jul 06 19:42:51.009206 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.009103 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" podUID="7c011959-df43-47b2-92b6-b70b4fe092aa" containerName="authorino" containerID="cri-o://ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40" gracePeriod=30 Jul 06 19:42:51.030574 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.030527 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" podStartSLOduration=1.646959206 podStartE2EDuration="2.030513265s" totalImagesPullingTime="383.554059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:51.028892769 +0000 UTC m=+603.328302212" watchObservedRunningTime="2026-07-06 19:42:51.030513265 +0000 UTC m=+603.329922710" Jul 06 19:42:51.053194 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.053127 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" podStartSLOduration=2.178513784 podStartE2EDuration="3.053107464s" totalImagesPullingTime="874.59368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:51.052337782 +0000 UTC m=+603.351747229" watchObservedRunningTime="2026-07-06 19:42:51.053107464 +0000 UTC m=+603.352516910" Jul 06 19:42:51.074538 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.074512 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7j5xx"] Jul 06 19:42:51.074715 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.074693 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7j5xx" podUID="eb7b0519-ad5c-4015-808f-00657f9788ed" containerName="authorino" containerID="cri-o://d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d" gracePeriod=30 Jul 06 19:42:51.344568 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.344543 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:51.347661 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.347641 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:51.436544 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.436511 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5gnv\" (UniqueName: \"kubernetes.io/projected/7c011959-df43-47b2-92b6-b70b4fe092aa-kube-api-access-x5gnv\") pod \"7c011959-df43-47b2-92b6-b70b4fe092aa\" (UID: \"7c011959-df43-47b2-92b6-b70b4fe092aa\") " Jul 06 19:42:51.436683 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.436607 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p26k\" (UniqueName: \"kubernetes.io/projected/eb7b0519-ad5c-4015-808f-00657f9788ed-kube-api-access-4p26k\") pod \"eb7b0519-ad5c-4015-808f-00657f9788ed\" (UID: \"eb7b0519-ad5c-4015-808f-00657f9788ed\") " Jul 06 19:42:51.438499 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.438470 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c011959-df43-47b2-92b6-b70b4fe092aa-kube-api-access-x5gnv" (OuterVolumeSpecName: "kube-api-access-x5gnv") pod "7c011959-df43-47b2-92b6-b70b4fe092aa" (UID: "7c011959-df43-47b2-92b6-b70b4fe092aa"). InnerVolumeSpecName "kube-api-access-x5gnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:42:51.438602 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.438523 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb7b0519-ad5c-4015-808f-00657f9788ed-kube-api-access-4p26k" (OuterVolumeSpecName: "kube-api-access-4p26k") pod "eb7b0519-ad5c-4015-808f-00657f9788ed" (UID: "eb7b0519-ad5c-4015-808f-00657f9788ed"). InnerVolumeSpecName "kube-api-access-4p26k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:42:51.537515 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.537432 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p26k\" (UniqueName: \"kubernetes.io/projected/eb7b0519-ad5c-4015-808f-00657f9788ed-kube-api-access-4p26k\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:42:51.537515 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:51.537459 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5gnv\" (UniqueName: \"kubernetes.io/projected/7c011959-df43-47b2-92b6-b70b4fe092aa-kube-api-access-x5gnv\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:42:52.015272 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.015233 2585 generic.go:356] "Generic (PLEG): container finished" podID="7c011959-df43-47b2-92b6-b70b4fe092aa" containerID="ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40" exitCode=0 Jul 06 19:42:52.015744 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.015294 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" Jul 06 19:42:52.015744 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.015322 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" event={"ID":"7c011959-df43-47b2-92b6-b70b4fe092aa","Type":"ContainerDied","Data":"ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40"} Jul 06 19:42:52.015744 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.015374 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7sc5j" event={"ID":"7c011959-df43-47b2-92b6-b70b4fe092aa","Type":"ContainerDied","Data":"f9e6591749e01a3c8d7016914b56d8a7884e11eed5ab836749004f712cfe981e"} Jul 06 19:42:52.015744 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.015398 2585 scope.go:117] "RemoveContainer" containerID="ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40" Jul 06 19:42:52.016678 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.016655 2585 generic.go:356] "Generic (PLEG): container finished" podID="eb7b0519-ad5c-4015-808f-00657f9788ed" containerID="d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d" exitCode=0 Jul 06 19:42:52.016799 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.016722 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7j5xx" Jul 06 19:42:52.016799 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.016753 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7j5xx" event={"ID":"eb7b0519-ad5c-4015-808f-00657f9788ed","Type":"ContainerDied","Data":"d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d"} Jul 06 19:42:52.016799 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.016788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7j5xx" event={"ID":"eb7b0519-ad5c-4015-808f-00657f9788ed","Type":"ContainerDied","Data":"9ff632a4c3a8958288d1ae3242fcd8d06962f42ae5a5948a1d119865f55a56e3"} Jul 06 19:42:52.028959 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.028263 2585 scope.go:117] "RemoveContainer" containerID="ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40" Jul 06 19:42:52.028959 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:42:52.028799 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40\": container with ID starting with ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40 not found: ID does not exist" containerID="ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40" Jul 06 19:42:52.028959 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.028860 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40"} err="failed to get container status \"ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40\": rpc error: code = NotFound desc = could not find container \"ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40\": container with ID starting with ed4102e7f56f21176fe7cb5b58918caa37b5de8456a6288ac7fdeaad87ef5f40 not found: ID does not exist" Jul 06 19:42:52.028959 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.028882 2585 scope.go:117] "RemoveContainer" containerID="d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d" Jul 06 19:42:52.038624 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.038604 2585 scope.go:117] "RemoveContainer" containerID="d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d" Jul 06 19:42:52.038912 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:42:52.038889 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d\": container with ID starting with d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d not found: ID does not exist" containerID="d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d" Jul 06 19:42:52.038980 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.038919 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d"} err="failed to get container status \"d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d\": rpc error: code = NotFound desc = could not find container \"d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d\": container with ID starting with d10575c912d95e270faa3daa909a47cf1f0a2d417325e5bb1b568473bb23734d not found: ID does not exist" Jul 06 19:42:52.061965 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.061926 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7sc5j"] Jul 06 19:42:52.068928 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.068902 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7sc5j"] Jul 06 19:42:52.109612 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.109583 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7j5xx"] Jul 06 19:42:52.129080 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.129048 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7j5xx"] Jul 06 19:42:52.340574 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.340491 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c011959-df43-47b2-92b6-b70b4fe092aa" path="/var/lib/kubelet/pods/7c011959-df43-47b2-92b6-b70b4fe092aa/volumes" Jul 06 19:42:52.340820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:42:52.340807 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb7b0519-ad5c-4015-808f-00657f9788ed" path="/var/lib/kubelet/pods/eb7b0519-ad5c-4015-808f-00657f9788ed/volumes" Jul 06 19:43:32.723587 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.723550 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7pqc4"] Jul 06 19:43:32.725832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.723906 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7b0519-ad5c-4015-808f-00657f9788ed" containerName="authorino" Jul 06 19:43:32.725832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.723916 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7b0519-ad5c-4015-808f-00657f9788ed" containerName="authorino" Jul 06 19:43:32.725832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.723933 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c011959-df43-47b2-92b6-b70b4fe092aa" containerName="authorino" Jul 06 19:43:32.725832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.723938 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c011959-df43-47b2-92b6-b70b4fe092aa" containerName="authorino" Jul 06 19:43:32.725832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.723997 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c011959-df43-47b2-92b6-b70b4fe092aa" containerName="authorino" Jul 06 19:43:32.725832 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.724009 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7b0519-ad5c-4015-808f-00657f9788ed" containerName="authorino" Jul 06 19:43:32.726666 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.726652 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:32.730609 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.730589 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ztsvn\"" Jul 06 19:43:32.747957 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.747937 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 19:43:32.806497 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.806461 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7pqc4"] Jul 06 19:43:32.906859 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.906814 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4ss\" (UniqueName: \"kubernetes.io/projected/d34a5d42-90b1-407b-b306-41625d5341ab-kube-api-access-pq4ss\") pod \"payload-processing-58f86c7798-7pqc4\" (UID: \"d34a5d42-90b1-407b-b306-41625d5341ab\") " pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:32.907030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:32.906870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a5d42-90b1-407b-b306-41625d5341ab-plugins-config-volume\") pod \"payload-processing-58f86c7798-7pqc4\" (UID: \"d34a5d42-90b1-407b-b306-41625d5341ab\") " pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:33.007895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:33.007805 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4ss\" (UniqueName: \"kubernetes.io/projected/d34a5d42-90b1-407b-b306-41625d5341ab-kube-api-access-pq4ss\") pod \"payload-processing-58f86c7798-7pqc4\" (UID: \"d34a5d42-90b1-407b-b306-41625d5341ab\") " pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:33.007895 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:33.007858 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a5d42-90b1-407b-b306-41625d5341ab-plugins-config-volume\") pod \"payload-processing-58f86c7798-7pqc4\" (UID: \"d34a5d42-90b1-407b-b306-41625d5341ab\") " pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:33.008605 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:33.008585 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a5d42-90b1-407b-b306-41625d5341ab-plugins-config-volume\") pod \"payload-processing-58f86c7798-7pqc4\" (UID: \"d34a5d42-90b1-407b-b306-41625d5341ab\") " pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:33.022396 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:33.022374 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4ss\" (UniqueName: \"kubernetes.io/projected/d34a5d42-90b1-407b-b306-41625d5341ab-kube-api-access-pq4ss\") pod \"payload-processing-58f86c7798-7pqc4\" (UID: \"d34a5d42-90b1-407b-b306-41625d5341ab\") " pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:33.036910 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:33.036884 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:33.251921 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:33.251886 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7pqc4"] Jul 06 19:43:33.260207 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:43:33.260115 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34a5d42_90b1_407b_b306_41625d5341ab.slice/crio-29c16776709935ceb627ca900f24b234d43ae8608affeea57857df4f86309eab WatchSource:0}: Error finding container 29c16776709935ceb627ca900f24b234d43ae8608affeea57857df4f86309eab: Status 404 returned error can't find the container with id 29c16776709935ceb627ca900f24b234d43ae8608affeea57857df4f86309eab Jul 06 19:43:34.219665 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:34.219601 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" event={"ID":"d34a5d42-90b1-407b-b306-41625d5341ab","Type":"ContainerStarted","Data":"29c16776709935ceb627ca900f24b234d43ae8608affeea57857df4f86309eab"} Jul 06 19:43:35.225635 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:35.225599 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" event={"ID":"d34a5d42-90b1-407b-b306-41625d5341ab","Type":"ContainerStarted","Data":"8360ada5b25d7b38f8f9120cc454fe1f47e304c97c7b425bd75c66ba8776e08d"} Jul 06 19:43:35.226021 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:35.225702 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:43:35.257068 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:35.256988 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" podStartSLOduration=1.924029236 podStartE2EDuration="3.256964721s" totalImagesPullingTime="1.332935485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:35.254542541 +0000 UTC m=+647.553951989" watchObservedRunningTime="2026-07-06 19:43:35.256964721 +0000 UTC m=+647.556374168" Jul 06 19:43:40.253384 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:40.253312 2585 generic.go:356] "Generic (PLEG): container finished" podID="e9e128fd-3b1f-480a-aceb-0360abc27da1" containerID="2cdd8a7f81da26a06a316fbd67101e013d519a919b37be8899315b02934ad298" exitCode=0 Jul 06 19:43:40.253764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:40.253387 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" event={"ID":"e9e128fd-3b1f-480a-aceb-0360abc27da1","Type":"ContainerDied","Data":"2cdd8a7f81da26a06a316fbd67101e013d519a919b37be8899315b02934ad298"} Jul 06 19:43:40.253764 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:40.253750 2585 scope.go:117] "RemoveContainer" containerID="2cdd8a7f81da26a06a316fbd67101e013d519a919b37be8899315b02934ad298" Jul 06 19:43:40.254701 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:40.254679 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:43:40.254768 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:40.254746 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:43:40.254808 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:40.254777 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:43:41.267332 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:41.267302 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" event={"ID":"e9e128fd-3b1f-480a-aceb-0360abc27da1","Type":"ContainerStarted","Data":"62a9fb0bbb6998816e1e32897413133e2b8fa35739f6fc753371ceb483c4b0af"} Jul 06 19:43:41.603950 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:41.603851 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:43:41.605006 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:41.604982 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7d892 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:43:41.605081 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:41.605062 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" podUID="e9e128fd-3b1f-480a-aceb-0360abc27da1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 06 19:43:42.604436 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:42.604399 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7d892 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:43:42.604823 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:42.604453 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" podUID="e9e128fd-3b1f-480a-aceb-0360abc27da1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 06 19:43:43.604391 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:43.604351 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7d892 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:43:43.604580 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:43.604424 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" podUID="e9e128fd-3b1f-480a-aceb-0360abc27da1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 06 19:43:43.814379 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:43.814347 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:43:44.603581 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:44.603549 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7d892 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:43:44.603745 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:44.603599 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" podUID="e9e128fd-3b1f-480a-aceb-0360abc27da1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 06 19:43:45.607288 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:45.607258 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:43:45.608293 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:45.608272 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7d892" Jul 06 19:43:46.233239 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:43:46.233214 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-7pqc4" Jul 06 19:44:11.339073 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.339043 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9"] Jul 06 19:44:11.343570 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.343549 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.347936 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.347917 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:44:11.348952 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.348929 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 19:44:11.349500 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.349482 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rq94b\"" Jul 06 19:44:11.349784 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.349764 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:44:11.370752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.370729 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9"] Jul 06 19:44:11.470744 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.470718 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.470910 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.470765 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.470910 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.470827 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.470910 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.470856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.470910 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.470876 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9822bbb3-b51c-40b8-b029-abab19276c7e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.470910 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.470904 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkdrx\" (UniqueName: \"kubernetes.io/projected/9822bbb3-b51c-40b8-b029-abab19276c7e-kube-api-access-jkdrx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572052 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572019 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572103 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572120 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9822bbb3-b51c-40b8-b029-abab19276c7e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdrx\" (UniqueName: \"kubernetes.io/projected/9822bbb3-b51c-40b8-b029-abab19276c7e-kube-api-access-jkdrx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572246 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572511 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572485 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572572 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572545 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.572618 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.572604 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.574404 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.574381 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9822bbb3-b51c-40b8-b029-abab19276c7e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.574857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.574837 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9822bbb3-b51c-40b8-b029-abab19276c7e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.584937 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.584907 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkdrx\" (UniqueName: \"kubernetes.io/projected/9822bbb3-b51c-40b8-b029-abab19276c7e-kube-api-access-jkdrx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2rm9\" (UID: \"9822bbb3-b51c-40b8-b029-abab19276c7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.654106 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.654031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:11.805808 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:11.805785 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9"] Jul 06 19:44:11.808308 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:44:11.808284 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9822bbb3_b51c_40b8_b029_abab19276c7e.slice/crio-aabccc93aa378e6e6a1e4cfd3fae201978b06e282d921134e952a89763e8fbf1 WatchSource:0}: Error finding container aabccc93aa378e6e6a1e4cfd3fae201978b06e282d921134e952a89763e8fbf1: Status 404 returned error can't find the container with id aabccc93aa378e6e6a1e4cfd3fae201978b06e282d921134e952a89763e8fbf1 Jul 06 19:44:12.417374 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:12.417285 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" event={"ID":"9822bbb3-b51c-40b8-b029-abab19276c7e","Type":"ContainerStarted","Data":"aabccc93aa378e6e6a1e4cfd3fae201978b06e282d921134e952a89763e8fbf1"} Jul 06 19:44:13.423503 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:13.423472 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" event={"ID":"9822bbb3-b51c-40b8-b029-abab19276c7e","Type":"ContainerStarted","Data":"2fceb4200a2cbe7ae17a6c5aae8cc451bc09cfae0a71fd67a94117df6dfb9e03"} Jul 06 19:44:21.655134 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:21.655088 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:21.655549 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:21.655203 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:21.667414 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:21.667389 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:21.697297 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:21.697241 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" podStartSLOduration=9.577593615 podStartE2EDuration="10.697224882s" totalImagesPullingTime="1.119631267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:13.465219029 +0000 UTC m=+685.764628475" watchObservedRunningTime="2026-07-06 19:44:21.697224882 +0000 UTC m=+693.996634330" Jul 06 19:44:22.474839 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:22.474798 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2rm9" Jul 06 19:44:25.526664 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.526636 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn"] Jul 06 19:44:25.536570 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.536541 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.541513 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.541490 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 19:44:25.545554 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.545535 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn"] Jul 06 19:44:25.595222 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.595195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jbwx\" (UniqueName: \"kubernetes.io/projected/789e63d1-91b1-4419-b585-604d29323304-kube-api-access-2jbwx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.595339 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.595236 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.595339 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.595255 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789e63d1-91b1-4419-b585-604d29323304-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.595339 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.595299 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.595339 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.595335 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.595478 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.595367 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696362 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696330 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696527 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696368 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696527 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696447 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jbwx\" (UniqueName: \"kubernetes.io/projected/789e63d1-91b1-4419-b585-604d29323304-kube-api-access-2jbwx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696527 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696493 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696527 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696517 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789e63d1-91b1-4419-b585-604d29323304-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696721 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696547 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696721 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696705 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696820 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696792 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.696872 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.696836 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.698850 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.698813 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789e63d1-91b1-4419-b585-604d29323304-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.699018 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.699002 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789e63d1-91b1-4419-b585-604d29323304-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.706877 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.706848 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jbwx\" (UniqueName: \"kubernetes.io/projected/789e63d1-91b1-4419-b585-604d29323304-kube-api-access-2jbwx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7hqvn\" (UID: \"789e63d1-91b1-4419-b585-604d29323304\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.848730 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.848662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:25.994889 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:44:25.994855 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789e63d1_91b1_4419_b585_604d29323304.slice/crio-c1ebf9fa17692d8b665449fe3ce9b9ed78cb0c54ead55c72a5d22c3beb6b3d1e WatchSource:0}: Error finding container c1ebf9fa17692d8b665449fe3ce9b9ed78cb0c54ead55c72a5d22c3beb6b3d1e: Status 404 returned error can't find the container with id c1ebf9fa17692d8b665449fe3ce9b9ed78cb0c54ead55c72a5d22c3beb6b3d1e Jul 06 19:44:25.997419 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:25.997392 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn"] Jul 06 19:44:26.484092 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:26.484005 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" event={"ID":"789e63d1-91b1-4419-b585-604d29323304","Type":"ContainerStarted","Data":"967c4542efc46ec20254477df106443e415c5cd1dd5d87f392596cc6749818e2"} Jul 06 19:44:26.484092 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:26.484058 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" event={"ID":"789e63d1-91b1-4419-b585-604d29323304","Type":"ContainerStarted","Data":"c1ebf9fa17692d8b665449fe3ce9b9ed78cb0c54ead55c72a5d22c3beb6b3d1e"} Jul 06 19:44:26.509743 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:26.509697 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" podStartSLOduration=1.305260207 podStartE2EDuration="1.509681826s" totalImagesPullingTime="204.421619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:26.506941562 +0000 UTC m=+698.806351008" watchObservedRunningTime="2026-07-06 19:44:26.509681826 +0000 UTC m=+698.809091272" Jul 06 19:44:31.251690 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.251655 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn"] Jul 06 19:44:31.257937 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.257919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.264097 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.264074 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 19:44:31.283512 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.283482 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn"] Jul 06 19:44:31.348472 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.348440 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfq5d\" (UniqueName: \"kubernetes.io/projected/b8140316-8c50-4129-8e20-856a4b24be3f-kube-api-access-kfq5d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.348612 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.348530 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8140316-8c50-4129-8e20-856a4b24be3f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.348612 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.348557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.348612 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.348588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.348728 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.348679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.348760 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.348722 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.449839 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.449798 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8140316-8c50-4129-8e20-856a4b24be3f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.449844 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.449877 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.449925 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.449960 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450030 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.450004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfq5d\" (UniqueName: \"kubernetes.io/projected/b8140316-8c50-4129-8e20-856a4b24be3f-kube-api-access-kfq5d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450406 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.450381 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450454 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.450410 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.450489 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.450448 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.452270 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.452243 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8140316-8c50-4129-8e20-856a4b24be3f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.452447 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.452427 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8140316-8c50-4129-8e20-856a4b24be3f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.472973 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.472952 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfq5d\" (UniqueName: \"kubernetes.io/projected/b8140316-8c50-4129-8e20-856a4b24be3f-kube-api-access-kfq5d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn\" (UID: \"b8140316-8c50-4129-8e20-856a4b24be3f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.569276 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.569202 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:31.718572 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:31.718536 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn"] Jul 06 19:44:31.723608 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:44:31.723584 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8140316_8c50_4129_8e20_856a4b24be3f.slice/crio-cc6a8c8b40dd0bc1bf48398e711ee429f1455d2c7df042d9266e1188e41880f9 WatchSource:0}: Error finding container cc6a8c8b40dd0bc1bf48398e711ee429f1455d2c7df042d9266e1188e41880f9: Status 404 returned error can't find the container with id cc6a8c8b40dd0bc1bf48398e711ee429f1455d2c7df042d9266e1188e41880f9 Jul 06 19:44:32.512786 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:32.512750 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" event={"ID":"b8140316-8c50-4129-8e20-856a4b24be3f","Type":"ContainerStarted","Data":"d40f95009a4480f771402a56be697cbaea79a526a9d4236b8d7c7fcf1d3de502"} Jul 06 19:44:32.513142 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:32.512812 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" event={"ID":"b8140316-8c50-4129-8e20-856a4b24be3f","Type":"ContainerStarted","Data":"cc6a8c8b40dd0bc1bf48398e711ee429f1455d2c7df042d9266e1188e41880f9"} Jul 06 19:44:32.546867 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:32.546814 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" podStartSLOduration=1.364207937 podStartE2EDuration="1.546800454s" totalImagesPullingTime="182.592517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:32.546708277 +0000 UTC m=+704.846117723" watchObservedRunningTime="2026-07-06 19:44:32.546800454 +0000 UTC m=+704.846209900" Jul 06 19:44:35.849054 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:35.849020 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:35.849505 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:35.849086 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:35.861423 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:35.861401 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:36.543210 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:36.543180 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7hqvn" Jul 06 19:44:41.569365 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:41.569293 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:41.569746 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:41.569372 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:41.581817 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:41.581794 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:44:42.571125 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:44:42.571098 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn" Jul 06 19:46:54.218254 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.218213 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c44f4cf5b-g57dv"] Jul 06 19:46:54.222164 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.222130 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.238113 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.238084 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c44f4cf5b-g57dv"] Jul 06 19:46:54.300699 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.300668 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ct2\" (UniqueName: \"kubernetes.io/projected/697aadba-174a-432e-815f-b19631fb1497-kube-api-access-t4ct2\") pod \"authorino-c44f4cf5b-g57dv\" (UID: \"697aadba-174a-432e-815f-b19631fb1497\") " pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.300900 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.300724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697aadba-174a-432e-815f-b19631fb1497-tls-cert\") pod \"authorino-c44f4cf5b-g57dv\" (UID: \"697aadba-174a-432e-815f-b19631fb1497\") " pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.401655 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.401618 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ct2\" (UniqueName: \"kubernetes.io/projected/697aadba-174a-432e-815f-b19631fb1497-kube-api-access-t4ct2\") pod \"authorino-c44f4cf5b-g57dv\" (UID: \"697aadba-174a-432e-815f-b19631fb1497\") " pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.401813 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.401679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697aadba-174a-432e-815f-b19631fb1497-tls-cert\") pod \"authorino-c44f4cf5b-g57dv\" (UID: \"697aadba-174a-432e-815f-b19631fb1497\") " pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.404309 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.404284 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697aadba-174a-432e-815f-b19631fb1497-tls-cert\") pod \"authorino-c44f4cf5b-g57dv\" (UID: \"697aadba-174a-432e-815f-b19631fb1497\") " pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.424366 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.424343 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ct2\" (UniqueName: \"kubernetes.io/projected/697aadba-174a-432e-815f-b19631fb1497-kube-api-access-t4ct2\") pod \"authorino-c44f4cf5b-g57dv\" (UID: \"697aadba-174a-432e-815f-b19631fb1497\") " pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.532062 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.531979 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c44f4cf5b-g57dv" Jul 06 19:46:54.702194 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.702169 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:46:54.703461 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:54.703112 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c44f4cf5b-g57dv"] Jul 06 19:46:55.198302 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:55.198263 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c44f4cf5b-g57dv" event={"ID":"697aadba-174a-432e-815f-b19631fb1497","Type":"ContainerStarted","Data":"eebdf202f9a0c65a3f512850a65d9f79f1eec1dd643e786493264667de576455"} Jul 06 19:46:56.208680 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.208638 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c44f4cf5b-g57dv" event={"ID":"697aadba-174a-432e-815f-b19631fb1497","Type":"ContainerStarted","Data":"1e361aaa6cb3542a770503c22807edc6a61c1b9d91b097e32671bfcfeb735f00"} Jul 06 19:46:56.249967 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.249895 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c44f4cf5b-g57dv" podStartSLOduration=1.7948321699999998 podStartE2EDuration="2.24986929s" totalImagesPullingTime="455.03712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:56.249445905 +0000 UTC m=+848.548855371" watchObservedRunningTime="2026-07-06 19:46:56.24986929 +0000 UTC m=+848.549278823" Jul 06 19:46:56.310170 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.309240 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b9595f9b9-82k4m"] Jul 06 19:46:56.310170 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.309443 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" podUID="1091313e-6d05-47fd-acc1-1c5537da6729" containerName="authorino" containerID="cri-o://a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226" gracePeriod=30 Jul 06 19:46:56.580565 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.580540 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:46:56.634564 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.634521 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv2zm\" (UniqueName: \"kubernetes.io/projected/1091313e-6d05-47fd-acc1-1c5537da6729-kube-api-access-bv2zm\") pod \"1091313e-6d05-47fd-acc1-1c5537da6729\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " Jul 06 19:46:56.634747 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.634718 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1091313e-6d05-47fd-acc1-1c5537da6729-tls-cert\") pod \"1091313e-6d05-47fd-acc1-1c5537da6729\" (UID: \"1091313e-6d05-47fd-acc1-1c5537da6729\") " Jul 06 19:46:56.636840 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.636805 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1091313e-6d05-47fd-acc1-1c5537da6729-kube-api-access-bv2zm" (OuterVolumeSpecName: "kube-api-access-bv2zm") pod "1091313e-6d05-47fd-acc1-1c5537da6729" (UID: "1091313e-6d05-47fd-acc1-1c5537da6729"). InnerVolumeSpecName "kube-api-access-bv2zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:46:56.646387 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.646361 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1091313e-6d05-47fd-acc1-1c5537da6729-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1091313e-6d05-47fd-acc1-1c5537da6729" (UID: "1091313e-6d05-47fd-acc1-1c5537da6729"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:46:56.735970 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.735924 2585 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1091313e-6d05-47fd-acc1-1c5537da6729-tls-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:46:56.735970 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:56.735956 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv2zm\" (UniqueName: \"kubernetes.io/projected/1091313e-6d05-47fd-acc1-1c5537da6729-kube-api-access-bv2zm\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:46:57.217233 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.217184 2585 generic.go:356] "Generic (PLEG): container finished" podID="1091313e-6d05-47fd-acc1-1c5537da6729" containerID="a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226" exitCode=0 Jul 06 19:46:57.217233 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.217228 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" Jul 06 19:46:57.217857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.217269 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" event={"ID":"1091313e-6d05-47fd-acc1-1c5537da6729","Type":"ContainerDied","Data":"a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226"} Jul 06 19:46:57.217857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.217337 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9595f9b9-82k4m" event={"ID":"1091313e-6d05-47fd-acc1-1c5537da6729","Type":"ContainerDied","Data":"0c3e7cfb04d8ebcd755594e632c5d9d291df58ef01bcc5726b5dfde34db6b09e"} Jul 06 19:46:57.217857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.217366 2585 scope.go:117] "RemoveContainer" containerID="a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226" Jul 06 19:46:57.229548 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.229525 2585 scope.go:117] "RemoveContainer" containerID="a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226" Jul 06 19:46:57.229999 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:46:57.229978 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226\": container with ID starting with a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226 not found: ID does not exist" containerID="a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226" Jul 06 19:46:57.230079 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.230012 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226"} err="failed to get container status \"a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226\": rpc error: code = NotFound desc = could not find container \"a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226\": container with ID starting with a400487610ac4cd25bc11cd741231ef686c3fb0f9e5ec0e0aab3b69da6f21226 not found: ID does not exist" Jul 06 19:46:57.266834 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.266798 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b9595f9b9-82k4m"] Jul 06 19:46:57.271857 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:57.271830 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b9595f9b9-82k4m"] Jul 06 19:46:58.339773 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:46:58.339731 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1091313e-6d05-47fd-acc1-1c5537da6729" path="/var/lib/kubelet/pods/1091313e-6d05-47fd-acc1-1c5537da6729/volumes" Jul 06 19:47:48.196086 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:47:48.196001 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:47:48.199284 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:47:48.199261 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:47:48.203618 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:47:48.203598 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:47:48.206597 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:47:48.206577 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:52:48.227441 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:52:48.227367 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:52:48.227441 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:52:48.227421 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:52:48.234842 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:52:48.234797 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:52:48.234980 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:52:48.234868 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:53:12.349978 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:12.349940 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h"] Jul 06 19:53:12.350530 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:12.350167 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" podUID="ed8aa357-6f53-4cb7-a12f-528cd4676b4d" containerName="manager" containerID="cri-o://6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3" gracePeriod=10 Jul 06 19:53:14.516428 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.516401 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:53:14.556742 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.556708 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hdxv\" (UniqueName: \"kubernetes.io/projected/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-kube-api-access-4hdxv\") pod \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " Jul 06 19:53:14.556950 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.556767 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-extensions-socket-volume\") pod \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\" (UID: \"ed8aa357-6f53-4cb7-a12f-528cd4676b4d\") " Jul 06 19:53:14.557187 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.557141 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed8aa357-6f53-4cb7-a12f-528cd4676b4d" (UID: "ed8aa357-6f53-4cb7-a12f-528cd4676b4d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:53:14.558891 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.558856 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-kube-api-access-4hdxv" (OuterVolumeSpecName: "kube-api-access-4hdxv") pod "ed8aa357-6f53-4cb7-a12f-528cd4676b4d" (UID: "ed8aa357-6f53-4cb7-a12f-528cd4676b4d"). InnerVolumeSpecName "kube-api-access-4hdxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:53:14.658096 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.658066 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hdxv\" (UniqueName: \"kubernetes.io/projected/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-kube-api-access-4hdxv\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:53:14.658096 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:14.658096 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa357-6f53-4cb7-a12f-528cd4676b4d-extensions-socket-volume\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 19:53:15.105905 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.105803 2585 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa357-6f53-4cb7-a12f-528cd4676b4d" containerID="6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3" exitCode=0 Jul 06 19:53:15.105905 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.105858 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" Jul 06 19:53:15.105905 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.105887 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" event={"ID":"ed8aa357-6f53-4cb7-a12f-528cd4676b4d","Type":"ContainerDied","Data":"6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3"} Jul 06 19:53:15.106224 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.105944 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h" event={"ID":"ed8aa357-6f53-4cb7-a12f-528cd4676b4d","Type":"ContainerDied","Data":"3a1695a885f5961950d7ea619daf82669674e45fbb49bc79a428b9948c0006a4"} Jul 06 19:53:15.106224 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.105969 2585 scope.go:117] "RemoveContainer" containerID="6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3" Jul 06 19:53:15.115847 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.115825 2585 scope.go:117] "RemoveContainer" containerID="6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3" Jul 06 19:53:15.116140 ip-10-0-128-14 kubenswrapper[2585]: E0706 19:53:15.116121 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3\": container with ID starting with 6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3 not found: ID does not exist" containerID="6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3" Jul 06 19:53:15.116227 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.116168 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3"} err="failed to get container status \"6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3\": rpc error: code = NotFound desc = could not find container \"6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3\": container with ID starting with 6e789fcaf69589354f14fd718616356f979787fda8b2e152f2b302ae5a5aa0d3 not found: ID does not exist" Jul 06 19:53:15.130040 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.130008 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h"] Jul 06 19:53:15.137615 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:15.137587 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g7h5h"] Jul 06 19:53:16.337933 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:53:16.337900 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8aa357-6f53-4cb7-a12f-528cd4676b4d" path="/var/lib/kubelet/pods/ed8aa357-6f53-4cb7-a12f-528cd4676b4d/volumes" Jul 06 19:54:13.497040 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.496999 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn"] Jul 06 19:54:13.497566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.497433 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1091313e-6d05-47fd-acc1-1c5537da6729" containerName="authorino" Jul 06 19:54:13.497566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.497446 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1091313e-6d05-47fd-acc1-1c5537da6729" containerName="authorino" Jul 06 19:54:13.497566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.497464 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa357-6f53-4cb7-a12f-528cd4676b4d" containerName="manager" Jul 06 19:54:13.497566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.497469 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa357-6f53-4cb7-a12f-528cd4676b4d" containerName="manager" Jul 06 19:54:13.497566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.497540 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1091313e-6d05-47fd-acc1-1c5537da6729" containerName="authorino" Jul 06 19:54:13.497566 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.497551 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa357-6f53-4cb7-a12f-528cd4676b4d" containerName="manager" Jul 06 19:54:13.501794 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.501776 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.504432 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.504408 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-967bv\"" Jul 06 19:54:13.539702 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.539675 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn"] Jul 06 19:54:13.621581 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.621540 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h76kz\" (UniqueName: \"kubernetes.io/projected/1030917c-9794-40f7-a263-b8bd9254be4d-kube-api-access-h76kz\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4gn\" (UID: \"1030917c-9794-40f7-a263-b8bd9254be4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.621752 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.621626 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1030917c-9794-40f7-a263-b8bd9254be4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4gn\" (UID: \"1030917c-9794-40f7-a263-b8bd9254be4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.722552 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.722501 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1030917c-9794-40f7-a263-b8bd9254be4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4gn\" (UID: \"1030917c-9794-40f7-a263-b8bd9254be4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.722742 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.722603 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h76kz\" (UniqueName: \"kubernetes.io/projected/1030917c-9794-40f7-a263-b8bd9254be4d-kube-api-access-h76kz\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4gn\" (UID: \"1030917c-9794-40f7-a263-b8bd9254be4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.722901 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.722882 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1030917c-9794-40f7-a263-b8bd9254be4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4gn\" (UID: \"1030917c-9794-40f7-a263-b8bd9254be4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.732846 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.732812 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h76kz\" (UniqueName: \"kubernetes.io/projected/1030917c-9794-40f7-a263-b8bd9254be4d-kube-api-access-h76kz\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4gn\" (UID: \"1030917c-9794-40f7-a263-b8bd9254be4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:13.812003 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:13.811910 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:14.002966 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:14.002849 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn"] Jul 06 19:54:14.006041 ip-10-0-128-14 kubenswrapper[2585]: W0706 19:54:14.006003 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1030917c_9794_40f7_a263_b8bd9254be4d.slice/crio-96f9207ff62b6a628cae4b87ecf3ec546ce5318bed9af4e2b2a7f940193db70d WatchSource:0}: Error finding container 96f9207ff62b6a628cae4b87ecf3ec546ce5318bed9af4e2b2a7f940193db70d: Status 404 returned error can't find the container with id 96f9207ff62b6a628cae4b87ecf3ec546ce5318bed9af4e2b2a7f940193db70d Jul 06 19:54:14.405947 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:14.405849 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" event={"ID":"1030917c-9794-40f7-a263-b8bd9254be4d","Type":"ContainerStarted","Data":"57f5751b298ce1d406a6e1e33c6fb5376fc45d876f50cbb60b2976599df03964"} Jul 06 19:54:14.405947 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:14.405912 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" event={"ID":"1030917c-9794-40f7-a263-b8bd9254be4d","Type":"ContainerStarted","Data":"96f9207ff62b6a628cae4b87ecf3ec546ce5318bed9af4e2b2a7f940193db70d"} Jul 06 19:54:14.406139 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:14.405950 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:54:14.437651 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:14.437604 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" podStartSLOduration=1.437589103 podStartE2EDuration="1.437589103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:14.435425403 +0000 UTC m=+1286.734834849" watchObservedRunningTime="2026-07-06 19:54:14.437589103 +0000 UTC m=+1286.736998610" Jul 06 19:54:25.413901 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:54:25.413868 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4gn" Jul 06 19:57:48.258546 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:57:48.258428 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:57:48.262611 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:57:48.259460 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 19:57:48.266265 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:57:48.266243 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 19:57:48.267445 ip-10-0-128-14 kubenswrapper[2585]: I0706 19:57:48.267425 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:00:26.818208 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.818172 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v"] Jul 06 20:00:26.822597 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.822570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.825902 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.825879 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-53be5925-openshift-default-dockercfg-7bpql\"" Jul 06 20:00:26.833132 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833100 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-socket\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833274 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833185 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25f609e-7895-4cc0-9434-0a3d86554505-istio-podinfo\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833274 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833254 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-istio-token\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833387 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833283 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25f609e-7895-4cc0-9434-0a3d86554505-istiod-ca-cert\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833387 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833310 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jsbv\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-kube-api-access-8jsbv\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833486 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833453 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-certs\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833535 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833490 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-envoy\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833535 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833513 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-data\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.833640 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.833558 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-credential-socket\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.846046 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.846017 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v"] Jul 06 20:00:26.934104 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934063 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-envoy\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934104 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934102 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-data\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934144 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-credential-socket\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-socket\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934231 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25f609e-7895-4cc0-9434-0a3d86554505-istio-podinfo\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-istio-token\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934326 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25f609e-7895-4cc0-9434-0a3d86554505-istiod-ca-cert\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934366 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jsbv\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-kube-api-access-8jsbv\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934407 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-certs\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934768 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934620 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-data\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934768 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934670 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-certs\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.934896 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.934875 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-socket\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.935212 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.935188 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-credential-socket\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.935340 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.935316 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25f609e-7895-4cc0-9434-0a3d86554505-istiod-ca-cert\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.936767 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.936735 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-envoy\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.936913 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.936895 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25f609e-7895-4cc0-9434-0a3d86554505-istio-podinfo\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.948077 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.948052 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-istio-token\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:26.949782 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:26.949758 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jsbv\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-kube-api-access-8jsbv\") pod \"e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:27.134396 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:27.134266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:27.286982 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:27.286952 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v"] Jul 06 20:00:27.289255 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:00:27.289227 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25f609e_7895_4cc0_9434_0a3d86554505.slice/crio-a0ffd08b2ff8ad8f9315676f0c64c73e90c47e3f5d35f691b1ed003e20103f86 WatchSource:0}: Error finding container a0ffd08b2ff8ad8f9315676f0c64c73e90c47e3f5d35f691b1ed003e20103f86: Status 404 returned error can't find the container with id a0ffd08b2ff8ad8f9315676f0c64c73e90c47e3f5d35f691b1ed003e20103f86 Jul 06 20:00:27.291418 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:27.291387 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:27.291494 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:27.291455 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:27.291494 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:27.291489 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:28.299636 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:28.299597 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" event={"ID":"e25f609e-7895-4cc0-9434-0a3d86554505","Type":"ContainerStarted","Data":"d78ca4a0dee9c876fb023d40e1c9ec89e4a1d6beba5c796bf6aea9a0a3086fea"} Jul 06 20:00:28.300075 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:28.299685 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" event={"ID":"e25f609e-7895-4cc0-9434-0a3d86554505","Type":"ContainerStarted","Data":"a0ffd08b2ff8ad8f9315676f0c64c73e90c47e3f5d35f691b1ed003e20103f86"} Jul 06 20:00:28.337498 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:28.337431 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" podStartSLOduration=2.337408102 podStartE2EDuration="2.337408102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:28.336298182 +0000 UTC m=+1660.635707629" watchObservedRunningTime="2026-07-06 20:00:28.337408102 +0000 UTC m=+1660.636817548" Jul 06 20:00:29.135024 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:29.134985 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:29.140485 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:29.140453 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:29.304650 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:29.304620 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:29.305413 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:29.305392 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:33.168614 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:33.168579 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v"] Jul 06 20:00:33.169103 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:33.168825 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" podUID="e25f609e-7895-4cc0-9434-0a3d86554505" containerName="istio-proxy" containerID="cri-o://d78ca4a0dee9c876fb023d40e1c9ec89e4a1d6beba5c796bf6aea9a0a3086fea" gracePeriod=30 Jul 06 20:00:38.352955 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.352924 2585 generic.go:356] "Generic (PLEG): container finished" podID="e25f609e-7895-4cc0-9434-0a3d86554505" containerID="d78ca4a0dee9c876fb023d40e1c9ec89e4a1d6beba5c796bf6aea9a0a3086fea" exitCode=0 Jul 06 20:00:38.353361 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.352997 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" event={"ID":"e25f609e-7895-4cc0-9434-0a3d86554505","Type":"ContainerDied","Data":"d78ca4a0dee9c876fb023d40e1c9ec89e4a1d6beba5c796bf6aea9a0a3086fea"} Jul 06 20:00:38.436736 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.436666 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:38.554404 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554372 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25f609e-7895-4cc0-9434-0a3d86554505-istio-podinfo\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554588 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554467 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-data\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554588 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554539 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jsbv\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-kube-api-access-8jsbv\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554588 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554579 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-istio-token\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554717 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554599 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-credential-socket\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554717 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554629 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25f609e-7895-4cc0-9434-0a3d86554505-istiod-ca-cert\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554717 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554645 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-envoy\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554717 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554678 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-socket\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554932 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554720 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-certs\") pod \"e25f609e-7895-4cc0-9434-0a3d86554505\" (UID: \"e25f609e-7895-4cc0-9434-0a3d86554505\") " Jul 06 20:00:38.554932 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.554905 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:38.555170 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.555093 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.555170 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.555093 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:38.555357 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.555293 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:38.555419 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.555389 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e25f609e-7895-4cc0-9434-0a3d86554505-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:00:38.555578 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.555553 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-data" (OuterVolumeSpecName: "istio-data") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:38.556900 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.556865 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-kube-api-access-8jsbv" (OuterVolumeSpecName: "kube-api-access-8jsbv") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "kube-api-access-8jsbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:38.557035 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.556940 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:38.557233 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.557202 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e25f609e-7895-4cc0-9434-0a3d86554505-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:00:38.557233 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.557219 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-istio-token" (OuterVolumeSpecName: "istio-token") pod "e25f609e-7895-4cc0-9434-0a3d86554505" (UID: "e25f609e-7895-4cc0-9434-0a3d86554505"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:38.655752 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655717 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.655752 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655747 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25f609e-7895-4cc0-9434-0a3d86554505-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.655752 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655756 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.656009 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655764 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jsbv\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-kube-api-access-8jsbv\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.656009 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655773 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25f609e-7895-4cc0-9434-0a3d86554505-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.656009 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655786 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25f609e-7895-4cc0-9434-0a3d86554505-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.656009 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655798 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:38.656009 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:38.655809 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25f609e-7895-4cc0-9434-0a3d86554505-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.359820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.359786 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" Jul 06 20:00:39.360326 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.359790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v" event={"ID":"e25f609e-7895-4cc0-9434-0a3d86554505","Type":"ContainerDied","Data":"a0ffd08b2ff8ad8f9315676f0c64c73e90c47e3f5d35f691b1ed003e20103f86"} Jul 06 20:00:39.360326 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.359924 2585 scope.go:117] "RemoveContainer" containerID="d78ca4a0dee9c876fb023d40e1c9ec89e4a1d6beba5c796bf6aea9a0a3086fea" Jul 06 20:00:39.385028 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.384993 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v"] Jul 06 20:00:39.389516 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.389485 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-53be5925-openshift-default-5d567ccf95-g4q8v"] Jul 06 20:00:39.709643 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.709605 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h"] Jul 06 20:00:39.710199 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.710174 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25f609e-7895-4cc0-9434-0a3d86554505" containerName="istio-proxy" Jul 06 20:00:39.710199 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.710198 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25f609e-7895-4cc0-9434-0a3d86554505" containerName="istio-proxy" Jul 06 20:00:39.710374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.710324 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25f609e-7895-4cc0-9434-0a3d86554505" containerName="istio-proxy" Jul 06 20:00:39.715442 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.715419 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.718808 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.718775 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1dd1d29f-gw-openshift-default-dockercfg-lgv7t\"" Jul 06 20:00:39.735803 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.735775 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h"] Jul 06 20:00:39.767566 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767524 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-certs\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.767754 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767569 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-data\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.767754 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767704 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-socket\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.767859 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767756 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-envoy\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.767859 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767783 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-podinfo\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.767859 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767803 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrqx4\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-kube-api-access-jrqx4\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.767859 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767825 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istiod-ca-cert\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.768057 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767893 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-credential-socket\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.768057 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.767989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-token\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.868923 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.868876 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-socket\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.868923 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.868933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-envoy\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.868961 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-podinfo\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.868986 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrqx4\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-kube-api-access-jrqx4\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869007 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istiod-ca-cert\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-credential-socket\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-token\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869175 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-certs\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869207 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869202 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-data\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869576 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869397 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-socket\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869576 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869503 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-credential-socket\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869576 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869570 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-data\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869699 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869676 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-certs\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.869998 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.869974 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istiod-ca-cert\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.871555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.871532 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-envoy\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.871687 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.871669 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-podinfo\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.878198 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.878131 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-token\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:39.878357 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:39.878244 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrqx4\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-kube-api-access-jrqx4\") pod \"e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:40.026986 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.026876 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:40.181787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.181762 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h"] Jul 06 20:00:40.183943 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:00:40.183905 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7844e21b_2a75_4abf_bd50_fce8c9d136c7.slice/crio-b2d2133000abdcc70360ee89c4b00661225c381f6863d708647296ecafca6e4b WatchSource:0}: Error finding container b2d2133000abdcc70360ee89c4b00661225c381f6863d708647296ecafca6e4b: Status 404 returned error can't find the container with id b2d2133000abdcc70360ee89c4b00661225c381f6863d708647296ecafca6e4b Jul 06 20:00:40.186228 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.186188 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:40.186325 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.186281 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:40.186365 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.186331 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:40.340498 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.340405 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25f609e-7895-4cc0-9434-0a3d86554505" path="/var/lib/kubelet/pods/e25f609e-7895-4cc0-9434-0a3d86554505/volumes" Jul 06 20:00:40.367696 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.367660 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" event={"ID":"7844e21b-2a75-4abf-bd50-fce8c9d136c7","Type":"ContainerStarted","Data":"92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66"} Jul 06 20:00:40.368218 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.367717 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" event={"ID":"7844e21b-2a75-4abf-bd50-fce8c9d136c7","Type":"ContainerStarted","Data":"b2d2133000abdcc70360ee89c4b00661225c381f6863d708647296ecafca6e4b"} Jul 06 20:00:40.391296 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:40.391243 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" podStartSLOduration=1.391225755 podStartE2EDuration="1.391225755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:40.389338442 +0000 UTC m=+1672.688747888" watchObservedRunningTime="2026-07-06 20:00:40.391225755 +0000 UTC m=+1672.690635201" Jul 06 20:00:41.027392 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:41.027346 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:41.032747 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:41.032714 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:41.376737 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:41.376641 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:41.377693 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:41.377667 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:45.748183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:45.748115 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h"] Jul 06 20:00:45.748888 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:45.748361 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" podUID="7844e21b-2a75-4abf-bd50-fce8c9d136c7" containerName="istio-proxy" containerID="cri-o://92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66" gracePeriod=30 Jul 06 20:00:51.001324 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.001285 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:51.086310 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086211 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-certs\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086310 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086260 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-credential-socket\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086334 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-podinfo\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086362 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-data\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086397 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-token\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086476 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-envoy\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086504 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-socket\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086551 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:51.086820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086589 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istiod-ca-cert\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086613 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrqx4\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-kube-api-access-jrqx4\") pod \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\" (UID: \"7844e21b-2a75-4abf-bd50-fce8c9d136c7\") " Jul 06 20:00:51.086820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086661 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:51.087064 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086816 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:51.087064 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086849 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:51.087064 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.086981 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:00:51.087064 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.087032 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.087064 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.087053 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.087336 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.087067 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.087336 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.087083 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.088864 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.088828 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:51.088864 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.088841 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:00:51.089141 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.089118 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-kube-api-access-jrqx4" (OuterVolumeSpecName: "kube-api-access-jrqx4") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "kube-api-access-jrqx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:51.089244 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.089129 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7844e21b-2a75-4abf-bd50-fce8c9d136c7" (UID: "7844e21b-2a75-4abf-bd50-fce8c9d136c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:51.188415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.188370 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.188415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.188409 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.188415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.188419 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrqx4\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-kube-api-access-jrqx4\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.188415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.188430 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.188735 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.188439 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7844e21b-2a75-4abf-bd50-fce8c9d136c7-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:00:51.429850 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.429814 2585 generic.go:356] "Generic (PLEG): container finished" podID="7844e21b-2a75-4abf-bd50-fce8c9d136c7" containerID="92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66" exitCode=0 Jul 06 20:00:51.430046 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.429858 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" event={"ID":"7844e21b-2a75-4abf-bd50-fce8c9d136c7","Type":"ContainerDied","Data":"92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66"} Jul 06 20:00:51.430046 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.429867 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" Jul 06 20:00:51.430046 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.429906 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h" event={"ID":"7844e21b-2a75-4abf-bd50-fce8c9d136c7","Type":"ContainerDied","Data":"b2d2133000abdcc70360ee89c4b00661225c381f6863d708647296ecafca6e4b"} Jul 06 20:00:51.430046 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.429927 2585 scope.go:117] "RemoveContainer" containerID="92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66" Jul 06 20:00:51.440359 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.440338 2585 scope.go:117] "RemoveContainer" containerID="92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66" Jul 06 20:00:51.440708 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:00:51.440683 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66\": container with ID starting with 92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66 not found: ID does not exist" containerID="92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66" Jul 06 20:00:51.440791 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.440716 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66"} err="failed to get container status \"92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66\": rpc error: code = NotFound desc = could not find container \"92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66\": container with ID starting with 92c5ed32a92d2bf8e26717f65b4edce675c58066a8e2ed7f9756afbe1b8a5b66 not found: ID does not exist" Jul 06 20:00:51.454264 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.454229 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h"] Jul 06 20:00:51.457539 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:51.457510 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1dd1d29f-gw-openshift-default-87bf57c9f-tg54h"] Jul 06 20:00:52.159259 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.159219 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl"] Jul 06 20:00:52.159838 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.159816 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7844e21b-2a75-4abf-bd50-fce8c9d136c7" containerName="istio-proxy" Jul 06 20:00:52.159927 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.159840 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7844e21b-2a75-4abf-bd50-fce8c9d136c7" containerName="istio-proxy" Jul 06 20:00:52.159984 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.159951 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7844e21b-2a75-4abf-bd50-fce8c9d136c7" containerName="istio-proxy" Jul 06 20:00:52.164451 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.164427 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.167563 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.167544 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-73a70dd2-openshift-default-dockercfg-g2mkv\"" Jul 06 20:00:52.189912 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.189870 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl"] Jul 06 20:00:52.302381 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302345 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-credential-socket\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302580 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302391 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-token\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302580 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302432 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p6g\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-kube-api-access-75p6g\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302580 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-data\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302580 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302498 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-podinfo\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302580 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302526 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-envoy\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-certs\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302611 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istiod-ca-cert\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.302820 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.302679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-socket\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.339456 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.339414 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7844e21b-2a75-4abf-bd50-fce8c9d136c7" path="/var/lib/kubelet/pods/7844e21b-2a75-4abf-bd50-fce8c9d136c7/volumes" Jul 06 20:00:52.403785 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-token\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.403785 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403732 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75p6g\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-kube-api-access-75p6g\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.403785 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403775 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-data\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404094 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403797 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-podinfo\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404094 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403826 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-envoy\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404094 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403893 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-certs\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404094 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.403931 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istiod-ca-cert\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404350 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404089 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-socket\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404350 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404175 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-credential-socket\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404350 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404297 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-data\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404483 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404394 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-certs\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404529 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404484 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-socket\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404529 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404514 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-credential-socket\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.404753 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.404731 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istiod-ca-cert\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.406372 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.406352 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-envoy\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.406509 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.406491 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-podinfo\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.412982 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.412948 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-token\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.413123 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.413079 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p6g\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-kube-api-access-75p6g\") pod \"e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.474635 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.474604 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:52.629442 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.629407 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl"] Jul 06 20:00:52.631201 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:00:52.631166 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff601ee_ecb6_41e0_b883_16a1a6be07c1.slice/crio-557cf9a744f33df4443141f4cdf6de9a7c58c078828dece5508d79635d427568 WatchSource:0}: Error finding container 557cf9a744f33df4443141f4cdf6de9a7c58c078828dece5508d79635d427568: Status 404 returned error can't find the container with id 557cf9a744f33df4443141f4cdf6de9a7c58c078828dece5508d79635d427568 Jul 06 20:00:52.633589 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.633555 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:52.633674 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.633633 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:52.633714 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:52.633671 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:00:53.445473 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:53.445430 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" event={"ID":"9ff601ee-ecb6-41e0-b883-16a1a6be07c1","Type":"ContainerStarted","Data":"548bb9caec639931e62236981d39a5b1656e4b22e5db8f52ba1a5ad2c448fc9c"} Jul 06 20:00:53.445969 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:53.445491 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" event={"ID":"9ff601ee-ecb6-41e0-b883-16a1a6be07c1","Type":"ContainerStarted","Data":"557cf9a744f33df4443141f4cdf6de9a7c58c078828dece5508d79635d427568"} Jul 06 20:00:53.474878 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:53.474845 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:53.477559 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:53.477508 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" podStartSLOduration=1.47749141 podStartE2EDuration="1.47749141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:53.475426332 +0000 UTC m=+1685.774835777" watchObservedRunningTime="2026-07-06 20:00:53.47749141 +0000 UTC m=+1685.776900855" Jul 06 20:00:53.480417 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:53.480389 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:54.450798 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:54.450765 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:00:54.451751 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:00:54.451728 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:01:04.481809 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.481766 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl"] Jul 06 20:01:04.482371 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.481995 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" podUID="9ff601ee-ecb6-41e0-b883-16a1a6be07c1" containerName="istio-proxy" containerID="cri-o://548bb9caec639931e62236981d39a5b1656e4b22e5db8f52ba1a5ad2c448fc9c" gracePeriod=30 Jul 06 20:01:04.506407 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.506359 2585 generic.go:356] "Generic (PLEG): container finished" podID="9ff601ee-ecb6-41e0-b883-16a1a6be07c1" containerID="548bb9caec639931e62236981d39a5b1656e4b22e5db8f52ba1a5ad2c448fc9c" exitCode=0 Jul 06 20:01:04.506578 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.506438 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" event={"ID":"9ff601ee-ecb6-41e0-b883-16a1a6be07c1","Type":"ContainerDied","Data":"548bb9caec639931e62236981d39a5b1656e4b22e5db8f52ba1a5ad2c448fc9c"} Jul 06 20:01:04.656372 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.656345 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:01:04.732214 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732116 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75p6g\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-kube-api-access-75p6g\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732214 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732173 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-certs\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732250 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-credential-socket\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732323 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-envoy\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732349 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-socket\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732415 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732393 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-podinfo\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732444 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-token\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732486 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istiod-ca-cert\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732495 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:04.732631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732508 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:04.732631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732512 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-data\") pod \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\" (UID: \"9ff601ee-ecb6-41e0-b883-16a1a6be07c1\") " Jul 06 20:01:04.732631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732613 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:04.732937 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732919 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.732993 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732942 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.732993 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.732956 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.733092 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.733028 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:01:04.733334 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.733311 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:04.734573 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.734549 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-kube-api-access-75p6g" (OuterVolumeSpecName: "kube-api-access-75p6g") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "kube-api-access-75p6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:01:04.735023 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.735003 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:04.735097 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.735022 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:01:04.735226 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.735203 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ff601ee-ecb6-41e0-b883-16a1a6be07c1" (UID: "9ff601ee-ecb6-41e0-b883-16a1a6be07c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:01:04.834001 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.833964 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.834001 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.833995 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.834001 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.834004 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75p6g\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-kube-api-access-75p6g\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.834001 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.834015 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.834304 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.834024 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:04.834304 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:04.834032 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff601ee-ecb6-41e0-b883-16a1a6be07c1-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:05.512723 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:05.512688 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" event={"ID":"9ff601ee-ecb6-41e0-b883-16a1a6be07c1","Type":"ContainerDied","Data":"557cf9a744f33df4443141f4cdf6de9a7c58c078828dece5508d79635d427568"} Jul 06 20:01:05.512723 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:05.512727 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl" Jul 06 20:01:05.513294 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:05.512753 2585 scope.go:117] "RemoveContainer" containerID="548bb9caec639931e62236981d39a5b1656e4b22e5db8f52ba1a5ad2c448fc9c" Jul 06 20:01:05.538299 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:05.538267 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl"] Jul 06 20:01:05.546003 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:05.545976 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-73a70dd2-openshift-default-f6958c975-l8wsl"] Jul 06 20:01:06.338991 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:06.338955 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff601ee-ecb6-41e0-b883-16a1a6be07c1" path="/var/lib/kubelet/pods/9ff601ee-ecb6-41e0-b883-16a1a6be07c1/volumes" Jul 06 20:01:10.781594 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.781563 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh"] Jul 06 20:01:10.782252 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.782217 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff601ee-ecb6-41e0-b883-16a1a6be07c1" containerName="istio-proxy" Jul 06 20:01:10.782252 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.782240 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff601ee-ecb6-41e0-b883-16a1a6be07c1" containerName="istio-proxy" Jul 06 20:01:10.782442 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.782383 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff601ee-ecb6-41e0-b883-16a1a6be07c1" containerName="istio-proxy" Jul 06 20:01:10.786011 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.785990 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.788688 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.788664 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0dc8851b-openshift-default-dockercfg-mwvn7\"" Jul 06 20:01:10.799952 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.799918 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh"] Jul 06 20:01:10.893969 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.893936 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31d7407-a610-4c05-8a0f-ee53bac739af-istiod-ca-cert\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.893969 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.893983 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-data\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894275 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894098 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-certs\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894275 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894174 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-podinfo\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894275 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894215 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdfn\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-kube-api-access-wrdfn\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894275 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894249 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-credential-socket\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894479 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894356 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-envoy\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894479 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894454 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-token\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.894604 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.894537 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-socket\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.995887 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.995845 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-certs\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.995887 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.995892 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-podinfo\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.995917 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdfn\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-kube-api-access-wrdfn\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.995938 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-credential-socket\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.995958 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-envoy\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.995983 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-token\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-socket\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31d7407-a610-4c05-8a0f-ee53bac739af-istiod-ca-cert\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996180 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996098 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-data\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996520 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996370 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-certs\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996520 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996424 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-socket\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996688 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996664 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-credential-socket\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996737 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996676 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-data\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.996906 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.996887 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31d7407-a610-4c05-8a0f-ee53bac739af-istiod-ca-cert\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.998220 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.998197 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-envoy\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:10.998578 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:10.998560 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-podinfo\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:11.015929 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.015895 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdfn\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-kube-api-access-wrdfn\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:11.022254 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.022217 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-token\") pod \"e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:11.097390 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.097296 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:11.249348 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.249317 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh"] Jul 06 20:01:11.251216 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:01:11.251187 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31d7407_a610_4c05_8a0f_ee53bac739af.slice/crio-33a7feb0387f22e02e16de30f29bccff0bb5cf2cbf8c78b10c60d8cbbe485623 WatchSource:0}: Error finding container 33a7feb0387f22e02e16de30f29bccff0bb5cf2cbf8c78b10c60d8cbbe485623: Status 404 returned error can't find the container with id 33a7feb0387f22e02e16de30f29bccff0bb5cf2cbf8c78b10c60d8cbbe485623 Jul 06 20:01:11.253279 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.253244 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:01:11.253383 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.253323 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:01:11.253383 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.253365 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:01:11.545600 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.545563 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" event={"ID":"c31d7407-a610-4c05-8a0f-ee53bac739af","Type":"ContainerStarted","Data":"ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb"} Jul 06 20:01:11.545773 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.545618 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" event={"ID":"c31d7407-a610-4c05-8a0f-ee53bac739af","Type":"ContainerStarted","Data":"33a7feb0387f22e02e16de30f29bccff0bb5cf2cbf8c78b10c60d8cbbe485623"} Jul 06 20:01:11.569692 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:11.569637 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" podStartSLOduration=1.569617211 podStartE2EDuration="1.569617211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:11.568365853 +0000 UTC m=+1703.867775325" watchObservedRunningTime="2026-07-06 20:01:11.569617211 +0000 UTC m=+1703.869026658" Jul 06 20:01:12.098297 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:12.098268 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:12.103359 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:12.103332 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:12.551626 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:12.551596 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:12.552591 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:12.552571 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:16.517119 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:16.517081 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh"] Jul 06 20:01:16.517543 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:16.517331 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" podUID="c31d7407-a610-4c05-8a0f-ee53bac739af" containerName="istio-proxy" containerID="cri-o://ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb" gracePeriod=30 Jul 06 20:01:23.776251 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.776226 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:23.941658 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.941617 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-data\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.941821 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.941675 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-token\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.941821 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.941764 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31d7407-a610-4c05-8a0f-ee53bac739af-istiod-ca-cert\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.941950 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.941926 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-certs\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.942014 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.941997 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-podinfo\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.942073 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942051 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-envoy\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.942129 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942082 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrdfn\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-kube-api-access-wrdfn\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.942211 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942176 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-socket\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.942276 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942211 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-credential-socket\") pod \"c31d7407-a610-4c05-8a0f-ee53bac739af\" (UID: \"c31d7407-a610-4c05-8a0f-ee53bac739af\") " Jul 06 20:01:23.942276 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942118 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c31d7407-a610-4c05-8a0f-ee53bac739af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:01:23.942276 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942227 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:23.942458 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942433 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-data" (OuterVolumeSpecName: "istio-data") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:23.942635 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942615 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:23.942726 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942642 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31d7407-a610-4c05-8a0f-ee53bac739af-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:23.942726 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942656 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:23.942726 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942674 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:23.942726 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.942689 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:23.944079 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.944055 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-token" (OuterVolumeSpecName: "istio-token") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:01:23.944301 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.944274 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:01:23.944756 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.944730 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:23.944807 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:23.944737 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-kube-api-access-wrdfn" (OuterVolumeSpecName: "kube-api-access-wrdfn") pod "c31d7407-a610-4c05-8a0f-ee53bac739af" (UID: "c31d7407-a610-4c05-8a0f-ee53bac739af"). InnerVolumeSpecName "kube-api-access-wrdfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:01:24.043183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.043137 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:24.043183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.043181 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:24.043382 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.043191 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrdfn\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-kube-api-access-wrdfn\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:24.043382 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.043202 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:24.043382 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.043210 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31d7407-a610-4c05-8a0f-ee53bac739af-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:24.043382 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.043218 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31d7407-a610-4c05-8a0f-ee53bac739af-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:01:24.612924 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.612837 2585 generic.go:356] "Generic (PLEG): container finished" podID="c31d7407-a610-4c05-8a0f-ee53bac739af" containerID="ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb" exitCode=0 Jul 06 20:01:24.612924 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.612886 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" event={"ID":"c31d7407-a610-4c05-8a0f-ee53bac739af","Type":"ContainerDied","Data":"ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb"} Jul 06 20:01:24.612924 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.612903 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" Jul 06 20:01:24.613174 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.612932 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh" event={"ID":"c31d7407-a610-4c05-8a0f-ee53bac739af","Type":"ContainerDied","Data":"33a7feb0387f22e02e16de30f29bccff0bb5cf2cbf8c78b10c60d8cbbe485623"} Jul 06 20:01:24.613174 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.612955 2585 scope.go:117] "RemoveContainer" containerID="ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb" Jul 06 20:01:24.623338 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.623319 2585 scope.go:117] "RemoveContainer" containerID="ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb" Jul 06 20:01:24.623618 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:01:24.623599 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb\": container with ID starting with ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb not found: ID does not exist" containerID="ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb" Jul 06 20:01:24.623676 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.623626 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb"} err="failed to get container status \"ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb\": rpc error: code = NotFound desc = could not find container \"ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb\": container with ID starting with ba5098f7512cbad52158cc2a5976c49ca0f7cd8089dfbb93da8cddbabd55adeb not found: ID does not exist" Jul 06 20:01:24.632565 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.632536 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh"] Jul 06 20:01:24.637269 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:24.637243 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0dc8851b-openshift-default-6cd9f58dff-gbrwh"] Jul 06 20:01:26.339369 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:01:26.339326 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31d7407-a610-4c05-8a0f-ee53bac739af" path="/var/lib/kubelet/pods/c31d7407-a610-4c05-8a0f-ee53bac739af/volumes" Jul 06 20:02:48.301486 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:02:48.301451 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:02:48.301985 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:02:48.301850 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:02:48.308815 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:02:48.308785 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:02:48.309509 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:02:48.309490 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:03:00.295754 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.295723 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6"] Jul 06 20:03:00.296142 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.296112 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31d7407-a610-4c05-8a0f-ee53bac739af" containerName="istio-proxy" Jul 06 20:03:00.296142 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.296123 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31d7407-a610-4c05-8a0f-ee53bac739af" containerName="istio-proxy" Jul 06 20:03:00.296247 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.296215 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31d7407-a610-4c05-8a0f-ee53bac739af" containerName="istio-proxy" Jul 06 20:03:00.298250 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.298232 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.308030 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.301700 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-adfb9455-openshift-default-dockercfg-lkdkw\"" Jul 06 20:03:00.322244 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.322217 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6"] Jul 06 20:03:00.378920 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.378875 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istiod-ca-cert\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379090 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.378927 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj5tl\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-kube-api-access-pj5tl\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379090 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.378992 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-data\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379090 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.379069 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-certs\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379209 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.379115 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-credential-socket\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379209 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.379172 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-socket\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379272 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.379209 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-envoy\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379272 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.379237 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-token\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.379272 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.379261 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-podinfo\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480429 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480391 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-credential-socket\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480614 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-socket\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480614 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480471 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-envoy\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480614 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480497 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-token\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480614 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-podinfo\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480614 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480543 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istiod-ca-cert\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480897 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480721 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj5tl\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-kube-api-access-pj5tl\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.480897 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480849 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-credential-socket\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.481021 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.480934 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-socket\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.481179 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.481137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-data\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.481251 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.481226 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istiod-ca-cert\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.481251 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.481231 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-certs\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.481477 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.481454 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-data\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.481549 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.481494 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-certs\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.482652 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.482632 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-envoy\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.482970 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.482952 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-podinfo\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.493426 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.493397 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-token\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.493627 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.493607 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj5tl\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-kube-api-access-pj5tl\") pod \"e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.615067 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.614988 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:00.752127 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.752101 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6"] Jul 06 20:03:00.754005 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:03:00.753979 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d6585d_d67e_4b42_bc23_af53ab30e1bf.slice/crio-347b545a00a2d91b424b97434dce7ee0feb7499d324bb07ca3f46fd909e2b71b WatchSource:0}: Error finding container 347b545a00a2d91b424b97434dce7ee0feb7499d324bb07ca3f46fd909e2b71b: Status 404 returned error can't find the container with id 347b545a00a2d91b424b97434dce7ee0feb7499d324bb07ca3f46fd909e2b71b Jul 06 20:03:00.756193 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.756141 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:00.756295 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.756224 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:00.756295 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:00.756254 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:01.085674 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:01.085643 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" event={"ID":"11d6585d-d67e-4b42-bc23-af53ab30e1bf","Type":"ContainerStarted","Data":"dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4"} Jul 06 20:03:01.085907 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:01.085693 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" event={"ID":"11d6585d-d67e-4b42-bc23-af53ab30e1bf","Type":"ContainerStarted","Data":"347b545a00a2d91b424b97434dce7ee0feb7499d324bb07ca3f46fd909e2b71b"} Jul 06 20:03:01.116133 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:01.116082 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" podStartSLOduration=1.116067055 podStartE2EDuration="1.116067055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:01.114410724 +0000 UTC m=+1813.413820170" watchObservedRunningTime="2026-07-06 20:03:01.116067055 +0000 UTC m=+1813.415476500" Jul 06 20:03:01.615808 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:01.615769 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:01.620039 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:01.620013 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:02.090630 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:02.090602 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:02.091461 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:02.091443 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:16.173043 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:16.173011 2585 generic.go:356] "Generic (PLEG): container finished" podID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerID="dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4" exitCode=0 Jul 06 20:03:16.173585 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:16.173060 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" event={"ID":"11d6585d-d67e-4b42-bc23-af53ab30e1bf","Type":"ContainerDied","Data":"dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4"} Jul 06 20:03:16.173585 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:16.173530 2585 scope.go:117] "RemoveContainer" containerID="dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4" Jul 06 20:03:16.174546 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:16.174519 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:16.174601 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:16.174591 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:16.174639 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:16.174625 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:17.091577 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:17.091533 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:17.180885 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:17.180852 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" event={"ID":"11d6585d-d67e-4b42-bc23-af53ab30e1bf","Type":"ContainerStarted","Data":"111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d"} Jul 06 20:03:17.615808 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:17.615766 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:17.617119 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:17.617088 2585 patch_prober.go:28] interesting pod/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 20:03:17.617264 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:17.617175 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 20:03:18.615734 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:18.615690 2585 patch_prober.go:28] interesting pod/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 20:03:18.616116 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:18.615759 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 20:03:19.616095 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:19.616055 2585 patch_prober.go:28] interesting pod/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 20:03:19.616577 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:19.616120 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 20:03:20.616354 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:20.616317 2585 patch_prober.go:28] interesting pod/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 06 20:03:20.616744 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:20.616371 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 06 20:03:21.619848 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:21.619812 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:21.620259 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:21.620183 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:21.620937 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:21.620919 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:21.720767 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:21.720730 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6"] Jul 06 20:03:22.206590 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:22.206559 2585 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" secret="" err="secret \"e2e-mt-adfb9455-openshift-default-dockercfg-lkdkw\" not found" Jul 06 20:03:23.217260 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:23.217198 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" containerID="cri-o://111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d" gracePeriod=30 Jul 06 20:03:28.482692 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.482617 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:28.560502 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560472 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-envoy\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560502 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560503 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-token\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560742 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560569 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istiod-ca-cert\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560742 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560610 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-data\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560742 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560637 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj5tl\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-kube-api-access-pj5tl\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560742 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560654 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-certs\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560742 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560689 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-credential-socket\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.560742 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560726 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-socket\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.561040 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560782 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-podinfo\") pod \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\" (UID: \"11d6585d-d67e-4b42-bc23-af53ab30e1bf\") " Jul 06 20:03:28.561040 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.560933 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:03:28.561167 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.561023 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:03:28.561167 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.561102 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:03:28.561167 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.561102 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.561323 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.561202 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:03:28.561924 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.561888 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:03:28.562793 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.562750 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:03:28.562793 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.562770 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:03:28.562923 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.562832 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-kube-api-access-pj5tl" (OuterVolumeSpecName: "kube-api-access-pj5tl") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "kube-api-access-pj5tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:03:28.562970 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.562958 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11d6585d-d67e-4b42-bc23-af53ab30e1bf" (UID: "11d6585d-d67e-4b42-bc23-af53ab30e1bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:03:28.661640 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661605 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661640 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661633 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661640 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661642 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661640 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661650 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661899 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661659 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661899 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661666 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661899 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661673 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11d6585d-d67e-4b42-bc23-af53ab30e1bf-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:28.661899 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:28.661682 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj5tl\" (UniqueName: \"kubernetes.io/projected/11d6585d-d67e-4b42-bc23-af53ab30e1bf-kube-api-access-pj5tl\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:03:29.246523 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.246485 2585 generic.go:356] "Generic (PLEG): container finished" podID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerID="111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d" exitCode=0 Jul 06 20:03:29.246697 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.246527 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" event={"ID":"11d6585d-d67e-4b42-bc23-af53ab30e1bf","Type":"ContainerDied","Data":"111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d"} Jul 06 20:03:29.246697 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.246543 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" Jul 06 20:03:29.246697 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.246606 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6" event={"ID":"11d6585d-d67e-4b42-bc23-af53ab30e1bf","Type":"ContainerDied","Data":"347b545a00a2d91b424b97434dce7ee0feb7499d324bb07ca3f46fd909e2b71b"} Jul 06 20:03:29.246697 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.246630 2585 scope.go:117] "RemoveContainer" containerID="111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d" Jul 06 20:03:29.255697 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.255678 2585 scope.go:117] "RemoveContainer" containerID="dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4" Jul 06 20:03:29.263358 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.263335 2585 scope.go:117] "RemoveContainer" containerID="111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d" Jul 06 20:03:29.263604 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:03:29.263586 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d\": container with ID starting with 111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d not found: ID does not exist" containerID="111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d" Jul 06 20:03:29.263667 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.263615 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d"} err="failed to get container status \"111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d\": rpc error: code = NotFound desc = could not find container \"111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d\": container with ID starting with 111d8b64c170a7ea18622a9957cf7f693c9383aae4178727397cc6c5ef8eda7d not found: ID does not exist" Jul 06 20:03:29.263667 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.263634 2585 scope.go:117] "RemoveContainer" containerID="dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4" Jul 06 20:03:29.263894 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:03:29.263874 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4\": container with ID starting with dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4 not found: ID does not exist" containerID="dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4" Jul 06 20:03:29.263941 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.263901 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4"} err="failed to get container status \"dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4\": rpc error: code = NotFound desc = could not find container \"dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4\": container with ID starting with dc9446c117a81ae1041717fba124ea8e0db049b14b96d490e1bd3d6642627ed4 not found: ID does not exist" Jul 06 20:03:29.271347 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.271322 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6"] Jul 06 20:03:29.277789 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:29.277764 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-adfb9455-openshift-default-f7fff4db7-n9zz6"] Jul 06 20:03:30.337756 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:30.337727 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" path="/var/lib/kubelet/pods/11d6585d-d67e-4b42-bc23-af53ab30e1bf/volumes" Jul 06 20:03:41.568970 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.568935 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg"] Jul 06 20:03:41.569566 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.569546 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" Jul 06 20:03:41.569658 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.569571 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" Jul 06 20:03:41.569658 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.569603 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" Jul 06 20:03:41.569658 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.569612 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" Jul 06 20:03:41.569757 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.569710 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" Jul 06 20:03:41.569757 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.569724 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d6585d-d67e-4b42-bc23-af53ab30e1bf" containerName="istio-proxy" Jul 06 20:03:41.573224 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.573199 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.576106 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.576078 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-84fa8f39-openshift-default-dockercfg-8pgwn\"" Jul 06 20:03:41.586923 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.586900 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg"] Jul 06 20:03:41.688174 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688100 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dd7358-a072-4219-bd41-3c79bbe441e7-istiod-ca-cert\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688389 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688212 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-data\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688389 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688322 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-socket\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688389 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-credential-socket\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688558 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688401 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-envoy\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688558 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688445 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-token\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688558 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688485 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-podinfo\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688558 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688511 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsncx\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-kube-api-access-qsncx\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.688763 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.688558 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-certs\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789069 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789031 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-socket\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789069 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-credential-socket\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789367 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789241 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-envoy\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789367 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789289 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-token\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789367 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789324 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-podinfo\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789551 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789442 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-socket\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789551 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789456 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsncx\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-kube-api-access-qsncx\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789551 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789479 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-credential-socket\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789739 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789606 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-certs\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789739 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789655 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dd7358-a072-4219-bd41-3c79bbe441e7-istiod-ca-cert\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.789739 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789711 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-data\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.790104 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.789974 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-certs\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.790240 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.790114 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-data\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.790495 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.790460 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dd7358-a072-4219-bd41-3c79bbe441e7-istiod-ca-cert\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.791891 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.791861 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-envoy\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.792269 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.792246 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-podinfo\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.797645 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.797613 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-token\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.797974 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.797951 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsncx\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-kube-api-access-qsncx\") pod \"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:41.884005 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:41.883918 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:42.033447 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.033358 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg"] Jul 06 20:03:42.036174 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:03:42.036125 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dd7358_a072_4219_bd41_3c79bbe441e7.slice/crio-17a638f15ebcad238bcffe9d5dc848be661b71a16ad0f356441add1b6b4d20d9 WatchSource:0}: Error finding container 17a638f15ebcad238bcffe9d5dc848be661b71a16ad0f356441add1b6b4d20d9: Status 404 returned error can't find the container with id 17a638f15ebcad238bcffe9d5dc848be661b71a16ad0f356441add1b6b4d20d9 Jul 06 20:03:42.038423 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.038386 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:42.038542 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.038456 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:42.038542 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.038489 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:42.315348 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.315307 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" event={"ID":"f6dd7358-a072-4219-bd41-3c79bbe441e7","Type":"ContainerStarted","Data":"75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3"} Jul 06 20:03:42.315527 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.315383 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" event={"ID":"f6dd7358-a072-4219-bd41-3c79bbe441e7","Type":"ContainerStarted","Data":"17a638f15ebcad238bcffe9d5dc848be661b71a16ad0f356441add1b6b4d20d9"} Jul 06 20:03:42.339052 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.338987 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" podStartSLOduration=1.338967875 podStartE2EDuration="1.338967875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:42.336515201 +0000 UTC m=+1854.635924647" watchObservedRunningTime="2026-07-06 20:03:42.338967875 +0000 UTC m=+1854.638377324" Jul 06 20:03:42.885074 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:42.885038 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:43.889517 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:43.889480 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:44.325833 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:44.325800 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:44.326699 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:44.326671 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:58.402906 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:58.402872 2585 generic.go:356] "Generic (PLEG): container finished" podID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerID="75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3" exitCode=0 Jul 06 20:03:58.403382 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:58.402949 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" event={"ID":"f6dd7358-a072-4219-bd41-3c79bbe441e7","Type":"ContainerDied","Data":"75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3"} Jul 06 20:03:58.403468 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:58.403452 2585 scope.go:117] "RemoveContainer" containerID="75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3" Jul 06 20:03:58.404625 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:58.404601 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:58.404691 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:58.404667 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:58.404729 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:58.404702 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:03:59.326040 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:59.326002 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:59.410762 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:59.410724 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" event={"ID":"f6dd7358-a072-4219-bd41-3c79bbe441e7","Type":"ContainerStarted","Data":"e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61"} Jul 06 20:03:59.884716 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:59.884672 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:03:59.885879 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:59.885847 2585 patch_prober.go:28] interesting pod/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 20:03:59.886015 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:03:59.885906 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 20:04:00.885019 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:00.884978 2585 patch_prober.go:28] interesting pod/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 20:04:00.885479 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:00.885047 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 20:04:01.885229 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:01.885192 2585 patch_prober.go:28] interesting pod/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 20:04:01.885633 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:01.885250 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 20:04:02.885234 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:02.885198 2585 patch_prober.go:28] interesting pod/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 06 20:04:02.885643 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:02.885254 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 06 20:04:03.888743 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:03.888705 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:04:03.889272 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:03.889096 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:04:03.889741 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:04:03.889721 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:04:08.422086 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:04:08.422021 2585 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f6dd7358-a072-4219-bd41-3c79bbe441e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-06T20:03:58Z\\\",\\\"message\\\":\\\"containers with unready status: [istio-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-06T20:03:58Z\\\",\\\"message\\\":\\\"containers with unready status: [istio-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"128Mi\\\"},\\\"containerID\\\":\\\"cri-o://75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3\\\",\\\"image\\\":\\\"registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8\\\",\\\"imageID\\\":\\\"registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:0ae6667459cd9e9ea0549e27bb014c722924454bf594b31646df8df58be91cc5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"istio-proxy\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"2\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"128Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-06T20:03:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-06T20:03:42Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":1000319999,\\\"supplementalGroups\\\":[1000319999,1000310000],\\\"uid\\\":1000319999}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/workload-spiffe-uds\\\",\\\"name\\\":\\\"workload-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/credential-uds\\\",\\\"name\\\":\\\"credential-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/workload-spiffe-credentials\\\",\\\"name\\\":\\\"workload-certs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/istio\\\",\\\"name\\\":\\\"istiod-ca-cert\\\"},{\\\"mountPath\\\":\\\"/var/lib/istio/data\\\",\\\"name\\\":\\\"istio-data\\\"},{\\\"mountPath\\\":\\\"/etc/istio/proxy\\\",\\\"name\\\":\\\"istio-envoy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/tokens\\\",\\\"name\\\":\\\"istio-token\\\"},{\\\"mountPath\\\":\\\"/etc/istio/pod\\\",\\\"name\\\":\\\"istio-podinfo\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-qsncx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ingress\"/\"e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-11455d6b-7677-49a5-b9af-ab382c018f61.svc:9743/pod?timeout=10s\": context deadline exceeded" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:05:37.416260 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:37.416224 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg"] Jul 06 20:05:37.416749 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:37.416463 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" containerID="cri-o://e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61" gracePeriod=30 Jul 06 20:05:42.694944 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.694913 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:05:42.799388 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799343 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-podinfo\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799388 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799399 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-data\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799669 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799435 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-credential-socket\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799669 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799484 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-certs\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799669 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799536 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsncx\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-kube-api-access-qsncx\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799669 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799602 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-token\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799669 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799642 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-envoy\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799925 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799680 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-socket\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799925 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799736 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dd7358-a072-4219-bd41-3c79bbe441e7-istiod-ca-cert\") pod \"f6dd7358-a072-4219-bd41-3c79bbe441e7\" (UID: \"f6dd7358-a072-4219-bd41-3c79bbe441e7\") " Jul 06 20:05:42.799925 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799731 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:42.799925 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799797 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:42.800125 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.799947 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:42.800209 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.800117 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.800209 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.800164 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.800209 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.800173 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dd7358-a072-4219-bd41-3c79bbe441e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:05:42.800209 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.800180 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.800492 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.800467 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:42.802296 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.802266 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-kube-api-access-qsncx" (OuterVolumeSpecName: "kube-api-access-qsncx") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "kube-api-access-qsncx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:42.802296 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.802283 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:42.802490 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.802346 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:42.802490 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.802435 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6dd7358-a072-4219-bd41-3c79bbe441e7" (UID: "f6dd7358-a072-4219-bd41-3c79bbe441e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:05:42.901964 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.901833 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsncx\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-kube-api-access-qsncx\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.901964 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.901887 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.901964 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.901901 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.901964 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.901912 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dd7358-a072-4219-bd41-3c79bbe441e7-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.901964 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.901925 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.901964 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.901936 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dd7358-a072-4219-bd41-3c79bbe441e7-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:05:42.944870 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.944764 2585 generic.go:356] "Generic (PLEG): container finished" podID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerID="e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61" exitCode=0 Jul 06 20:05:42.944870 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.944826 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" Jul 06 20:05:42.944870 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.944857 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" event={"ID":"f6dd7358-a072-4219-bd41-3c79bbe441e7","Type":"ContainerDied","Data":"e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61"} Jul 06 20:05:42.945128 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.944918 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg" event={"ID":"f6dd7358-a072-4219-bd41-3c79bbe441e7","Type":"ContainerDied","Data":"17a638f15ebcad238bcffe9d5dc848be661b71a16ad0f356441add1b6b4d20d9"} Jul 06 20:05:42.945128 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.944946 2585 scope.go:117] "RemoveContainer" containerID="e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61" Jul 06 20:05:42.957355 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.957334 2585 scope.go:117] "RemoveContainer" containerID="75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3" Jul 06 20:05:42.967595 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.967574 2585 scope.go:117] "RemoveContainer" containerID="e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61" Jul 06 20:05:42.967933 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:05:42.967910 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61\": container with ID starting with e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61 not found: ID does not exist" containerID="e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61" Jul 06 20:05:42.968030 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.967940 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61"} err="failed to get container status \"e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61\": rpc error: code = NotFound desc = could not find container \"e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61\": container with ID starting with e79b22a651759e04bad3b557a3ce9391aae9b7fc7aaf28956d27364c6fc32b61 not found: ID does not exist" Jul 06 20:05:42.968030 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.967959 2585 scope.go:117] "RemoveContainer" containerID="75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3" Jul 06 20:05:42.968249 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:05:42.968231 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3\": container with ID starting with 75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3 not found: ID does not exist" containerID="75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3" Jul 06 20:05:42.968308 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.968254 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3"} err="failed to get container status \"75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3\": rpc error: code = NotFound desc = could not find container \"75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3\": container with ID starting with 75db17fee3f01f3e097cfae404b6890ba719ae28b778aa7423fbb36d63040cb3 not found: ID does not exist" Jul 06 20:05:42.976664 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.976628 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg"] Jul 06 20:05:42.981833 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:42.981803 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-84fa8f39-openshift-default-7c8cf4f5f-ht9vg"] Jul 06 20:05:44.338527 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:05:44.338489 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" path="/var/lib/kubelet/pods/f6dd7358-a072-4219-bd41-3c79bbe441e7/volumes" Jul 06 20:06:33.362974 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.362941 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj"] Jul 06 20:06:33.363465 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.363374 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" Jul 06 20:06:33.363465 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.363388 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" Jul 06 20:06:33.363465 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.363402 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" Jul 06 20:06:33.363465 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.363408 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" Jul 06 20:06:33.363598 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.363481 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" Jul 06 20:06:33.363598 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.363492 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6dd7358-a072-4219-bd41-3c79bbe441e7" containerName="istio-proxy" Jul 06 20:06:33.366688 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.366670 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.369783 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.369760 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d30688-openshift-default-dockercfg-zfl4b\"" Jul 06 20:06:33.381412 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.381380 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj"] Jul 06 20:06:33.392980 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.392940 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476ce7e-78aa-4065-98f6-0cd21889b693-istiod-ca-cert\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.393183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.393047 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-podinfo\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.393183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.393077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-certs\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.393183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.393106 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-socket\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.393183 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.393141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmkcr\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-kube-api-access-bmkcr\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.393416 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.393213 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-envoy\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.394056 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.394028 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-credential-socket\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.394205 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.394077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-token\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.394286 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.394220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-data\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495594 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-data\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495594 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495595 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476ce7e-78aa-4065-98f6-0cd21889b693-istiod-ca-cert\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495819 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-podinfo\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495819 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495651 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-certs\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495819 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495678 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-socket\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495819 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495706 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmkcr\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-kube-api-access-bmkcr\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.495819 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495727 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-envoy\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496031 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495820 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-credential-socket\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496031 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.495854 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-token\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496135 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.496107 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-data\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496404 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.496373 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-certs\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496544 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.496472 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476ce7e-78aa-4065-98f6-0cd21889b693-istiod-ca-cert\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496674 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.496645 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-credential-socket\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.496790 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.496756 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-socket\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.498754 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.498730 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-envoy\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.498974 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.498956 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-podinfo\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.505760 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.505716 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-token\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.505903 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.505818 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmkcr\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-kube-api-access-bmkcr\") pod \"e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.677611 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.677580 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:33.847772 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.847577 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj"] Jul 06 20:06:33.850850 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:06:33.850820 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7476ce7e_78aa_4065_98f6_0cd21889b693.slice/crio-10075d10696dab544449e76ef5d473c981402865f0795e05c8285ded5576287c WatchSource:0}: Error finding container 10075d10696dab544449e76ef5d473c981402865f0795e05c8285ded5576287c: Status 404 returned error can't find the container with id 10075d10696dab544449e76ef5d473c981402865f0795e05c8285ded5576287c Jul 06 20:06:33.853315 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.853285 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:33.853425 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.853363 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:33.853425 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:33.853408 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:34.208428 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:34.208384 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" event={"ID":"7476ce7e-78aa-4065-98f6-0cd21889b693","Type":"ContainerStarted","Data":"5a30e34293dae2bd89f2046e6cfc25f8c644213851a5a7c215a7f811898252e3"} Jul 06 20:06:34.208605 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:34.208456 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" event={"ID":"7476ce7e-78aa-4065-98f6-0cd21889b693","Type":"ContainerStarted","Data":"10075d10696dab544449e76ef5d473c981402865f0795e05c8285ded5576287c"} Jul 06 20:06:34.240004 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:34.239951 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podStartSLOduration=1.23993306 podStartE2EDuration="1.23993306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:34.239510337 +0000 UTC m=+2026.538919786" watchObservedRunningTime="2026-07-06 20:06:34.23993306 +0000 UTC m=+2026.539342507" Jul 06 20:06:34.677990 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:34.677955 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:34.683057 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:34.683035 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:35.213878 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:35.213850 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:35.214921 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:35.214898 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:51.254364 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:51.254321 2585 patch_prober.go:28] interesting pod/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 20:06:51.254816 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:51.254404 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 20:06:52.300909 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:52.300873 2585 generic.go:356] "Generic (PLEG): container finished" podID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerID="5a30e34293dae2bd89f2046e6cfc25f8c644213851a5a7c215a7f811898252e3" exitCode=0 Jul 06 20:06:52.301458 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:52.300950 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" event={"ID":"7476ce7e-78aa-4065-98f6-0cd21889b693","Type":"ContainerDied","Data":"5a30e34293dae2bd89f2046e6cfc25f8c644213851a5a7c215a7f811898252e3"} Jul 06 20:06:52.301568 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:52.301551 2585 scope.go:117] "RemoveContainer" containerID="5a30e34293dae2bd89f2046e6cfc25f8c644213851a5a7c215a7f811898252e3" Jul 06 20:06:52.302544 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:52.302519 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:52.302647 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:52.302584 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:52.302647 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:52.302615 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:53.307837 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:53.307804 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" event={"ID":"7476ce7e-78aa-4065-98f6-0cd21889b693","Type":"ContainerStarted","Data":"04200663d47f20a3c60c22fac893085f2ac357ed8404110ddf4b1f6b75d96bbd"} Jul 06 20:06:53.677959 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:53.677926 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:53.678126 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:53.678096 2585 patch_prober.go:28] interesting pod/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 20:06:53.678200 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:53.678140 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 20:06:54.678342 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:54.678300 2585 patch_prober.go:28] interesting pod/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 20:06:54.678817 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:54.678362 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 20:06:55.678461 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:55.678420 2585 patch_prober.go:28] interesting pod/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 20:06:55.678875 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:55.678476 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 20:06:56.678613 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:56.678574 2585 patch_prober.go:28] interesting pod/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 20:06:56.679020 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:56.678649 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 20:06:57.678485 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:57.678439 2585 patch_prober.go:28] interesting pod/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 06 20:06:57.678662 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:57.678504 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 06 20:06:58.682600 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:58.682564 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:58.682990 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:58.682858 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:06:58.683621 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:06:58.683600 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:07:48.333907 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:07:48.333877 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:07:48.338790 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:07:48.338755 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:07:48.343596 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:07:48.343574 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:07:48.346316 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:07:48.346299 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:08:34.615517 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:34.615476 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj"] Jul 06 20:08:34.616073 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:34.615739 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" containerID="cri-o://04200663d47f20a3c60c22fac893085f2ac357ed8404110ddf4b1f6b75d96bbd" gracePeriod=30 Jul 06 20:08:39.840994 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.840960 2585 generic.go:356] "Generic (PLEG): container finished" podID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerID="04200663d47f20a3c60c22fac893085f2ac357ed8404110ddf4b1f6b75d96bbd" exitCode=0 Jul 06 20:08:39.841428 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.841030 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" event={"ID":"7476ce7e-78aa-4065-98f6-0cd21889b693","Type":"ContainerDied","Data":"04200663d47f20a3c60c22fac893085f2ac357ed8404110ddf4b1f6b75d96bbd"} Jul 06 20:08:39.841428 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.841100 2585 scope.go:117] "RemoveContainer" containerID="5a30e34293dae2bd89f2046e6cfc25f8c644213851a5a7c215a7f811898252e3" Jul 06 20:08:39.875136 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.875070 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:08:39.965800 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.965771 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-envoy\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.965800 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.965805 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmkcr\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-kube-api-access-bmkcr\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966062 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.965828 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-podinfo\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966062 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.965875 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-token\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966062 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.965908 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-credential-socket\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966062 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.965932 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476ce7e-78aa-4065-98f6-0cd21889b693-istiod-ca-cert\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966062 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966033 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-certs\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966347 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966117 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-socket\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966347 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966142 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-data\") pod \"7476ce7e-78aa-4065-98f6-0cd21889b693\" (UID: \"7476ce7e-78aa-4065-98f6-0cd21889b693\") " Jul 06 20:08:39.966347 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966315 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:08:39.966496 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966416 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7476ce7e-78aa-4065-98f6-0cd21889b693-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:08:39.966555 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966541 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:08:39.966743 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966693 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:39.966743 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966717 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:39.966743 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966733 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476ce7e-78aa-4065-98f6-0cd21889b693-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:39.966743 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.966735 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:08:39.967374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.967350 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-data" (OuterVolumeSpecName: "istio-data") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:08:39.968291 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.968268 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:08:39.968291 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.968279 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-token" (OuterVolumeSpecName: "istio-token") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:08:39.968424 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.968326 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:08:39.968424 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:39.968331 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-kube-api-access-bmkcr" (OuterVolumeSpecName: "kube-api-access-bmkcr") pod "7476ce7e-78aa-4065-98f6-0cd21889b693" (UID: "7476ce7e-78aa-4065-98f6-0cd21889b693"). InnerVolumeSpecName "kube-api-access-bmkcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:08:40.068102 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.068055 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:40.068102 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.068090 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:40.068102 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.068103 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:40.068102 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.068112 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:40.068421 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.068125 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476ce7e-78aa-4065-98f6-0cd21889b693-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:40.068421 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.068138 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmkcr\" (UniqueName: \"kubernetes.io/projected/7476ce7e-78aa-4065-98f6-0cd21889b693-kube-api-access-bmkcr\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:08:40.847292 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.847260 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" Jul 06 20:08:40.847292 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.847287 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj" event={"ID":"7476ce7e-78aa-4065-98f6-0cd21889b693","Type":"ContainerDied","Data":"10075d10696dab544449e76ef5d473c981402865f0795e05c8285ded5576287c"} Jul 06 20:08:40.847789 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.847346 2585 scope.go:117] "RemoveContainer" containerID="04200663d47f20a3c60c22fac893085f2ac357ed8404110ddf4b1f6b75d96bbd" Jul 06 20:08:40.917507 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.917457 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj"] Jul 06 20:08:40.933058 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:40.933022 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d30688-openshift-default-cb85bfc6c-rv2xj"] Jul 06 20:08:42.337745 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:42.337712 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" path="/var/lib/kubelet/pods/7476ce7e-78aa-4065-98f6-0cd21889b693/volumes" Jul 06 20:08:44.116655 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.116610 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr"] Jul 06 20:08:44.117196 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.117182 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" Jul 06 20:08:44.117251 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.117198 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" Jul 06 20:08:44.117287 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.117270 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" Jul 06 20:08:44.117287 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.117278 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" Jul 06 20:08:44.120229 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.120211 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.123461 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.123440 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2131ed-openshift-default-dockercfg-bdjgx\"" Jul 06 20:08:44.134815 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.134784 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr"] Jul 06 20:08:44.206731 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.206693 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s24l\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-kube-api-access-6s24l\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.206731 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.206730 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-envoy\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.206967 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.206750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-certs\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.206967 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.206896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-socket\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.206967 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.206937 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-token\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.207089 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.206985 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/347cb539-10f9-4cee-b9a5-96281a2e27c6-istiod-ca-cert\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.207089 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.207033 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-credential-socket\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.207208 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.207192 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-data\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.207267 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.207232 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-podinfo\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.307866 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.307827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-socket\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.307866 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.307866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-token\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308132 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.307900 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/347cb539-10f9-4cee-b9a5-96281a2e27c6-istiod-ca-cert\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308132 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.307941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-credential-socket\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308132 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308035 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-data\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308132 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-podinfo\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308178 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s24l\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-kube-api-access-6s24l\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308206 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-envoy\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308225 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-certs\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308334 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-socket\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308393 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-data\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308719 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308586 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-certs\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308719 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308649 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-credential-socket\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.308827 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.308815 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/347cb539-10f9-4cee-b9a5-96281a2e27c6-istiod-ca-cert\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.310590 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.310563 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-envoy\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.310754 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.310737 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-podinfo\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.326580 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.326552 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s24l\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-kube-api-access-6s24l\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.328003 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.327974 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-token\") pod \"e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.430677 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.430636 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:44.593507 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.593474 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr"] Jul 06 20:08:44.596208 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:08:44.596180 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347cb539_10f9_4cee_b9a5_96281a2e27c6.slice/crio-9c7ed38759e4f8323ffd7770d4ef587eb470c0e6325ea14e9c292bda38d8cf3e WatchSource:0}: Error finding container 9c7ed38759e4f8323ffd7770d4ef587eb470c0e6325ea14e9c292bda38d8cf3e: Status 404 returned error can't find the container with id 9c7ed38759e4f8323ffd7770d4ef587eb470c0e6325ea14e9c292bda38d8cf3e Jul 06 20:08:44.598220 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.598189 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:08:44.598294 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.598258 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:08:44.598294 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.598286 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:08:44.875840 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.875739 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" event={"ID":"347cb539-10f9-4cee-b9a5-96281a2e27c6","Type":"ContainerStarted","Data":"f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617"} Jul 06 20:08:44.875840 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.875802 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" event={"ID":"347cb539-10f9-4cee-b9a5-96281a2e27c6","Type":"ContainerStarted","Data":"9c7ed38759e4f8323ffd7770d4ef587eb470c0e6325ea14e9c292bda38d8cf3e"} Jul 06 20:08:44.911059 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:44.911004 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" podStartSLOduration=0.910986687 podStartE2EDuration="910.986687ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:08:44.908451628 +0000 UTC m=+2157.207861095" watchObservedRunningTime="2026-07-06 20:08:44.910986687 +0000 UTC m=+2157.210396133" Jul 06 20:08:45.431507 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:45.431466 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:45.437021 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:45.436990 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:45.881211 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:45.881118 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:45.881969 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:45.881952 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:08:59.954604 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:59.954568 2585 generic.go:356] "Generic (PLEG): container finished" podID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerID="f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617" exitCode=0 Jul 06 20:08:59.955111 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:59.954648 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" event={"ID":"347cb539-10f9-4cee-b9a5-96281a2e27c6","Type":"ContainerDied","Data":"f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617"} Jul 06 20:08:59.955201 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:59.955128 2585 scope.go:117] "RemoveContainer" containerID="f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617" Jul 06 20:08:59.956753 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:59.956708 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:08:59.956893 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:59.956869 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:08:59.956985 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:08:59.956965 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:00.881809 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:00.881762 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:00.964108 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:00.964074 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" event={"ID":"347cb539-10f9-4cee-b9a5-96281a2e27c6","Type":"ContainerStarted","Data":"f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19"} Jul 06 20:09:01.431514 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:01.431465 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:01.432504 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:01.432473 2585 patch_prober.go:28] interesting pod/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 20:09:01.432646 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:01.432542 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 20:09:02.431199 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:02.431122 2585 patch_prober.go:28] interesting pod/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 20:09:02.431821 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:02.431785 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 20:09:03.431753 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:03.431708 2585 patch_prober.go:28] interesting pod/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 20:09:03.432399 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:03.432362 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 20:09:04.431628 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:04.431591 2585 patch_prober.go:28] interesting pod/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 06 20:09:04.431965 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:04.431923 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 06 20:09:05.436185 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:05.436139 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:05.436805 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:05.436587 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:05.437611 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:05.437590 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:14.324654 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:14.324619 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr"] Jul 06 20:09:14.325072 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:14.324836 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" containerID="cri-o://f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19" gracePeriod=30 Jul 06 20:09:19.586837 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.586733 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:19.680293 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680260 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-certs\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680293 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680297 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-token\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680533 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680324 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/347cb539-10f9-4cee-b9a5-96281a2e27c6-istiod-ca-cert\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680533 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680344 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-socket\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680533 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680370 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-data\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680533 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680412 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-podinfo\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680533 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680456 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s24l\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-kube-api-access-6s24l\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680533 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680494 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-envoy\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680834 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680559 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-credential-socket\") pod \"347cb539-10f9-4cee-b9a5-96281a2e27c6\" (UID: \"347cb539-10f9-4cee-b9a5-96281a2e27c6\") " Jul 06 20:09:19.680834 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680608 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:09:19.680834 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680710 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/347cb539-10f9-4cee-b9a5-96281a2e27c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:09:19.680991 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.680930 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:09:19.681049 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.681022 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:09:19.681049 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.681036 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/347cb539-10f9-4cee-b9a5-96281a2e27c6-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.681122 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.681053 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.681122 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.681065 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.681622 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.681588 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:09:19.682682 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.682659 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:09:19.682798 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.682727 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:09:19.682798 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.682730 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-kube-api-access-6s24l" (OuterVolumeSpecName: "kube-api-access-6s24l") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "kube-api-access-6s24l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:09:19.683070 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.683049 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "347cb539-10f9-4cee-b9a5-96281a2e27c6" (UID: "347cb539-10f9-4cee-b9a5-96281a2e27c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:09:19.782364 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.782326 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.782364 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.782357 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.782364 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.782366 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.782364 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.782374 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.782649 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.782382 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s24l\" (UniqueName: \"kubernetes.io/projected/347cb539-10f9-4cee-b9a5-96281a2e27c6-kube-api-access-6s24l\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:19.782649 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:19.782391 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/347cb539-10f9-4cee-b9a5-96281a2e27c6-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:09:20.065979 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.065942 2585 generic.go:356] "Generic (PLEG): container finished" podID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerID="f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19" exitCode=0 Jul 06 20:09:20.066198 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.066003 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" Jul 06 20:09:20.066198 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.066035 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" event={"ID":"347cb539-10f9-4cee-b9a5-96281a2e27c6","Type":"ContainerDied","Data":"f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19"} Jul 06 20:09:20.066198 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.066090 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr" event={"ID":"347cb539-10f9-4cee-b9a5-96281a2e27c6","Type":"ContainerDied","Data":"9c7ed38759e4f8323ffd7770d4ef587eb470c0e6325ea14e9c292bda38d8cf3e"} Jul 06 20:09:20.066198 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.066112 2585 scope.go:117] "RemoveContainer" containerID="f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19" Jul 06 20:09:20.075535 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.075520 2585 scope.go:117] "RemoveContainer" containerID="f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617" Jul 06 20:09:20.085864 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.085846 2585 scope.go:117] "RemoveContainer" containerID="f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19" Jul 06 20:09:20.086211 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:09:20.086169 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19\": container with ID starting with f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19 not found: ID does not exist" containerID="f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19" Jul 06 20:09:20.086329 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.086278 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19"} err="failed to get container status \"f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19\": rpc error: code = NotFound desc = could not find container \"f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19\": container with ID starting with f234d010adee95133abca13046a3229af5f8a11c847174f736314d742db36a19 not found: ID does not exist" Jul 06 20:09:20.086402 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.086328 2585 scope.go:117] "RemoveContainer" containerID="f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617" Jul 06 20:09:20.086632 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:09:20.086611 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617\": container with ID starting with f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617 not found: ID does not exist" containerID="f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617" Jul 06 20:09:20.086745 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.086642 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617"} err="failed to get container status \"f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617\": rpc error: code = NotFound desc = could not find container \"f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617\": container with ID starting with f73b619ccd8813cf92560d04f9fa7a0b3bc4f4c7706a949dde82b67b9d12d617 not found: ID does not exist" Jul 06 20:09:20.089994 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.089976 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr"] Jul 06 20:09:20.093626 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.093598 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2131ed-openshift-default-69fbd99b7-9q4jr"] Jul 06 20:09:20.337788 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:20.337709 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" path="/var/lib/kubelet/pods/347cb539-10f9-4cee-b9a5-96281a2e27c6/volumes" Jul 06 20:09:22.101202 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101168 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn"] Jul 06 20:09:22.101744 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101729 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" Jul 06 20:09:22.101790 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101747 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" Jul 06 20:09:22.101790 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101767 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" Jul 06 20:09:22.101790 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101775 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" Jul 06 20:09:22.101885 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101803 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" Jul 06 20:09:22.101885 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101812 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7476ce7e-78aa-4065-98f6-0cd21889b693" containerName="istio-proxy" Jul 06 20:09:22.101954 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101919 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" Jul 06 20:09:22.101954 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.101934 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="347cb539-10f9-4cee-b9a5-96281a2e27c6" containerName="istio-proxy" Jul 06 20:09:22.106865 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.106843 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.109406 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.109386 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-87cbde-openshift-default-dockercfg-rjmhb\"" Jul 06 20:09:22.116687 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.116664 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn"] Jul 06 20:09:22.205783 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205744 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-kube-api-access-wtb9r\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.205783 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-podinfo\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206054 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205807 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-envoy\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206054 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205836 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-token\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206054 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205877 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istiod-ca-cert\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206054 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205903 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-credential-socket\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206054 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.205920 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-data\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206054 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.206007 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-certs\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.206279 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.206065 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-socket\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307245 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307212 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istiod-ca-cert\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307245 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307257 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-credential-socket\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307522 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307282 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-data\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307522 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307377 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-certs\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307522 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-socket\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307522 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307467 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-kube-api-access-wtb9r\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307522 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307494 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-podinfo\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307522 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307521 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-envoy\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307831 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307547 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-token\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307831 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307711 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-credential-socket\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307831 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307739 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-certs\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307970 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307893 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-socket\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.307970 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.307940 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-data\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.308122 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.308101 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istiod-ca-cert\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.309898 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.309872 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-envoy\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.310107 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.310088 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-podinfo\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.316470 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.316444 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-token\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.316750 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.316729 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-kube-api-access-wtb9r\") pod \"e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.418022 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.417989 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:22.567005 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.566975 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn"] Jul 06 20:09:22.569704 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:09:22.569667 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fa3109_b6a5_49af_82c5_cd9ff637ed10.slice/crio-ec5bd1493602d5050a4d895ba9a8b2d9dc90c598ad3dd11e36c9414cb6d3c63c WatchSource:0}: Error finding container ec5bd1493602d5050a4d895ba9a8b2d9dc90c598ad3dd11e36c9414cb6d3c63c: Status 404 returned error can't find the container with id ec5bd1493602d5050a4d895ba9a8b2d9dc90c598ad3dd11e36c9414cb6d3c63c Jul 06 20:09:22.572086 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.572055 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:22.572191 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.572128 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:22.572191 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:22.572184 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:23.083821 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:23.083783 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" event={"ID":"15fa3109-b6a5-49af-82c5-cd9ff637ed10","Type":"ContainerStarted","Data":"3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8"} Jul 06 20:09:23.084003 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:23.083838 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" event={"ID":"15fa3109-b6a5-49af-82c5-cd9ff637ed10","Type":"ContainerStarted","Data":"ec5bd1493602d5050a4d895ba9a8b2d9dc90c598ad3dd11e36c9414cb6d3c63c"} Jul 06 20:09:23.112686 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:23.112630 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podStartSLOduration=1.112614092 podStartE2EDuration="1.112614092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:23.111114105 +0000 UTC m=+2195.410523577" watchObservedRunningTime="2026-07-06 20:09:23.112614092 +0000 UTC m=+2195.412023535" Jul 06 20:09:23.418678 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:23.418635 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:23.423839 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:23.423815 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:24.088492 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:24.088460 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:24.089382 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:24.089364 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:38.173123 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:38.173085 2585 generic.go:356] "Generic (PLEG): container finished" podID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerID="3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8" exitCode=0 Jul 06 20:09:38.173576 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:38.173177 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" event={"ID":"15fa3109-b6a5-49af-82c5-cd9ff637ed10","Type":"ContainerDied","Data":"3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8"} Jul 06 20:09:38.173621 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:38.173574 2585 scope.go:117] "RemoveContainer" containerID="3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8" Jul 06 20:09:38.174602 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:38.174567 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:38.174716 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:38.174639 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:38.174716 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:38.174669 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:09:39.089392 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:39.089361 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:39.179453 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:39.179411 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" event={"ID":"15fa3109-b6a5-49af-82c5-cd9ff637ed10","Type":"ContainerStarted","Data":"472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf"} Jul 06 20:09:39.418976 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:39.418942 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:39.420133 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:39.420106 2585 patch_prober.go:28] interesting pod/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 06 20:09:39.420265 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:39.420188 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 06 20:09:40.419236 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:40.419198 2585 patch_prober.go:28] interesting pod/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 06 20:09:40.419631 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:40.419253 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 06 20:09:41.419403 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:41.419363 2585 patch_prober.go:28] interesting pod/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 06 20:09:41.419781 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:41.419420 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 06 20:09:42.418544 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:42.418501 2585 patch_prober.go:28] interesting pod/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 06 20:09:42.418721 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:42.418563 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 06 20:09:43.422570 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:43.422523 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:43.423012 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:43.422911 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:43.423620 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:43.423601 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:09:55.622817 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.622783 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn"] Jul 06 20:09:55.625267 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.625250 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.628804 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.628784 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"openshift-service-ca.crt\"" Jul 06 20:09:55.629000 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.628982 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"default-dockercfg-p5b9t\"" Jul 06 20:09:55.629000 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.628991 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"auth-test-model-87cbde-kserve-self-signed-certs\"" Jul 06 20:09:55.629462 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.629444 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"kube-root-ca.crt\"" Jul 06 20:09:55.648490 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.648460 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn"] Jul 06 20:09:55.739036 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.738986 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tls-certs\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.739231 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.739055 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-model-cache\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.739231 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.739091 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrqz\" (UniqueName: \"kubernetes.io/projected/2403d6f0-4882-43aa-9bcf-95f8f2aea847-kube-api-access-glrqz\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.739231 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.739128 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-dshm\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.739231 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.739228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tmp-dir\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.739392 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.739259 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-home\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840265 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrqz\" (UniqueName: \"kubernetes.io/projected/2403d6f0-4882-43aa-9bcf-95f8f2aea847-kube-api-access-glrqz\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840265 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840272 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-dshm\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840498 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840313 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tmp-dir\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840498 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840333 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-home\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840607 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840515 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tls-certs\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840607 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840598 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-model-cache\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840874 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840846 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-home\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.840874 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840869 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tmp-dir\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.841068 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.840917 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-model-cache\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.842725 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.842704 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-dshm\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.843003 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.842982 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tls-certs\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.851942 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.851916 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrqz\" (UniqueName: \"kubernetes.io/projected/2403d6f0-4882-43aa-9bcf-95f8f2aea847-kube-api-access-glrqz\") pod \"auth-test-model-87cbde-kserve-849b75d6f5-997xn\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:55.934935 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:55.934893 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:09:56.090768 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:56.090731 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn"] Jul 06 20:09:56.097715 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:09:56.097672 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2403d6f0_4882_43aa_9bcf_95f8f2aea847.slice/crio-5ed4ebc3b4bbea6f965f3a92253856fc477ac31053b998755feec48b255cff02 WatchSource:0}: Error finding container 5ed4ebc3b4bbea6f965f3a92253856fc477ac31053b998755feec48b255cff02: Status 404 returned error can't find the container with id 5ed4ebc3b4bbea6f965f3a92253856fc477ac31053b998755feec48b255cff02 Jul 06 20:09:56.269234 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:56.268126 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" event={"ID":"2403d6f0-4882-43aa-9bcf-95f8f2aea847","Type":"ContainerStarted","Data":"65477b66bbde8083dfb0492734b03ba9e729af74fd6d10197c42b96a7527711d"} Jul 06 20:09:56.269234 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:56.268202 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" event={"ID":"2403d6f0-4882-43aa-9bcf-95f8f2aea847","Type":"ContainerStarted","Data":"5ed4ebc3b4bbea6f965f3a92253856fc477ac31053b998755feec48b255cff02"} Jul 06 20:09:56.292070 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:09:56.292019 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" podStartSLOduration=1.292004074 podStartE2EDuration="1.292004074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:56.289837191 +0000 UTC m=+2228.589246638" watchObservedRunningTime="2026-07-06 20:09:56.292004074 +0000 UTC m=+2228.591413520" Jul 06 20:10:05.935814 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:10:05.935767 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:10:05.936366 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:10:05.935837 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:10:05.948608 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:10:05.948580 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:10:06.327822 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:10:06.327741 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:12:16.880933 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:16.880902 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn"] Jul 06 20:12:31.901316 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:31.901244 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" podUID="2403d6f0-4882-43aa-9bcf-95f8f2aea847" containerName="main" containerID="cri-o://65477b66bbde8083dfb0492734b03ba9e729af74fd6d10197c42b96a7527711d" gracePeriod=45 Jul 06 20:12:32.066371 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.066339 2585 generic.go:356] "Generic (PLEG): container finished" podID="2403d6f0-4882-43aa-9bcf-95f8f2aea847" containerID="65477b66bbde8083dfb0492734b03ba9e729af74fd6d10197c42b96a7527711d" exitCode=0 Jul 06 20:12:32.066539 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.066412 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" event={"ID":"2403d6f0-4882-43aa-9bcf-95f8f2aea847","Type":"ContainerDied","Data":"65477b66bbde8083dfb0492734b03ba9e729af74fd6d10197c42b96a7527711d"} Jul 06 20:12:32.158800 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.158773 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:12:32.221435 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221399 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glrqz\" (UniqueName: \"kubernetes.io/projected/2403d6f0-4882-43aa-9bcf-95f8f2aea847-kube-api-access-glrqz\") pod \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " Jul 06 20:12:32.221611 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221476 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tls-certs\") pod \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " Jul 06 20:12:32.221611 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221495 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tmp-dir\") pod \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " Jul 06 20:12:32.221611 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221596 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-home\") pod \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " Jul 06 20:12:32.221738 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221648 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-model-cache\") pod \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " Jul 06 20:12:32.221787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221743 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2403d6f0-4882-43aa-9bcf-95f8f2aea847" (UID: "2403d6f0-4882-43aa-9bcf-95f8f2aea847"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:12:32.221787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221777 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-dshm\") pod \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\" (UID: \"2403d6f0-4882-43aa-9bcf-95f8f2aea847\") " Jul 06 20:12:32.221872 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221789 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-home" (OuterVolumeSpecName: "home") pod "2403d6f0-4882-43aa-9bcf-95f8f2aea847" (UID: "2403d6f0-4882-43aa-9bcf-95f8f2aea847"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:12:32.221960 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.221909 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-model-cache" (OuterVolumeSpecName: "model-cache") pod "2403d6f0-4882-43aa-9bcf-95f8f2aea847" (UID: "2403d6f0-4882-43aa-9bcf-95f8f2aea847"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:12:32.222170 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.222133 2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tmp-dir\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:12:32.222170 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.222167 2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-home\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:12:32.222317 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.222179 2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-model-cache\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:12:32.223807 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.223773 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2403d6f0-4882-43aa-9bcf-95f8f2aea847" (UID: "2403d6f0-4882-43aa-9bcf-95f8f2aea847"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:12:32.223807 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.223797 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2403d6f0-4882-43aa-9bcf-95f8f2aea847-kube-api-access-glrqz" (OuterVolumeSpecName: "kube-api-access-glrqz") pod "2403d6f0-4882-43aa-9bcf-95f8f2aea847" (UID: "2403d6f0-4882-43aa-9bcf-95f8f2aea847"). InnerVolumeSpecName "kube-api-access-glrqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:12:32.223935 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.223843 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-dshm" (OuterVolumeSpecName: "dshm") pod "2403d6f0-4882-43aa-9bcf-95f8f2aea847" (UID: "2403d6f0-4882-43aa-9bcf-95f8f2aea847"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:12:32.323316 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.323269 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2403d6f0-4882-43aa-9bcf-95f8f2aea847-tls-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:12:32.323316 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.323306 2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2403d6f0-4882-43aa-9bcf-95f8f2aea847-dshm\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:12:32.323316 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:32.323318 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glrqz\" (UniqueName: \"kubernetes.io/projected/2403d6f0-4882-43aa-9bcf-95f8f2aea847-kube-api-access-glrqz\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:12:33.072807 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:33.072773 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" event={"ID":"2403d6f0-4882-43aa-9bcf-95f8f2aea847","Type":"ContainerDied","Data":"5ed4ebc3b4bbea6f965f3a92253856fc477ac31053b998755feec48b255cff02"} Jul 06 20:12:33.073293 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:33.072823 2585 scope.go:117] "RemoveContainer" containerID="65477b66bbde8083dfb0492734b03ba9e729af74fd6d10197c42b96a7527711d" Jul 06 20:12:33.073293 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:33.072787 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn" Jul 06 20:12:33.092788 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:33.092763 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn"] Jul 06 20:12:33.097894 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:33.097870 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/auth-test-model-87cbde-kserve-849b75d6f5-997xn"] Jul 06 20:12:34.337474 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:34.337442 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2403d6f0-4882-43aa-9bcf-95f8f2aea847" path="/var/lib/kubelet/pods/2403d6f0-4882-43aa-9bcf-95f8f2aea847/volumes" Jul 06 20:12:48.370933 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:48.370905 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:12:48.372498 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:48.372477 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:12:48.379721 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:48.379697 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:12:48.380992 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:12:48.380975 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-14.ec2.internal_551a2656eb9acdf6b8852513bf829170/kube-rbac-proxy-crio/0.log" Jul 06 20:13:12.075912 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.075840 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq"] Jul 06 20:13:12.076315 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.076301 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2403d6f0-4882-43aa-9bcf-95f8f2aea847" containerName="main" Jul 06 20:13:12.076315 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.076316 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2403d6f0-4882-43aa-9bcf-95f8f2aea847" containerName="main" Jul 06 20:13:12.076390 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.076382 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2403d6f0-4882-43aa-9bcf-95f8f2aea847" containerName="main" Jul 06 20:13:12.079523 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.079502 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.083947 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.083916 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332acb\"/\"kube-root-ca.crt\"" Jul 06 20:13:12.083947 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.083929 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332acb\"/\"sub-test-model-332acb-kserve-self-signed-certs\"" Jul 06 20:13:12.084161 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.083998 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332acb\"/\"openshift-service-ca.crt\"" Jul 06 20:13:12.084227 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.084215 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332acb\"/\"default-dockercfg-tgfbr\"" Jul 06 20:13:12.093864 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.093839 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq"] Jul 06 20:13:12.115139 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.115106 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-home\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.115278 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.115182 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-dshm\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.115278 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.115215 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5741e0f-9baf-49f5-97fa-1ad80872be18-tls-certs\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.115278 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.115255 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwpsv\" (UniqueName: \"kubernetes.io/projected/a5741e0f-9baf-49f5-97fa-1ad80872be18-kube-api-access-wwpsv\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.115419 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.115299 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-model-cache\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.115419 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.115336 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-tmp-dir\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216436 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216398 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-home\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216694 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216468 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-dshm\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216694 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216493 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5741e0f-9baf-49f5-97fa-1ad80872be18-tls-certs\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216694 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216616 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwpsv\" (UniqueName: \"kubernetes.io/projected/a5741e0f-9baf-49f5-97fa-1ad80872be18-kube-api-access-wwpsv\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216694 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216671 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-model-cache\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216935 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216898 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-tmp-dir\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.216993 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.216947 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-home\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.217314 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.217283 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-tmp-dir\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.217457 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.217352 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-model-cache\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.219502 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.219416 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-dshm\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.220786 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.220759 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5741e0f-9baf-49f5-97fa-1ad80872be18-tls-certs\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.227596 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.227570 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwpsv\" (UniqueName: \"kubernetes.io/projected/a5741e0f-9baf-49f5-97fa-1ad80872be18-kube-api-access-wwpsv\") pod \"sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.389596 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.389509 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:12.530678 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:12.530644 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq"] Jul 06 20:13:12.535389 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:13:12.535357 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5741e0f_9baf_49f5_97fa_1ad80872be18.slice/crio-6e2b7a1c980670a4d79229b3ba2911b6ffffc778c4d66ebae110a8b204de4e02 WatchSource:0}: Error finding container 6e2b7a1c980670a4d79229b3ba2911b6ffffc778c4d66ebae110a8b204de4e02: Status 404 returned error can't find the container with id 6e2b7a1c980670a4d79229b3ba2911b6ffffc778c4d66ebae110a8b204de4e02 Jul 06 20:13:13.275701 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:13.275665 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" event={"ID":"a5741e0f-9baf-49f5-97fa-1ad80872be18","Type":"ContainerStarted","Data":"04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799"} Jul 06 20:13:13.275701 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:13.275706 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" event={"ID":"a5741e0f-9baf-49f5-97fa-1ad80872be18","Type":"ContainerStarted","Data":"6e2b7a1c980670a4d79229b3ba2911b6ffffc778c4d66ebae110a8b204de4e02"} Jul 06 20:13:13.301831 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:13.301784 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" podStartSLOduration=1.301769506 podStartE2EDuration="1.301769506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:13:13.300396983 +0000 UTC m=+2425.599806430" watchObservedRunningTime="2026-07-06 20:13:13.301769506 +0000 UTC m=+2425.601178956" Jul 06 20:13:22.389676 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:22.389645 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:22.390309 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:22.389696 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:22.401925 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:22.401899 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:13:23.341847 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:13:23.341822 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:14:11.123194 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:11.123144 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq"] Jul 06 20:14:26.143616 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.143573 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" podUID="a5741e0f-9baf-49f5-97fa-1ad80872be18" containerName="main" containerID="cri-o://04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799" gracePeriod=45 Jul 06 20:14:26.399845 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.399787 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:14:26.455249 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455221 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-tmp-dir\") pod \"a5741e0f-9baf-49f5-97fa-1ad80872be18\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " Jul 06 20:14:26.455394 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455263 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5741e0f-9baf-49f5-97fa-1ad80872be18-tls-certs\") pod \"a5741e0f-9baf-49f5-97fa-1ad80872be18\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " Jul 06 20:14:26.455394 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455294 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-dshm\") pod \"a5741e0f-9baf-49f5-97fa-1ad80872be18\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " Jul 06 20:14:26.455517 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455484 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-home\") pod \"a5741e0f-9baf-49f5-97fa-1ad80872be18\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " Jul 06 20:14:26.455568 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455519 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5741e0f-9baf-49f5-97fa-1ad80872be18" (UID: "a5741e0f-9baf-49f5-97fa-1ad80872be18"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:14:26.455630 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455588 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwpsv\" (UniqueName: \"kubernetes.io/projected/a5741e0f-9baf-49f5-97fa-1ad80872be18-kube-api-access-wwpsv\") pod \"a5741e0f-9baf-49f5-97fa-1ad80872be18\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " Jul 06 20:14:26.455688 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455663 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-model-cache\") pod \"a5741e0f-9baf-49f5-97fa-1ad80872be18\" (UID: \"a5741e0f-9baf-49f5-97fa-1ad80872be18\") " Jul 06 20:14:26.455789 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455751 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-home" (OuterVolumeSpecName: "home") pod "a5741e0f-9baf-49f5-97fa-1ad80872be18" (UID: "a5741e0f-9baf-49f5-97fa-1ad80872be18"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:14:26.455990 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.455970 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5741e0f-9baf-49f5-97fa-1ad80872be18" (UID: "a5741e0f-9baf-49f5-97fa-1ad80872be18"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:14:26.456075 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.456056 2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-tmp-dir\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:14:26.456136 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.456076 2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-home\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:14:26.457809 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.457786 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-dshm" (OuterVolumeSpecName: "dshm") pod "a5741e0f-9baf-49f5-97fa-1ad80872be18" (UID: "a5741e0f-9baf-49f5-97fa-1ad80872be18"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:14:26.457889 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.457830 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5741e0f-9baf-49f5-97fa-1ad80872be18-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5741e0f-9baf-49f5-97fa-1ad80872be18" (UID: "a5741e0f-9baf-49f5-97fa-1ad80872be18"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:14:26.457889 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.457873 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5741e0f-9baf-49f5-97fa-1ad80872be18-kube-api-access-wwpsv" (OuterVolumeSpecName: "kube-api-access-wwpsv") pod "a5741e0f-9baf-49f5-97fa-1ad80872be18" (UID: "a5741e0f-9baf-49f5-97fa-1ad80872be18"). InnerVolumeSpecName "kube-api-access-wwpsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:14:26.556569 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.556538 2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-model-cache\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:14:26.556569 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.556563 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5741e0f-9baf-49f5-97fa-1ad80872be18-tls-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:14:26.556569 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.556572 2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5741e0f-9baf-49f5-97fa-1ad80872be18-dshm\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:14:26.556799 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.556580 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwpsv\" (UniqueName: \"kubernetes.io/projected/a5741e0f-9baf-49f5-97fa-1ad80872be18-kube-api-access-wwpsv\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:14:26.647916 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.647880 2585 generic.go:356] "Generic (PLEG): container finished" podID="a5741e0f-9baf-49f5-97fa-1ad80872be18" containerID="04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799" exitCode=0 Jul 06 20:14:26.648092 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.647922 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" Jul 06 20:14:26.648092 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.647970 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" event={"ID":"a5741e0f-9baf-49f5-97fa-1ad80872be18","Type":"ContainerDied","Data":"04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799"} Jul 06 20:14:26.648092 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.648009 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq" event={"ID":"a5741e0f-9baf-49f5-97fa-1ad80872be18","Type":"ContainerDied","Data":"6e2b7a1c980670a4d79229b3ba2911b6ffffc778c4d66ebae110a8b204de4e02"} Jul 06 20:14:26.648092 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.648030 2585 scope.go:117] "RemoveContainer" containerID="04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799" Jul 06 20:14:26.657596 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.657574 2585 scope.go:117] "RemoveContainer" containerID="04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799" Jul 06 20:14:26.657913 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:14:26.657889 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799\": container with ID starting with 04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799 not found: ID does not exist" containerID="04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799" Jul 06 20:14:26.658009 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.657926 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799"} err="failed to get container status \"04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799\": rpc error: code = NotFound desc = could not find container \"04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799\": container with ID starting with 04e4e2a6219f2ddace34ccf6e04d7a94587db42c3aab1a52bac6afd954a03799 not found: ID does not exist" Jul 06 20:14:26.675941 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.675917 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq"] Jul 06 20:14:26.679725 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:26.679703 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-332acb/sub-test-model-332acb-kserve-7ff8c74c9f-7jcqq"] Jul 06 20:14:28.338159 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:14:28.338121 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5741e0f-9baf-49f5-97fa-1ad80872be18" path="/var/lib/kubelet/pods/a5741e0f-9baf-49f5-97fa-1ad80872be18/volumes" Jul 06 20:16:25.196980 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:25.196901 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn"] Jul 06 20:16:25.197528 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:25.197216 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" containerID="cri-o://472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf" gracePeriod=30 Jul 06 20:16:28.425961 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:28.425918 2585 patch_prober.go:28] interesting pod/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 20:16:28.426368 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:28.425978 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:16:30.454992 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.454960 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:16:30.492061 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.491965 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-certs\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492061 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492015 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-envoy\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492061 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492042 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-socket\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492096 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-data\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492115 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-podinfo\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492160 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istiod-ca-cert\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492220 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-kube-api-access-wtb9r\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492242 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-token\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492285 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-credential-socket\") pod \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\" (UID: \"15fa3109-b6a5-49af-82c5-cd9ff637ed10\") " Jul 06 20:16:30.492374 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492308 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:16:30.492741 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492403 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:16:30.492741 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492602 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:16:30.492741 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492611 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-certs\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.492741 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492640 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-workload-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.492953 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492808 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:16:30.493013 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.492962 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-data" (OuterVolumeSpecName: "istio-data") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:16:30.494898 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.494862 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-token" (OuterVolumeSpecName: "istio-token") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:16:30.495031 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.495003 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:16:30.495031 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.495017 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:16:30.495422 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.495404 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-kube-api-access-wtb9r" (OuterVolumeSpecName: "kube-api-access-wtb9r") pod "15fa3109-b6a5-49af-82c5-cd9ff637ed10" (UID: "15fa3109-b6a5-49af-82c5-cd9ff637ed10"). InnerVolumeSpecName "kube-api-access-wtb9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:16:30.593314 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593281 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-data\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.593314 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593310 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-podinfo\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.593314 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593319 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istiod-ca-cert\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.593559 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593327 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-kube-api-access-wtb9r\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.593559 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593336 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-token\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.593559 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593368 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-credential-socket\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:30.593559 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:30.593377 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fa3109-b6a5-49af-82c5-cd9ff637ed10-istio-envoy\") on node \"ip-10-0-128-14.ec2.internal\" DevicePath \"\"" Jul 06 20:16:31.283609 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.283571 2585 generic.go:356] "Generic (PLEG): container finished" podID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerID="472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf" exitCode=0 Jul 06 20:16:31.283787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.283626 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" Jul 06 20:16:31.283787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.283659 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" event={"ID":"15fa3109-b6a5-49af-82c5-cd9ff637ed10","Type":"ContainerDied","Data":"472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf"} Jul 06 20:16:31.283787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.283720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn" event={"ID":"15fa3109-b6a5-49af-82c5-cd9ff637ed10","Type":"ContainerDied","Data":"ec5bd1493602d5050a4d895ba9a8b2d9dc90c598ad3dd11e36c9414cb6d3c63c"} Jul 06 20:16:31.283787 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.283744 2585 scope.go:117] "RemoveContainer" containerID="472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf" Jul 06 20:16:31.293767 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.293752 2585 scope.go:117] "RemoveContainer" containerID="3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8" Jul 06 20:16:31.301603 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.301586 2585 scope.go:117] "RemoveContainer" containerID="472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf" Jul 06 20:16:31.301846 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:16:31.301826 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf\": container with ID starting with 472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf not found: ID does not exist" containerID="472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf" Jul 06 20:16:31.301933 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.301860 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf"} err="failed to get container status \"472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf\": rpc error: code = NotFound desc = could not find container \"472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf\": container with ID starting with 472339b0ec89d77f38f91e847dd98e5a7ab80e38df0b736bc1fb197dfee96cdf not found: ID does not exist" Jul 06 20:16:31.301933 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.301883 2585 scope.go:117] "RemoveContainer" containerID="3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8" Jul 06 20:16:31.302126 ip-10-0-128-14 kubenswrapper[2585]: E0706 20:16:31.302107 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8\": container with ID starting with 3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8 not found: ID does not exist" containerID="3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8" Jul 06 20:16:31.302194 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.302134 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8"} err="failed to get container status \"3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8\": rpc error: code = NotFound desc = could not find container \"3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8\": container with ID starting with 3b9d275d239f0fb8262beb1cc737538360bcdd665f78e2401dd6d2344a6488b8 not found: ID does not exist" Jul 06 20:16:31.335915 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.335881 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn"] Jul 06 20:16:31.352528 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:31.352500 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-87cbde-openshift-default-6cc68cb8d7-7q7dn"] Jul 06 20:16:32.339286 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:32.339255 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" path="/var/lib/kubelet/pods/15fa3109-b6a5-49af-82c5-cd9ff637ed10/volumes" Jul 06 20:16:34.905620 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:34.905589 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c44f4cf5b-g57dv_697aadba-174a-432e-815f-b19631fb1497/authorino/0.log" Jul 06 20:16:41.355697 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:41.355667 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-zrpk8_a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d/copy-manifests/0.log" Jul 06 20:16:41.366325 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:41.366298 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-zrpk8_a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d/manager/0.log" Jul 06 20:16:42.828514 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:42.828482 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c44f4cf5b-g57dv_697aadba-174a-432e-815f-b19631fb1497/authorino/0.log" Jul 06 20:16:43.087402 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:43.087331 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-drdjw_5efe7e30-4ab7-4e5d-bc46-5228c407c142/manager/0.log" Jul 06 20:16:43.330094 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:43.330057 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cnpxv_f04477ec-53cd-4d7a-b4be-348332884886/registry-server/0.log" Jul 06 20:16:43.450003 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:43.449976 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vh4gn_1030917c-9794-40f7-a263-b8bd9254be4d/manager/0.log" Jul 06 20:16:43.686730 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:43.686701 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9rvd9_f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9/manager/0.log" Jul 06 20:16:44.053952 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:44.053917 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r2kh9_067012df-ac43-4376-a5b3-4e69199afed3/istio-proxy/0.log" Jul 06 20:16:44.528414 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:44.528384 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/1.log" Jul 06 20:16:44.770562 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:44.770529 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7pqc4_d34a5d42-90b1-407b-b306-41625d5341ab/payload-processing/0.log" Jul 06 20:16:44.891173 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:44.891069 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6869767d5-ltf8v_e08c88a7-f17d-4551-a5a6-75a306567711/router/0.log" Jul 06 20:16:45.368098 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:45.368065 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x2rm9_9822bbb3-b51c-40b8-b029-abab19276c7e/main/0.log" Jul 06 20:16:45.491315 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:45.491290 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7hqvn_789e63d1-91b1-4419-b585-604d29323304/main/0.log" Jul 06 20:16:45.622320 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:45.622239 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2zdn_b8140316-8c50-4129-8e20-856a4b24be3f/main/0.log" Jul 06 20:16:54.025263 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:54.025236 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wqlbq_163686c1-2cc6-4ec9-8222-b6f3f96772d5/global-pull-secret-syncer/0.log" Jul 06 20:16:54.172026 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:54.171989 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j5fvf_ab60d8f1-46f6-403e-9e7f-15a4c8c04c79/konnectivity-agent/0.log" Jul 06 20:16:54.250063 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:54.250032 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-14.ec2.internal_a353b4e16a284a7954e86f68b4b656d8/haproxy/0.log" Jul 06 20:16:59.342822 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:59.342706 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c44f4cf5b-g57dv_697aadba-174a-432e-815f-b19631fb1497/authorino/0.log" Jul 06 20:16:59.452123 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:59.452097 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-drdjw_5efe7e30-4ab7-4e5d-bc46-5228c407c142/manager/0.log" Jul 06 20:16:59.570108 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:59.570083 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cnpxv_f04477ec-53cd-4d7a-b4be-348332884886/registry-server/0.log" Jul 06 20:16:59.740887 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:59.740850 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vh4gn_1030917c-9794-40f7-a263-b8bd9254be4d/manager/0.log" Jul 06 20:16:59.984634 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:16:59.984601 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9rvd9_f2e0a524-dfb2-4c93-a2a1-b8754a6b67d9/manager/0.log" Jul 06 20:17:02.080849 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:02.080815 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-lrgdn_2babca22-b684-4714-b7e2-30fe26e57bd3/cluster-monitoring-operator/0.log" Jul 06 20:17:02.252693 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:02.252614 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7668d6f949-9vmld_0fd4e780-977c-4fe7-9783-9c0496e3c450/metrics-server/0.log" Jul 06 20:17:02.627860 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:02.627767 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrxpz_d63898b7-9382-4b5c-8548-ca8cbdd9c567/node-exporter/0.log" Jul 06 20:17:02.696372 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:02.696343 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrxpz_d63898b7-9382-4b5c-8548-ca8cbdd9c567/kube-rbac-proxy/0.log" Jul 06 20:17:02.742737 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:02.742709 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrxpz_d63898b7-9382-4b5c-8548-ca8cbdd9c567/init-textfile/0.log" Jul 06 20:17:03.034716 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.034685 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/prometheus/0.log" Jul 06 20:17:03.081203 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.081176 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/config-reloader/0.log" Jul 06 20:17:03.133763 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.133738 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/thanos-sidecar/0.log" Jul 06 20:17:03.172590 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.172560 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/kube-rbac-proxy-web/0.log" Jul 06 20:17:03.209268 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.209240 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/kube-rbac-proxy/0.log" Jul 06 20:17:03.249857 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.249830 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/kube-rbac-proxy-thanos/0.log" Jul 06 20:17:03.294288 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.294197 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e8da284-4c95-44a6-a295-f056ce109594/init-config-reloader/0.log" Jul 06 20:17:03.333867 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.333842 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-b887r_970b0cea-b22c-410f-9918-711b30fa3666/prometheus-operator/0.log" Jul 06 20:17:03.371326 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.371292 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-b887r_970b0cea-b22c-410f-9918-711b30fa3666/kube-rbac-proxy/0.log" Jul 06 20:17:03.403662 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.403632 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-jqpvs_7cf98094-d3b2-4915-ac00-f698f619b114/prometheus-operator-admission-webhook/0.log" Jul 06 20:17:03.564472 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.564392 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bc569dc4c-jxspt_a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86/thanos-query/0.log" Jul 06 20:17:03.596638 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.596607 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bc569dc4c-jxspt_a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86/kube-rbac-proxy-web/0.log" Jul 06 20:17:03.631857 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.631831 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bc569dc4c-jxspt_a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86/kube-rbac-proxy/0.log" Jul 06 20:17:03.675566 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.675538 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bc569dc4c-jxspt_a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86/prom-label-proxy/0.log" Jul 06 20:17:03.715411 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.715383 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bc569dc4c-jxspt_a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86/kube-rbac-proxy-rules/0.log" Jul 06 20:17:03.754411 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.754382 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bc569dc4c-jxspt_a0ebb3d8-3b20-48a9-9e1b-b144e0a1cd86/kube-rbac-proxy-metrics/0.log" Jul 06 20:17:03.795839 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.795809 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj"] Jul 06 20:17:03.796223 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796210 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" Jul 06 20:17:03.796273 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796224 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" Jul 06 20:17:03.796273 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796240 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5741e0f-9baf-49f5-97fa-1ad80872be18" containerName="main" Jul 06 20:17:03.796273 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796245 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5741e0f-9baf-49f5-97fa-1ad80872be18" containerName="main" Jul 06 20:17:03.796371 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796306 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5741e0f-9baf-49f5-97fa-1ad80872be18" containerName="main" Jul 06 20:17:03.796371 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796317 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" Jul 06 20:17:03.796371 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.796325 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fa3109-b6a5-49af-82c5-cd9ff637ed10" containerName="istio-proxy" Jul 06 20:17:03.799668 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.799646 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:03.802408 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.802384 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m6vl\"/\"openshift-service-ca.crt\"" Jul 06 20:17:03.802531 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.802406 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m6vl\"/\"kube-root-ca.crt\"" Jul 06 20:17:03.803344 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.803327 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4m6vl\"/\"default-dockercfg-j9ks9\"" Jul 06 20:17:03.811799 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.811777 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj"] Jul 06 20:17:03.912047 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.912018 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nth5m\" (UniqueName: \"kubernetes.io/projected/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-kube-api-access-nth5m\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:03.912213 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.912076 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-lib-modules\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:03.912213 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.912187 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-proc\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:03.912298 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.912216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-podres\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:03.912333 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:03.912301 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-sys\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013138 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013100 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-proc\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013138 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013138 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-podres\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013206 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-sys\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013253 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-proc\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013271 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nth5m\" (UniqueName: \"kubernetes.io/projected/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-kube-api-access-nth5m\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013320 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-sys\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013338 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-lib-modules\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013420 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013378 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-podres\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.013719 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.013456 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-lib-modules\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.023114 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.023084 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nth5m\" (UniqueName: \"kubernetes.io/projected/587c0fc9-d34c-4e62-8272-cf48f1e2bf79-kube-api-access-nth5m\") pod \"perf-node-gather-daemonset-zqflj\" (UID: \"587c0fc9-d34c-4e62-8272-cf48f1e2bf79\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.110251 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.110218 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.252721 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.252693 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj"] Jul 06 20:17:04.254240 ip-10-0-128-14 kubenswrapper[2585]: W0706 20:17:04.254202 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod587c0fc9_d34c_4e62_8272_cf48f1e2bf79.slice/crio-c3dc04b8b138578594ff5f6c3d9b8f2d1361cf2b7c740fd3641a201fe69c0b58 WatchSource:0}: Error finding container c3dc04b8b138578594ff5f6c3d9b8f2d1361cf2b7c740fd3641a201fe69c0b58: Status 404 returned error can't find the container with id c3dc04b8b138578594ff5f6c3d9b8f2d1361cf2b7c740fd3641a201fe69c0b58 Jul 06 20:17:04.469175 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.469054 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" event={"ID":"587c0fc9-d34c-4e62-8272-cf48f1e2bf79","Type":"ContainerStarted","Data":"833989ed67c678e90302a77556c113b210eb1fcaff8527f34534fb1f9a0603a5"} Jul 06 20:17:04.469175 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.469110 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" event={"ID":"587c0fc9-d34c-4e62-8272-cf48f1e2bf79","Type":"ContainerStarted","Data":"c3dc04b8b138578594ff5f6c3d9b8f2d1361cf2b7c740fd3641a201fe69c0b58"} Jul 06 20:17:04.469362 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.469203 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:04.491362 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:04.491308 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" podStartSLOduration=1.491289911 podStartE2EDuration="1.491289911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:17:04.489939154 +0000 UTC m=+2656.789348600" watchObservedRunningTime="2026-07-06 20:17:04.491289911 +0000 UTC m=+2656.790699356" Jul 06 20:17:05.458825 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:05.458798 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/1.log" Jul 06 20:17:05.463423 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:05.463384 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9q4nt_944f0118-0a65-4e59-9a79-048b620fb8b6/console-operator/2.log" Jul 06 20:17:06.038833 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:06.038785 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5dj27_9eb87134-db89-491b-aa77-a155e61e2fc1/download-server/0.log" Jul 06 20:17:08.007973 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:08.007942 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2s449_1e42a98d-f050-44d3-88d2-7657cb76ffd2/dns/0.log" Jul 06 20:17:08.052767 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:08.052743 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2s449_1e42a98d-f050-44d3-88d2-7657cb76ffd2/kube-rbac-proxy/0.log" Jul 06 20:17:08.342120 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:08.342049 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdgnv_265b29b9-6ad8-47cd-828a-4b4936be39ba/dns-node-resolver/0.log" Jul 06 20:17:08.990224 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:08.990196 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cf99c7d9-j8lt9_d1244e89-cd55-4bcb-93a4-2145592efdb7/registry/0.log" Jul 06 20:17:09.074360 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:09.074331 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-94qxf_f35e88f1-b561-46a0-853a-f36e75fbd3de/node-ca/0.log" Jul 06 20:17:10.268681 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:10.268647 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r2kh9_067012df-ac43-4376-a5b3-4e69199afed3/istio-proxy/0.log" Jul 06 20:17:10.484308 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:10.484284 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-zqflj" Jul 06 20:17:10.519714 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:10.519627 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/0.log" Jul 06 20:17:10.545010 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:10.544979 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/1.log" Jul 06 20:17:10.647781 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:10.647756 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7pqc4_d34a5d42-90b1-407b-b306-41625d5341ab/payload-processing/0.log" Jul 06 20:17:10.687217 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:10.687188 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6869767d5-ltf8v_e08c88a7-f17d-4551-a5a6-75a306567711/router/0.log" Jul 06 20:17:11.444569 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:11.444542 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lh89_509b6b9d-ec42-40a0-8bae-ce258324c692/serve-healthcheck-canary/0.log" Jul 06 20:17:12.377074 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:12.377047 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tkhlm_4a0956ea-4a11-4730-bca6-0014cfc80628/kube-rbac-proxy/0.log" Jul 06 20:17:12.416910 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:12.416884 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tkhlm_4a0956ea-4a11-4730-bca6-0014cfc80628/exporter/0.log" Jul 06 20:17:12.448890 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:12.448859 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tkhlm_4a0956ea-4a11-4730-bca6-0014cfc80628/extractor/0.log" Jul 06 20:17:14.572698 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:14.572675 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r2kh9_067012df-ac43-4376-a5b3-4e69199afed3/istio-proxy/0.log" Jul 06 20:17:14.738339 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:14.738313 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/0.log" Jul 06 20:17:14.763664 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:14.763639 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/1.log" Jul 06 20:17:14.831708 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:14.831677 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7pqc4_d34a5d42-90b1-407b-b306-41625d5341ab/payload-processing/0.log" Jul 06 20:17:14.851921 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:14.851895 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6869767d5-ltf8v_e08c88a7-f17d-4551-a5a6-75a306567711/router/0.log" Jul 06 20:17:15.968885 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:15.968861 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-zrpk8_a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d/manager/0.log" Jul 06 20:17:16.002605 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:16.002577 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-zrpk8_a3d6af6b-1fcf-4f13-b7f0-057a9e1aa29d/copy-manifests/0.log" Jul 06 20:17:16.007507 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:16.007485 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r2kh9_067012df-ac43-4376-a5b3-4e69199afed3/istio-proxy/0.log" Jul 06 20:17:16.192162 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:16.192130 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/0.log" Jul 06 20:17:16.222326 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:16.222285 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7d892_e9e128fd-3b1f-480a-aceb-0360abc27da1/istio-proxy/1.log" Jul 06 20:17:16.299159 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:16.299102 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7pqc4_d34a5d42-90b1-407b-b306-41625d5341ab/payload-processing/0.log" Jul 06 20:17:16.314608 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:16.314577 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6869767d5-ltf8v_e08c88a7-f17d-4551-a5a6-75a306567711/router/0.log" Jul 06 20:17:17.526402 ip-10-0-128-14 kubenswrapper[2585]: I0706 20:17:17.526373 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fdd95bb87-x86wq_c114c834-d6c4-42c2-ac9e-ecaa006fd9e3/manager/0.log"