Aug 04 15:11:10.113636 ip-10-0-135-95 systemd[1]: Starting Kubernetes Kubelet... Aug 04 15:11:10.517362 ip-10-0-135-95 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 15:11:10.517362 ip-10-0-135-95 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 04 15:11:10.517362 ip-10-0-135-95 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 15:11:10.517362 ip-10-0-135-95 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 04 15:11:10.517362 ip-10-0-135-95 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 15:11:10.519554 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.519470 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 04 15:11:10.523078 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523063 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 15:11:10.523078 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523079 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523083 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523086 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523089 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523093 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523096 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523099 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523102 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523105 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523107 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523110 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523112 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523115 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523118 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523120 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523125 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523134 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523137 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523141 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 15:11:10.523138 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523145 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523149 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523151 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523154 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523157 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523159 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523162 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523164 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523167 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523180 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523183 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523187 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523190 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523192 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523195 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523197 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523200 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523202 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523205 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523207 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 15:11:10.523611 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523210 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523212 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523215 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523217 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523220 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523224 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523226 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523229 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523231 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523234 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523236 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523239 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523241 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523244 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523247 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523249 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523252 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523254 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523257 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523259 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 15:11:10.524090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523262 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523264 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523267 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523270 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523272 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523275 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523277 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523280 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523282 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523285 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523287 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523290 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523292 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523296 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523300 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523303 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523307 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523311 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523314 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 15:11:10.524628 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523317 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523319 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523323 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523325 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523328 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523330 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523332 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523335 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523338 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523353 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523356 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523359 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523362 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523364 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523367 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523370 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523373 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523375 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523378 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 15:11:10.525087 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.523381 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524067 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524073 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524077 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524080 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524083 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524091 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524095 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524097 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524100 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524103 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524105 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524108 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524110 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524113 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524116 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524118 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524121 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524123 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524126 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 15:11:10.525586 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524129 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524131 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524134 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524137 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524139 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524142 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524144 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524148 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524150 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524153 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524155 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524158 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524161 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524163 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524166 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524168 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524171 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524173 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524176 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524179 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 15:11:10.526097 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524181 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524184 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524187 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524189 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524192 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524195 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524199 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524203 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524206 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524209 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524212 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524215 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524218 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524220 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524223 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524226 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524229 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524231 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524239 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524242 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 15:11:10.526602 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524244 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524248 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524250 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524253 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524256 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524258 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524261 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524264 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524266 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524269 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524271 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524274 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524282 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524285 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524287 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524290 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524293 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524295 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524298 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524301 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 15:11:10.527095 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524303 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524306 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524309 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524312 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524314 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524317 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524320 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524323 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524325 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524328 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524330 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524333 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524336 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524339 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524358 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524361 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524364 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524368 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524373 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 15:11:10.527616 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524377 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524746 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524751 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524754 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524757 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524761 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524764 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524767 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524770 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524773 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524776 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524781 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524784 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524788 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524791 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524794 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524798 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524801 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 15:11:10.528079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524804 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524807 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524810 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524813 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524816 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524819 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524822 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524825 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524827 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524830 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524832 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524835 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524838 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524840 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524844 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524846 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524849 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524851 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524853 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524856 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524859 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 15:11:10.528519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524861 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524864 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524867 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524869 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524871 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524874 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524876 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524879 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524882 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524884 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524887 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524889 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524892 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524894 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524897 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524899 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524902 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524904 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524907 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524909 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 15:11:10.529052 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524912 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524914 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524917 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524919 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524922 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524925 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524927 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524929 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524932 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524935 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524937 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524940 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524943 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524945 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524948 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524950 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524953 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524956 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524960 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 15:11:10.529584 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524963 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524968 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524971 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524974 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524976 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524979 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524981 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524984 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524986 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524989 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524992 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524994 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.524997 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525000 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525002 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525005 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525008 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525010 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525013 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525016 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 04 15:11:10.530041 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525018 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525021 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525085 2562 flags.go:64] FLAG: --address="0.0.0.0" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525098 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525104 2562 flags.go:64] FLAG: --anonymous-auth="true" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525108 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525125 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525129 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525133 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525136 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525140 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525142 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525146 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525150 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525153 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525155 2562 flags.go:64] FLAG: --cgroup-root="" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525158 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525161 2562 flags.go:64] FLAG: --client-ca-file="" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525164 2562 flags.go:64] FLAG: --cloud-provider="external" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525167 2562 flags.go:64] FLAG: --cluster-dns="[]" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525176 2562 flags.go:64] FLAG: --cluster-domain="" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525179 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525182 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525185 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 04 15:11:10.530543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525188 2562 flags.go:64] FLAG: --container-log-max-files="5" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525192 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525195 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525198 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525201 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525204 2562 flags.go:64] FLAG: --contention-profiling="false" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525207 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525210 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525213 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525216 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525219 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525222 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525225 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525228 2562 flags.go:64] FLAG: --enable-load-reader="false" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525230 2562 flags.go:64] FLAG: --enable-server="true" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525238 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525248 2562 flags.go:64] FLAG: --event-burst="100" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525251 2562 flags.go:64] FLAG: --event-qps="50" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525253 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525256 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525260 2562 flags.go:64] FLAG: --eviction-hard="" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525265 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525268 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525271 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525274 2562 flags.go:64] FLAG: --eviction-soft="" Aug 04 15:11:10.531107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525277 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525280 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525282 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525285 2562 flags.go:64] FLAG: --experimental-mounter-path="" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525288 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525291 2562 flags.go:64] FLAG: --fail-swap-on="true" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525294 2562 flags.go:64] FLAG: --feature-gates="" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525297 2562 flags.go:64] FLAG: --file-check-frequency="20s" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525300 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525303 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525306 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525308 2562 flags.go:64] FLAG: --healthz-port="10248" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525311 2562 flags.go:64] FLAG: --help="false" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525314 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525317 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525320 2562 flags.go:64] FLAG: --http-check-frequency="20s" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525322 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525326 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525329 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525332 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525334 2562 flags.go:64] FLAG: --image-service-endpoint="" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525337 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525340 2562 flags.go:64] FLAG: --kube-api-burst="100" Aug 04 15:11:10.531719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525362 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525365 2562 flags.go:64] FLAG: --kube-api-qps="50" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525368 2562 flags.go:64] FLAG: --kube-reserved="" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525371 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525373 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525378 2562 flags.go:64] FLAG: --kubelet-cgroups="" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525381 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525383 2562 flags.go:64] FLAG: --lock-file="" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525386 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525389 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525392 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525398 2562 flags.go:64] FLAG: --log-json-split-stream="false" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525400 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525403 2562 flags.go:64] FLAG: --log-text-split-stream="false" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525406 2562 flags.go:64] FLAG: --logging-format="text" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525409 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525412 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525414 2562 flags.go:64] FLAG: --manifest-url="" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525418 2562 flags.go:64] FLAG: --manifest-url-header="" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525421 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525424 2562 flags.go:64] FLAG: --max-open-files="1000000" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525428 2562 flags.go:64] FLAG: --max-pods="110" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525431 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525434 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525437 2562 flags.go:64] FLAG: --memory-manager-policy="None" Aug 04 15:11:10.532329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525440 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525443 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525445 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525448 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525455 2562 flags.go:64] FLAG: --node-status-max-images="50" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525458 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525460 2562 flags.go:64] FLAG: --oom-score-adj="-999" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525463 2562 flags.go:64] FLAG: --pod-cidr="" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525467 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525471 2562 flags.go:64] FLAG: --pod-manifest-path="" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525474 2562 flags.go:64] FLAG: --pod-max-pids="-1" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525477 2562 flags.go:64] FLAG: --pods-per-core="0" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525483 2562 flags.go:64] FLAG: --port="10250" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525487 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525489 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031547e27c4d1b359" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525492 2562 flags.go:64] FLAG: --qos-reserved="" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525495 2562 flags.go:64] FLAG: --read-only-port="10255" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525498 2562 flags.go:64] FLAG: --register-node="true" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525501 2562 flags.go:64] FLAG: --register-with-taints="" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525504 2562 flags.go:64] FLAG: --registry-burst="10" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525507 2562 flags.go:64] FLAG: --registry-qps="5" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525510 2562 flags.go:64] FLAG: --reserved-cpus="" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525513 2562 flags.go:64] FLAG: --reserved-memory="" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525516 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525519 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 04 15:11:10.532991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525522 2562 flags.go:64] FLAG: --rotate-certificates="false" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525525 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525527 2562 flags.go:64] FLAG: --runonce="false" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525530 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525533 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525536 2562 flags.go:64] FLAG: --seccomp-default="false" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525538 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525541 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525544 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525547 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525550 2562 flags.go:64] FLAG: --storage-driver-password="root" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525552 2562 flags.go:64] FLAG: --storage-driver-secure="false" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525555 2562 flags.go:64] FLAG: --storage-driver-table="stats" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525558 2562 flags.go:64] FLAG: --storage-driver-user="root" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525561 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525564 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525567 2562 flags.go:64] FLAG: --system-cgroups="" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525569 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525575 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525578 2562 flags.go:64] FLAG: --tls-cert-file="" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525583 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525587 2562 flags.go:64] FLAG: --tls-min-version="" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525590 2562 flags.go:64] FLAG: --tls-private-key-file="" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525593 2562 flags.go:64] FLAG: --topology-manager-policy="none" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525596 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 04 15:11:10.533708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525599 2562 flags.go:64] FLAG: --topology-manager-scope="container" Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525602 2562 flags.go:64] FLAG: --v="2" Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525606 2562 flags.go:64] FLAG: --version="false" Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525610 2562 flags.go:64] FLAG: --vmodule="" Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525613 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.525616 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525739 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525744 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525747 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525751 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525754 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525756 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525759 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525762 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525765 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525768 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525771 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525774 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525777 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525779 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525782 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 15:11:10.534302 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525785 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525788 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525791 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525794 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525798 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525802 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525806 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525809 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525812 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525814 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525817 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525820 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525822 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525825 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525827 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525830 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525832 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525835 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525837 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525840 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 15:11:10.534840 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525843 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525845 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525848 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525850 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525853 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525855 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525858 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525860 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525863 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525865 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525868 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525870 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525873 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525875 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525878 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525880 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525883 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525887 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525891 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525893 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 15:11:10.535377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525896 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525899 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525901 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525904 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525906 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525910 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525914 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525917 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525919 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525922 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525925 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525928 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525931 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525934 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525936 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525939 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525942 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525944 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525949 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 15:11:10.535862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525952 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525955 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525958 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525961 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525964 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525966 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525969 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525972 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525974 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525977 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525981 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525984 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525987 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525990 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525993 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525995 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.525998 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526000 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526003 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 15:11:10.536332 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526005 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526008 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526010 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526013 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526015 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.526018 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.526619 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.533605 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.533620 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.533640 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.533646 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533701 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533706 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533710 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533714 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 15:11:10.537081 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533717 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533720 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533723 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533726 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533729 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533732 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533735 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533739 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533744 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533747 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533751 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533753 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533756 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533759 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533761 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533764 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533767 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533769 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533772 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533774 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 15:11:10.537537 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533777 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533779 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533782 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533784 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533787 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533790 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533793 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533795 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533798 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533801 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533803 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533806 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533808 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533811 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533813 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533816 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533818 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533821 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533823 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533826 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 15:11:10.538103 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533829 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533831 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533834 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533837 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533839 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533842 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533844 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533846 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533849 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533852 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533855 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533858 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533861 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533865 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533868 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533871 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533874 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533877 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533880 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 15:11:10.538951 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533882 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533886 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533889 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533892 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533895 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533897 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533900 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533902 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533905 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533908 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533910 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533913 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533915 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533918 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533920 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533923 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533925 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533928 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533930 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 15:11:10.539500 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533933 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533935 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533938 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533941 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533943 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533946 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533948 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533951 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533953 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533956 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533958 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533961 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533963 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533967 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533970 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533972 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 15:11:10.540090 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.533975 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.533980 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534092 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534097 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534100 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534102 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534105 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534107 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534110 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534113 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534115 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534118 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534120 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534123 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534125 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 15:11:10.540528 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534128 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534131 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534133 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534136 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534138 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534141 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534143 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534146 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534148 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534151 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534153 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534156 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534159 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534161 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534164 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534168 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534170 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534173 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534177 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 15:11:10.540897 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534181 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534184 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534186 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534189 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534191 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534194 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534196 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534200 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534204 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534206 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534209 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534212 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534214 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534217 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534219 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534222 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534224 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534226 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534229 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534231 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 15:11:10.541499 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534234 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534236 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534239 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534241 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534244 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534246 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534249 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534251 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534254 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534257 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534259 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534262 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534264 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534267 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534269 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534271 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534274 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534276 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534279 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534281 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 15:11:10.541986 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534284 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534289 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534291 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534294 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534296 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534299 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534302 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534306 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534309 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534312 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534314 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534317 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534319 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534322 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534325 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534329 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534332 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534335 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534338 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534340 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 15:11:10.542496 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534358 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534361 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534365 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534368 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534370 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534373 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:10.534376 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.534380 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.534476 2562 server.go:962] "Client rotation is on, will bootstrap in background" Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.539639 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.541284 2562 server.go:1019] "Starting client certificate rotation" Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.541391 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 15:11:10.542974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.541431 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 15:11:10.544647 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.544632 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 15:11:10.548691 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.548667 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 15:11:10.558616 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.558594 2562 log.go:25] "Validated CRI v1 runtime API" Aug 04 15:11:10.560769 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.560753 2562 log.go:25] "Validated CRI v1 image API" Aug 04 15:11:10.562426 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.562403 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 04 15:11:10.564920 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.564902 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 adf95018-8a92-4f78-91cf-87f22e8751ca:/dev/nvme0n1p3 d2f5daaa-a1e6-4e11-8c8d-2c262a053213:/dev/nvme0n1p4] Aug 04 15:11:10.564972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.564921 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 04 15:11:10.569886 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.569773 2562 manager.go:216] Machine: {Timestamp:2026-08-04 15:11:10.568497479 +0000 UTC m=+0.338890703 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099781 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec244e5e87865d12f2c6a132b6ec5099 SystemUUID:ec244e5e-8786-5d12-f2c6-a132b6ec5099 BootID:6ce96b7d-1b11-4f69-ae53-49b64ce4d465 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:55:ae:37:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:55:ae:37:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:61:4e:bb:17:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 04 15:11:10.569886 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.569881 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 04 15:11:10.570004 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.569993 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 04 15:11:10.572942 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.572919 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 04 15:11:10.573091 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.572943 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 04 15:11:10.573935 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.573915 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 15:11:10.574233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.574216 2562 topology_manager.go:138] "Creating topology manager with none policy" Aug 04 15:11:10.574304 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.574244 2562 container_manager_linux.go:309] "Creating device plugin manager" Aug 04 15:11:10.574304 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.574252 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 15:11:10.575152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.575141 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 15:11:10.577837 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.577816 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 04 15:11:10.581267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581255 2562 state_mem.go:36] "Initialized new in-memory state store" Aug 04 15:11:10.581406 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581396 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 04 15:11:10.581444 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581427 2562 kubelet.go:486] "Attempting to sync node with API server" Aug 04 15:11:10.581444 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581437 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 04 15:11:10.581505 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581447 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 04 15:11:10.581505 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581456 2562 kubelet.go:398] "Adding apiserver pod source" Aug 04 15:11:10.581505 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581466 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 04 15:11:10.581841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581829 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 15:11:10.581903 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.581853 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 15:11:10.583932 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.583917 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 04 15:11:10.585386 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.585373 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 04 15:11:10.585435 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.585402 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 04 15:11:10.586071 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586057 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 04 15:11:10.586071 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586073 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 04 15:11:10.586165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586080 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 04 15:11:10.586165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586085 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 04 15:11:10.586165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586093 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 04 15:11:10.586165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586099 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 04 15:11:10.586439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586426 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 04 15:11:10.586477 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586442 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 04 15:11:10.586477 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586450 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 04 15:11:10.586477 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586455 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 04 15:11:10.586477 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586465 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 04 15:11:10.586477 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.586473 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 04 15:11:10.587266 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.587256 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 04 15:11:10.587266 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.587266 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 04 15:11:10.590480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.590466 2562 server.go:1268] "Started kubelet" Aug 04 15:11:10.590592 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.590557 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 04 15:11:10.590655 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.590579 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 04 15:11:10.590712 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.590659 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 04 15:11:10.591365 ip-10-0-135-95 systemd[1]: Started Kubernetes Kubelet. Aug 04 15:11:10.592024 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.591997 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 04 15:11:10.592175 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.592096 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 04 15:11:10.592233 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.592197 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 04 15:11:10.592487 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.592393 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 04 15:11:10.593204 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.593186 2562 server.go:310] "Adding debug handlers to kubelet server" Aug 04 15:11:10.595771 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.595739 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 04 15:11:10.598823 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.598809 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 04 15:11:10.598914 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.598897 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 04 15:11:10.599021 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.597828 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-95.ec2.internal.18c8a2d0f4726d11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-95.ec2.internal,UID:ip-10-0-135-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-95.ec2.internal,},FirstTimestamp:2026-08-04 15:11:10.590438673 +0000 UTC m=+0.360831896,LastTimestamp:2026-08-04 15:11:10.590438673 +0000 UTC m=+0.360831896,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-95.ec2.internal,}" Aug 04 15:11:10.599495 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599477 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 04 15:11:10.599586 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599494 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 04 15:11:10.599640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599602 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 04 15:11:10.599640 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.599473 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:10.599775 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599759 2562 reconstruct.go:97] "Volume reconstruction finished" Aug 04 15:11:10.599775 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599771 2562 reconciler.go:29] "Reconciler: start to sync state" Aug 04 15:11:10.599914 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599898 2562 factory.go:55] Registering systemd factory Aug 04 15:11:10.599971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.599918 2562 factory.go:223] Registration of the systemd container factory successfully Aug 04 15:11:10.600509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.600489 2562 factory.go:153] Registering CRI-O factory Aug 04 15:11:10.600509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.600511 2562 factory.go:223] Registration of the crio container factory successfully Aug 04 15:11:10.600651 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.600580 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 04 15:11:10.600651 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.600602 2562 factory.go:103] Registering Raw factory Aug 04 15:11:10.600651 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.600625 2562 manager.go:1196] Started watching for new ooms in manager Aug 04 15:11:10.601309 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.601289 2562 manager.go:349] Starting recovery of all containers Aug 04 15:11:10.606198 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.606117 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 04 15:11:10.606198 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.606122 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 04 15:11:10.606370 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.606295 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6rlqz" Aug 04 15:11:10.613232 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.613208 2562 manager.go:354] Recovery completed Aug 04 15:11:10.615485 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.615469 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6rlqz" Aug 04 15:11:10.617971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.617960 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.620409 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620395 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.620478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620424 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.620478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620442 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.620975 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620961 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 04 15:11:10.620975 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620974 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 04 15:11:10.621069 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620964 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.621069 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.620990 2562 state_mem.go:36] "Initialized new in-memory state store" Aug 04 15:11:10.621972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.621955 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.622040 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.621976 2562 policy_none.go:49] "None policy: Start" Aug 04 15:11:10.622040 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.621989 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 04 15:11:10.622040 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.622016 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 04 15:11:10.622177 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.621988 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.622177 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.622084 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.622433 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.622338 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-95.ec2.internal.18c8a2d0f63bbc44 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-95.ec2.internal,UID:ip-10-0-135-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-95.ec2.internal,},FirstTimestamp:2026-08-04 15:11:10.6204089 +0000 UTC m=+0.390802123,LastTimestamp:2026-08-04 15:11:10.6204089 +0000 UTC m=+0.390802123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-95.ec2.internal,}" Aug 04 15:11:10.622971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.622960 2562 policy_none.go:47] "Start" Aug 04 15:11:10.658620 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.658603 2562 manager.go:337] "Starting Device Plugin manager" Aug 04 15:11:10.658698 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.658640 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 04 15:11:10.658698 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.658653 2562 server.go:87] "Starting device plugin registration server" Aug 04 15:11:10.658959 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.658944 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 04 15:11:10.659016 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.658961 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 04 15:11:10.659099 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.659083 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 04 15:11:10.659224 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.659207 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 04 15:11:10.659224 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.659222 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 04 15:11:10.659786 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.659651 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 04 15:11:10.659867 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.659821 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:10.759814 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.759791 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.760902 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.760719 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.760902 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.760748 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.760902 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.760757 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.760902 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.760780 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.770461 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.770406 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.770461 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.770433 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-95.ec2.internal\": node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:10.775972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.775943 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 04 15:11:10.777273 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.777258 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 04 15:11:10.777333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.777297 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 04 15:11:10.777333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.777318 2562 kubelet.go:2448] "Starting kubelet main sync loop" Aug 04 15:11:10.777459 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.777370 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 04 15:11:10.779501 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.779486 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 15:11:10.829204 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.829167 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:10.877718 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.877668 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"] Aug 04 15:11:10.877805 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.877769 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.879310 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.879296 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.879385 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.879326 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.879385 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.879336 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.880775 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.880763 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.880863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.880849 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.880896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.880879 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.881492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.881475 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.881576 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.881479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.881576 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.881508 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.881576 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.881523 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.881576 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.881525 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.881576 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.881538 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.882693 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.882677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.882767 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.882706 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 15:11:10.883428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.883411 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory" Aug 04 15:11:10.883496 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.883445 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 15:11:10.883496 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.883458 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID" Aug 04 15:11:10.902078 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.902032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8b8e081d682f77350c20538c7d5d9ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"b8b8e081d682f77350c20538c7d5d9ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.902155 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.902090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8b8e081d682f77350c20538c7d5d9ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"b8b8e081d682f77350c20538c7d5d9ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.902155 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:10.902120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea84f11ede18b206ea05dd1ebd48a2be-config\") pod \"kube-apiserver-proxy-ip-10-0-135-95.ec2.internal\" (UID: \"ea84f11ede18b206ea05dd1ebd48a2be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.911967 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.911945 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-95.ec2.internal\" not found" node="ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.916496 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.916478 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-95.ec2.internal\" not found" node="ip-10-0-135-95.ec2.internal" Aug 04 15:11:10.929534 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:10.929519 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.002982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.002955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8b8e081d682f77350c20538c7d5d9ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"b8b8e081d682f77350c20538c7d5d9ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.003075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.002995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8b8e081d682f77350c20538c7d5d9ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"b8b8e081d682f77350c20538c7d5d9ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.003075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.003023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea84f11ede18b206ea05dd1ebd48a2be-config\") pod \"kube-apiserver-proxy-ip-10-0-135-95.ec2.internal\" (UID: \"ea84f11ede18b206ea05dd1ebd48a2be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.003075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.003046 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8b8e081d682f77350c20538c7d5d9ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"b8b8e081d682f77350c20538c7d5d9ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.003075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.003056 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8b8e081d682f77350c20538c7d5d9ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"b8b8e081d682f77350c20538c7d5d9ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.003207 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.003074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea84f11ede18b206ea05dd1ebd48a2be-config\") pod \"kube-apiserver-proxy-ip-10-0-135-95.ec2.internal\" (UID: \"ea84f11ede18b206ea05dd1ebd48a2be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.030154 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.030101 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.130867 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.130845 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.214614 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.214597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.219982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.219864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" Aug 04 15:11:11.231469 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.231451 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.333064 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.332990 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.433630 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.433592 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.474279 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.474254 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 15:11:11.534553 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.534532 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.540049 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.540031 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 04 15:11:11.540169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.540149 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 04 15:11:11.540234 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.540198 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 04 15:11:11.619700 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.619632 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 15:06:11 +0000 UTC" deadline="2028-03-07 15:43:13.498674574 +0000 UTC" Aug 04 15:11:11.619700 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.619660 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13944h32m1.879016932s" Aug 04 15:11:11.635791 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.635767 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.736357 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.736321 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.773804 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:11.773776 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b8e081d682f77350c20538c7d5d9ac.slice/crio-38cc8875831749112d3074f722c464d7a98dafb347d5bf94a8ed8f7203c42838 WatchSource:0}: Error finding container 38cc8875831749112d3074f722c464d7a98dafb347d5bf94a8ed8f7203c42838: Status 404 returned error can't find the container with id 38cc8875831749112d3074f722c464d7a98dafb347d5bf94a8ed8f7203c42838 Aug 04 15:11:11.778656 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.778630 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 15:11:11.780807 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.780770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" event={"ID":"b8b8e081d682f77350c20538c7d5d9ac","Type":"ContainerStarted","Data":"38cc8875831749112d3074f722c464d7a98dafb347d5bf94a8ed8f7203c42838"} Aug 04 15:11:11.837011 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.836984 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.937506 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:11.937443 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found" Aug 04 15:11:11.953295 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.953273 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 15:11:11.999579 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:11.999547 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" Aug 04 15:11:12.018441 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.018417 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 15:11:12.019547 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.019532 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" Aug 04 15:11:12.040143 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.040121 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 15:11:12.062868 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.062849 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 15:11:12.582213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.582181 2562 apiserver.go:52] "Watching apiserver" Aug 04 15:11:12.594070 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.594044 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 04 15:11:12.594528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.594506 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz","openshift-cluster-node-tuning-operator/tuned-2mqt2","openshift-dns/node-resolver-7krts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal","openshift-network-diagnostics/network-check-target-2lfz8","openshift-ovn-kubernetes/ovnkube-node-vz5xq","kube-system/konnectivity-agent-5p55r","openshift-image-registry/node-ca-wxc2n","openshift-multus/multus-additional-cni-plugins-gsltr","openshift-multus/multus-h4zxx","openshift-multus/network-metrics-daemon-dpq4x","openshift-network-operator/iptables-alerter-rg7t9","kube-system/global-pull-secret-syncer-d2wwg"] Aug 04 15:11:12.596404 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.596378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.597864 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.597603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.598911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.598891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.599723 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.599700 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 04 15:11:12.600445 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.600408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.601520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.601499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.601632 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.601607 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:12.602528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.602508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 04 15:11:12.602528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.602517 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.602680 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.602578 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 04 15:11:12.602680 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.602582 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.602680 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.602516 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 04 15:11:12.602876 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.602829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:12.602945 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.602920 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:12.603580 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.603548 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 04 15:11:12.603667 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.603587 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 04 15:11:12.604077 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.603998 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.604184 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5q6x7\"" Aug 04 15:11:12.604258 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604217 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 04 15:11:12.604367 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hwc6n\"" Aug 04 15:11:12.604520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604502 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.604606 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604573 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.605062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.605062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.604778 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gwmsq\"" Aug 04 15:11:12.605178 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.605153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.605464 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.605446 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.605545 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.605472 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.605776 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.605759 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7zmw\"" Aug 04 15:11:12.606095 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.606061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.607739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.607714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.608710 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.608691 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.609386 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.609264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tlqc2\"" Aug 04 15:11:12.609386 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.609271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.610789 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.610773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.611441 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611419 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 04 15:11:12.611540 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-etc-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.611632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-cni-multus\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.611632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xcf\" (UniqueName: \"kubernetes.io/projected/83425635-6e3b-4258-8f46-a633932856c4-kube-api-access-r9xcf\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.611632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3efdd025-7d22-4539-a223-d79bc17fb7d0-hosts-file\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.611632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-cnibin\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-system-cni-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5k2\" (UniqueName: \"kubernetes.io/projected/75bfc996-cf4e-4c07-b2df-cb89bdee8125-kube-api-access-wg5k2\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-kubernetes\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b86fa58e-a860-4681-9d75-5eacafae1780-ovn-node-metrics-cert\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-multus-certs\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-etc-kubernetes\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.611828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-systemd\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75bfc996-cf4e-4c07-b2df-cb89bdee8125-cni-binary-copy\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-socket-dir-parent\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-daemon-config\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3efdd025-7d22-4539-a223-d79bc17fb7d0-tmp-dir\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.611981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-cni-bin\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-modprobe-d\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612054 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8445m\"" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-node-log\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-cni-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-kubelet\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-kubelet\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-var-lib-kubelet\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-run\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-systemd-units\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612250 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-slash\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-log-socket\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-env-overrides\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612365 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysctl-d\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-lib-modules\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612514 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83425635-6e3b-4258-8f46-a633932856c4-tmp\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-ovn\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-ovnkube-config\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612599 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.612601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612607 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkzt7\" (UniqueName: \"kubernetes.io/projected/b86fa58e-a860-4681-9d75-5eacafae1780-kube-api-access-zkzt7\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-os-release\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.612922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-netns\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-systemd\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9kqz9\"" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-conf-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-run-netns\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-var-lib-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612803 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-ovnkube-script-lib\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f69fs\" (UniqueName: \"kubernetes.io/projected/3efdd025-7d22-4539-a223-d79bc17fb7d0-kube-api-access-f69fs\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.612960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-cni-netd\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-894nd\"" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-k8s-cni-cncf-io\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-hostroot\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613147 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-sys\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83425635-6e3b-4258-8f46-a633932856c4-etc-tuned\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.613826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.613230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-cni-bin\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.614783 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.614435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysconfig\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.614783 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.614486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysctl-conf\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.615102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.615082 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 04 15:11:12.615877 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.615832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-host\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.616209 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.616186 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 04 15:11:12.616299 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.616279 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k844d\"" Aug 04 15:11:12.616942 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.616922 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 04 15:11:12.619838 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.619818 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 15:11:12.652520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.652493 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2nxn6" Aug 04 15:11:12.666191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.666168 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2nxn6" Aug 04 15:11:12.701062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.701042 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 04 15:11:12.716127 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/574ac05a-6ef1-4ee6-896d-681609138916-konnectivity-ca\") pod \"konnectivity-agent-5p55r\" (UID: \"574ac05a-6ef1-4ee6-896d-681609138916\") " pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.716245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3efdd025-7d22-4539-a223-d79bc17fb7d0-hosts-file\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.716245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-cnibin\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.716245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-system-cni-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-cnibin\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3efdd025-7d22-4539-a223-d79bc17fb7d0-hosts-file\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5k2\" (UniqueName: \"kubernetes.io/projected/75bfc996-cf4e-4c07-b2df-cb89bdee8125-kube-api-access-wg5k2\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-kubernetes\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716303 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-system-cni-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-system-cni-dir\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716338 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-kubernetes\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kts98\" (UniqueName: \"kubernetes.io/projected/5df7941e-8ef3-4ecc-966b-366cbac458f5-kube-api-access-kts98\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b86fa58e-a860-4681-9d75-5eacafae1780-ovn-node-metrics-cert\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrg9q\" (UniqueName: \"kubernetes.io/projected/eddffcd5-7dce-4f24-8997-4c1ffb818b10-kube-api-access-mrg9q\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-kubelet-config\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.716472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-multus-certs\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-etc-kubernetes\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-systemd\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75bfc996-cf4e-4c07-b2df-cb89bdee8125-cni-binary-copy\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716642 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-etc-kubernetes\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716649 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-multus-certs\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716677 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-socket-dir-parent\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-daemon-config\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716782 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-systemd\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7c2ed02-2385-4b00-92c2-f5094a385e4a-host-slash\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3efdd025-7d22-4539-a223-d79bc17fb7d0-tmp-dir\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/574ac05a-6ef1-4ee6-896d-681609138916-agent-certs\") pod \"konnectivity-agent-5p55r\" (UID: \"574ac05a-6ef1-4ee6-896d-681609138916\") " pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.716981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-cni-bin\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-modprobe-d\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:12.717150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-device-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-node-log\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddffcd5-7dce-4f24-8997-4c1ffb818b10-host\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717158 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75bfc996-cf4e-4c07-b2df-cb89bdee8125-cni-binary-copy\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eddffcd5-7dce-4f24-8997-4c1ffb818b10-serviceca\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7c2ed02-2385-4b00-92c2-f5094a385e4a-iptables-alerter-script\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-registration-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-cni-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-kubelet\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717319 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-cni-bin\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717267 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-daemon-config\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-cni-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717590 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-kubelet\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717601 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-modprobe-d\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717642 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-socket-dir-parent\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717647 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3efdd025-7d22-4539-a223-d79bc17fb7d0-tmp-dir\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.718066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpxkc\" (UniqueName: \"kubernetes.io/projected/a7c2ed02-2385-4b00-92c2-f5094a385e4a-kube-api-access-tpxkc\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717697 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-node-log\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717723 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-kubelet\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-var-lib-kubelet\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-kubelet\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-var-lib-kubelet\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-run\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-systemd-units\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-systemd-units\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-slash\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.717988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-run\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718014 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-slash\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-log-socket\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-env-overrides\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.718825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718143 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-log-socket\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgrr\" (UniqueName: \"kubernetes.io/projected/d9245d37-6a56-459b-ab37-a482e6b28715-kube-api-access-bhgrr\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysctl-d\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-lib-modules\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83425635-6e3b-4258-8f46-a633932856c4-tmp\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-ovn\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-ovnkube-config\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkzt7\" (UniqueName: \"kubernetes.io/projected/b86fa58e-a860-4681-9d75-5eacafae1780-kube-api-access-zkzt7\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysctl-d\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718370 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-lib-modules\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-os-release\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-netns\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718437 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-os-release\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-systemd\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-conf-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718492 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-netns\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-run-netns\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-var-lib-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.719892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-systemd\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-ovnkube-script-lib\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-multus-conf-dir\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718598 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-run-netns\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f69fs\" (UniqueName: \"kubernetes.io/projected/3efdd025-7d22-4539-a223-d79bc17fb7d0-kube-api-access-f69fs\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718612 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-var-lib-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-sys-fs\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718737 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-socket-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9grdb\" (UniqueName: \"kubernetes.io/projected/88c20a04-196b-4fc0-8f62-2c88e189d3c0-kube-api-access-9grdb\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718882 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-ovn\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-cni-netd\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718924 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-cni-netd\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.720835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-k8s-cni-cncf-io\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.718951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-run-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719412 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-ovnkube-config\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-hostroot\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-env-overrides\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-run-k8s-cni-cncf-io\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-sys\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-hostroot\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83425635-6e3b-4258-8f46-a633932856c4-etc-tuned\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-cni-bin\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-sys\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-cnibin\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-host-cni-bin\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-os-release\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysconfig\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysctl-conf\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-host\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.721533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-dbus\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719804 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysconfig\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-etc-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-cni-multus\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9xcf\" (UniqueName: \"kubernetes.io/projected/83425635-6e3b-4258-8f46-a633932856c4-kube-api-access-r9xcf\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-etc-selinux\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719964 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-etc-sysctl-conf\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.719869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83425635-6e3b-4258-8f46-a633932856c4-host\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.720023 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b86fa58e-a860-4681-9d75-5eacafae1780-etc-openvswitch\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.720118 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75bfc996-cf4e-4c07-b2df-cb89bdee8125-host-var-lib-cni-multus\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.720184 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b86fa58e-a860-4681-9d75-5eacafae1780-ovnkube-script-lib\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.720677 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b86fa58e-a860-4681-9d75-5eacafae1780-ovn-node-metrics-cert\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.721078 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83425635-6e3b-4258-8f46-a633932856c4-tmp\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.722102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.721840 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83425635-6e3b-4258-8f46-a633932856c4-etc-tuned\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.729754 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.729667 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5k2\" (UniqueName: \"kubernetes.io/projected/75bfc996-cf4e-4c07-b2df-cb89bdee8125-kube-api-access-wg5k2\") pod \"multus-h4zxx\" (UID: \"75bfc996-cf4e-4c07-b2df-cb89bdee8125\") " pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.730985 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.730935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f69fs\" (UniqueName: \"kubernetes.io/projected/3efdd025-7d22-4539-a223-d79bc17fb7d0-kube-api-access-f69fs\") pod \"node-resolver-7krts\" (UID: \"3efdd025-7d22-4539-a223-d79bc17fb7d0\") " pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.732038 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.732006 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkzt7\" (UniqueName: \"kubernetes.io/projected/b86fa58e-a860-4681-9d75-5eacafae1780-kube-api-access-zkzt7\") pod \"ovnkube-node-vz5xq\" (UID: \"b86fa58e-a860-4681-9d75-5eacafae1780\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.732038 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.732031 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9xcf\" (UniqueName: \"kubernetes.io/projected/83425635-6e3b-4258-8f46-a633932856c4-kube-api-access-r9xcf\") pod \"tuned-2mqt2\" (UID: \"83425635-6e3b-4258-8f46-a633932856c4\") " pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.786514 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.786476 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" event={"ID":"ea84f11ede18b206ea05dd1ebd48a2be","Type":"ContainerStarted","Data":"4aa66c95b4787e11a0f01ee3b002f9dc15de83578fe80aa996c42b2e97b3589d"} Aug 04 15:11:12.820885 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.820854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:12.820885 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.820887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-device-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.820905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.820932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddffcd5-7dce-4f24-8997-4c1ffb818b10-host\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.820956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eddffcd5-7dce-4f24-8997-4c1ffb818b10-serviceca\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.820997 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-device-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821007 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddffcd5-7dce-4f24-8997-4c1ffb818b10-host\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7c2ed02-2385-4b00-92c2-f5094a385e4a-iptables-alerter-script\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.821131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-registration-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpxkc\" (UniqueName: \"kubernetes.io/projected/a7c2ed02-2385-4b00-92c2-f5094a385e4a-kube-api-access-tpxkc\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821241 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-registration-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgrr\" (UniqueName: \"kubernetes.io/projected/d9245d37-6a56-459b-ab37-a482e6b28715-kube-api-access-bhgrr\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-sys-fs\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-socket-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9grdb\" (UniqueName: \"kubernetes.io/projected/88c20a04-196b-4fc0-8f62-2c88e189d3c0-kube-api-access-9grdb\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.821503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-cnibin\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821546 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-cnibin\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821547 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821561 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eddffcd5-7dce-4f24-8997-4c1ffb818b10-serviceca\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821601 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-sys-fs\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821668 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.821693 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.821731 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7c2ed02-2385-4b00-92c2-f5094a385e4a-iptables-alerter-script\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.821788 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:13.321740345 +0000 UTC m=+3.092133581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821798 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-socket-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.821817 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:13.321798091 +0000 UTC m=+3.092191305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-os-release\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-dbus\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-etc-selinux\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-os-release\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/574ac05a-6ef1-4ee6-896d-681609138916-konnectivity-ca\") pod \"konnectivity-agent-5p55r\" (UID: \"574ac05a-6ef1-4ee6-896d-681609138916\") " pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821961 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-dbus\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.821987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-system-cni-dir\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822010 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kts98\" (UniqueName: \"kubernetes.io/projected/5df7941e-8ef3-4ecc-966b-366cbac458f5-kube-api-access-kts98\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-etc-selinux\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrg9q\" (UniqueName: \"kubernetes.io/projected/eddffcd5-7dce-4f24-8997-4c1ffb818b10-kube-api-access-mrg9q\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-kubelet-config\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822108 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df7941e-8ef3-4ecc-966b-366cbac458f5-system-cni-dir\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7c2ed02-2385-4b00-92c2-f5094a385e4a-host-slash\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/574ac05a-6ef1-4ee6-896d-681609138916-agent-certs\") pod \"konnectivity-agent-5p55r\" (UID: \"574ac05a-6ef1-4ee6-896d-681609138916\") " pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822196 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-kubelet-config\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822221 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5df7941e-8ef3-4ecc-966b-366cbac458f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7c2ed02-2385-4b00-92c2-f5094a385e4a-host-slash\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822258 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88c20a04-196b-4fc0-8f62-2c88e189d3c0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.822696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.822469 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/574ac05a-6ef1-4ee6-896d-681609138916-konnectivity-ca\") pod \"konnectivity-agent-5p55r\" (UID: \"574ac05a-6ef1-4ee6-896d-681609138916\") " pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.824572 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.824555 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/574ac05a-6ef1-4ee6-896d-681609138916-agent-certs\") pod \"konnectivity-agent-5p55r\" (UID: \"574ac05a-6ef1-4ee6-896d-681609138916\") " pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:12.831455 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.831415 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:12.831496 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.831458 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:12.831496 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.831468 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:12.831566 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:12.831512 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:13.331501524 +0000 UTC m=+3.101894736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:12.834994 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.834940 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9grdb\" (UniqueName: \"kubernetes.io/projected/88c20a04-196b-4fc0-8f62-2c88e189d3c0-kube-api-access-9grdb\") pod \"aws-ebs-csi-driver-node-76vrz\" (UID: \"88c20a04-196b-4fc0-8f62-2c88e189d3c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.835373 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.835347 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrg9q\" (UniqueName: \"kubernetes.io/projected/eddffcd5-7dce-4f24-8997-4c1ffb818b10-kube-api-access-mrg9q\") pod \"node-ca-wxc2n\" (UID: \"eddffcd5-7dce-4f24-8997-4c1ffb818b10\") " pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.835464 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.835404 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kts98\" (UniqueName: \"kubernetes.io/projected/5df7941e-8ef3-4ecc-966b-366cbac458f5-kube-api-access-kts98\") pod \"multus-additional-cni-plugins-gsltr\" (UID: \"5df7941e-8ef3-4ecc-966b-366cbac458f5\") " pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.835730 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.835709 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpxkc\" (UniqueName: \"kubernetes.io/projected/a7c2ed02-2385-4b00-92c2-f5094a385e4a-kube-api-access-tpxkc\") pod \"iptables-alerter-rg7t9\" (UID: \"a7c2ed02-2385-4b00-92c2-f5094a385e4a\") " pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.836263 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.836247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgrr\" (UniqueName: \"kubernetes.io/projected/d9245d37-6a56-459b-ab37-a482e6b28715-kube-api-access-bhgrr\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:12.855768 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.855749 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 15:11:12.908959 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.908931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:12.919210 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:12.919167 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86fa58e_a860_4681_9d75_5eacafae1780.slice/crio-9bec59887591fb9c7973604205c229289fc567e44058e4e97e8c5ab069f348be WatchSource:0}: Error finding container 9bec59887591fb9c7973604205c229289fc567e44058e4e97e8c5ab069f348be: Status 404 returned error can't find the container with id 9bec59887591fb9c7973604205c229289fc567e44058e4e97e8c5ab069f348be Aug 04 15:11:12.919939 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.919921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h4zxx" Aug 04 15:11:12.926595 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.926571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" Aug 04 15:11:12.931574 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:12.931551 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bfc996_cf4e_4c07_b2df_cb89bdee8125.slice/crio-424ab1ad7cb23f6e901ce2a3824aa31d2fadfe591f1b8fbd5e9b737e6796a7b8 WatchSource:0}: Error finding container 424ab1ad7cb23f6e901ce2a3824aa31d2fadfe591f1b8fbd5e9b737e6796a7b8: Status 404 returned error can't find the container with id 424ab1ad7cb23f6e901ce2a3824aa31d2fadfe591f1b8fbd5e9b737e6796a7b8 Aug 04 15:11:12.933087 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.933071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7krts" Aug 04 15:11:12.940188 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.940167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxc2n" Aug 04 15:11:12.949000 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.948982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg7t9" Aug 04 15:11:12.957966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.957950 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" Aug 04 15:11:12.965606 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.965588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gsltr" Aug 04 15:11:12.971439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:12.971413 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:13.279022 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.278983 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83425635_6e3b_4258_8f46_a633932856c4.slice/crio-dbf7e415f126784d15e7d1fddb2a1a44f93b18e9a6dcab5e7d32acb3807c52b7 WatchSource:0}: Error finding container dbf7e415f126784d15e7d1fddb2a1a44f93b18e9a6dcab5e7d32acb3807c52b7: Status 404 returned error can't find the container with id dbf7e415f126784d15e7d1fddb2a1a44f93b18e9a6dcab5e7d32acb3807c52b7 Aug 04 15:11:13.300833 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.300810 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c20a04_196b_4fc0_8f62_2c88e189d3c0.slice/crio-874881a76370d5517b1a30aa4bb1dd028dd038b5b6be33dd29dbf83feaae028f WatchSource:0}: Error finding container 874881a76370d5517b1a30aa4bb1dd028dd038b5b6be33dd29dbf83feaae028f: Status 404 returned error can't find the container with id 874881a76370d5517b1a30aa4bb1dd028dd038b5b6be33dd29dbf83feaae028f Aug 04 15:11:13.301335 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.301275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c2ed02_2385_4b00_92c2_f5094a385e4a.slice/crio-5ee27a3959f133cb1874375e84dc3f6c40bcaddba66ce96d762786ccd018f738 WatchSource:0}: Error finding container 5ee27a3959f133cb1874375e84dc3f6c40bcaddba66ce96d762786ccd018f738: Status 404 returned error can't find the container with id 5ee27a3959f133cb1874375e84dc3f6c40bcaddba66ce96d762786ccd018f738 Aug 04 15:11:13.303676 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.303628 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df7941e_8ef3_4ecc_966b_366cbac458f5.slice/crio-5cf0839f1a371796ea5d519bf9edffa56dc194e14f9ff98d812f957d4ca39837 WatchSource:0}: Error finding container 5cf0839f1a371796ea5d519bf9edffa56dc194e14f9ff98d812f957d4ca39837: Status 404 returned error can't find the container with id 5cf0839f1a371796ea5d519bf9edffa56dc194e14f9ff98d812f957d4ca39837 Aug 04 15:11:13.304933 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.304906 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efdd025_7d22_4539_a223_d79bc17fb7d0.slice/crio-2f07f38150d7f949ca5b2c5bfeec0a7a7e62a2104d1e21bd11fe199831011c90 WatchSource:0}: Error finding container 2f07f38150d7f949ca5b2c5bfeec0a7a7e62a2104d1e21bd11fe199831011c90: Status 404 returned error can't find the container with id 2f07f38150d7f949ca5b2c5bfeec0a7a7e62a2104d1e21bd11fe199831011c90 Aug 04 15:11:13.306589 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.306365 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddffcd5_7dce_4f24_8997_4c1ffb818b10.slice/crio-fe06a945ae8f346146531ec4047200a0b692890d219cca319a036a384cf6ec66 WatchSource:0}: Error finding container fe06a945ae8f346146531ec4047200a0b692890d219cca319a036a384cf6ec66: Status 404 returned error can't find the container with id fe06a945ae8f346146531ec4047200a0b692890d219cca319a036a384cf6ec66 Aug 04 15:11:13.308102 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:13.307824 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574ac05a_6ef1_4ee6_896d_681609138916.slice/crio-97da33efae2beec064b28df381725ef8e6508865bbdae452f53693fc7b0ef733 WatchSource:0}: Error finding container 97da33efae2beec064b28df381725ef8e6508865bbdae452f53693fc7b0ef733: Status 404 returned error can't find the container with id 97da33efae2beec064b28df381725ef8e6508865bbdae452f53693fc7b0ef733 Aug 04 15:11:13.326123 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.326096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:13.326184 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.326149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:13.326266 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.326249 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:13.326299 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.326276 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:13.326329 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.326308 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:14.326291479 +0000 UTC m=+4.096684694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:13.326428 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.326332 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:14.326315686 +0000 UTC m=+4.096708931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:13.351698 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.351674 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 15:11:13.427251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.427216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:13.427449 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.427411 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:13.427536 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.427457 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:13.427536 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.427481 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:13.427630 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.427551 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:14.42753028 +0000 UTC m=+4.197923500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:13.668586 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.668372 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:06:13 +0000 UTC" deadline="2028-03-06 02:20:17.021287873 +0000 UTC" Aug 04 15:11:13.669146 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.668592 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13907h9m3.352704498s" Aug 04 15:11:13.778401 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.778261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:13.778553 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:13.778410 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:13.794860 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.794249 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8b8e081d682f77350c20538c7d5d9ac" containerID="c4e6e3cf6cd3daa6422dbe4407963dc6135d729b9f9432e6e750880e8e538d28" exitCode=0 Aug 04 15:11:13.794860 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.794338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" event={"ID":"b8b8e081d682f77350c20538c7d5d9ac","Type":"ContainerDied","Data":"c4e6e3cf6cd3daa6422dbe4407963dc6135d729b9f9432e6e750880e8e538d28"} Aug 04 15:11:13.813741 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.813585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5p55r" event={"ID":"574ac05a-6ef1-4ee6-896d-681609138916","Type":"ContainerStarted","Data":"97da33efae2beec064b28df381725ef8e6508865bbdae452f53693fc7b0ef733"} Aug 04 15:11:13.827106 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.825332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7krts" event={"ID":"3efdd025-7d22-4539-a223-d79bc17fb7d0","Type":"ContainerStarted","Data":"2f07f38150d7f949ca5b2c5bfeec0a7a7e62a2104d1e21bd11fe199831011c90"} Aug 04 15:11:13.832556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.832532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg7t9" event={"ID":"a7c2ed02-2385-4b00-92c2-f5094a385e4a","Type":"ContainerStarted","Data":"5ee27a3959f133cb1874375e84dc3f6c40bcaddba66ce96d762786ccd018f738"} Aug 04 15:11:13.835719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.835688 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" event={"ID":"88c20a04-196b-4fc0-8f62-2c88e189d3c0","Type":"ContainerStarted","Data":"874881a76370d5517b1a30aa4bb1dd028dd038b5b6be33dd29dbf83feaae028f"} Aug 04 15:11:13.839354 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.839331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"9bec59887591fb9c7973604205c229289fc567e44058e4e97e8c5ab069f348be"} Aug 04 15:11:13.842650 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.842518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxc2n" event={"ID":"eddffcd5-7dce-4f24-8997-4c1ffb818b10","Type":"ContainerStarted","Data":"fe06a945ae8f346146531ec4047200a0b692890d219cca319a036a384cf6ec66"} Aug 04 15:11:13.847517 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.847453 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerStarted","Data":"5cf0839f1a371796ea5d519bf9edffa56dc194e14f9ff98d812f957d4ca39837"} Aug 04 15:11:13.849467 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.849369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" event={"ID":"83425635-6e3b-4258-8f46-a633932856c4","Type":"ContainerStarted","Data":"dbf7e415f126784d15e7d1fddb2a1a44f93b18e9a6dcab5e7d32acb3807c52b7"} Aug 04 15:11:13.851216 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:13.851161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h4zxx" event={"ID":"75bfc996-cf4e-4c07-b2df-cb89bdee8125","Type":"ContainerStarted","Data":"424ab1ad7cb23f6e901ce2a3824aa31d2fadfe591f1b8fbd5e9b737e6796a7b8"} Aug 04 15:11:14.332781 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.332692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:14.332781 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.332753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:14.333018 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.332922 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:14.333018 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.332984 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:16.332964918 +0000 UTC m=+6.103358152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:14.333694 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.333671 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:14.333817 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.333735 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:16.333717585 +0000 UTC m=+6.104110817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:14.433227 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.433191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:14.433557 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.433531 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:14.433647 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.433561 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:14.433647 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.433576 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:14.433647 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.433643 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:16.433622175 +0000 UTC m=+6.204015407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:14.669638 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.669522 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:06:13 +0000 UTC" deadline="2028-02-26 23:52:56.620249486 +0000 UTC" Aug 04 15:11:14.669638 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.669583 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13712h41m41.950670773s" Aug 04 15:11:14.781184 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.780449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:14.781184 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.780601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:14.781184 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.781018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:14.781184 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:14.781122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:14.891575 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:14.891496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" event={"ID":"b8b8e081d682f77350c20538c7d5d9ac","Type":"ContainerStarted","Data":"ee3edec7ec2b812165878e4a00522a43a7c509de6b7ea3d0f5653e2c372f7e43"} Aug 04 15:11:15.778396 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:15.778348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:15.778873 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:15.778510 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:16.351149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:16.351012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:16.351149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:16.351066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:16.351434 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.351203 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:16.351434 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.351266 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:20.351246802 +0000 UTC m=+10.121640016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:16.351717 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.351697 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:16.351822 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.351752 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:20.351736669 +0000 UTC m=+10.122129883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:16.452917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:16.452232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:16.452917 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.452442 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:16.452917 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.452465 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:16.452917 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.452479 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:16.452917 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.452539 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:20.452519874 +0000 UTC m=+10.222913092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:16.781608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:16.780757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:16.781608 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.780909 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:16.781608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:16.781381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:16.781608 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:16.781508 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:17.779120 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:17.778552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:17.779120 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:17.778712 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:18.778619 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:18.778539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:18.778619 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:18.778584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:18.779197 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:18.778704 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:18.779197 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:18.778864 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:19.778333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:19.778302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:19.778544 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:19.778448 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:20.389728 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:20.389685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:20.390194 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:20.389750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:20.390194 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.389926 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:20.390194 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.389986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:28.389971038 +0000 UTC m=+18.160364250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:20.390328 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.390303 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:20.390494 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.390352 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:28.390340398 +0000 UTC m=+18.160733610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:20.491663 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:20.491111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:20.491663 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.491271 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:20.491663 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.491287 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:20.491663 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.491296 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:20.491663 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.491347 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:28.491333286 +0000 UTC m=+18.261726498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:20.779896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:20.779541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:20.779896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:20.779668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:20.779896 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.779712 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:20.779896 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:20.779767 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:21.777491 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:21.777463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:21.777924 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:21.777571 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:22.778181 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:22.778101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:22.778181 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:22.778116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:22.778693 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:22.778237 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:22.778693 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:22.778551 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:23.777826 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:23.777783 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:23.778043 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:23.777907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:24.777950 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:24.777913 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:24.778441 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:24.777913 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:24.778441 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:24.778074 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:24.778441 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:24.778127 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:25.778056 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:25.778024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:25.778508 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:25.778142 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:26.779217 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:26.778615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:26.779217 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:26.778646 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:26.779217 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:26.778748 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:26.779217 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:26.779171 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:27.778527 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:27.778488 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:27.778736 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:27.778600 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:28.455108 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:28.455066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:28.455108 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:28.455115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:28.455675 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.455216 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:28.455675 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.455218 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:28.455675 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.455276 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:44.455259915 +0000 UTC m=+34.225653125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:28.455675 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.455291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:44.455283501 +0000 UTC m=+34.225676711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:28.556021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:28.555990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:28.556196 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.556147 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:28.556196 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.556170 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:28.556196 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.556184 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:28.556336 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.556248 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:11:44.556230073 +0000 UTC m=+34.326623288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:28.778115 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:28.778028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:28.778278 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:28.778040 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:28.778278 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.778155 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:28.778278 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:28.778237 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:29.778245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:29.778210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:29.778683 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:29.778316 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:30.779237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:30.779200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:30.779723 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:30.779315 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:30.779723 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:30.779383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:30.779723 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:30.779479 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:31.778111 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:31.778074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:31.778290 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:31.778181 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:32.777631 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:32.777599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:32.778140 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:32.777649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:32.778140 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:32.777737 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:32.778140 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:32.777881 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:33.778767 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.777705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:33.778767 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:33.778035 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:33.942504 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.942294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5p55r" event={"ID":"574ac05a-6ef1-4ee6-896d-681609138916","Type":"ContainerStarted","Data":"18bbc928e740903217c4c4a973a2cad3cf8c73b0005ae57f4a49c427f4e53cbe"} Aug 04 15:11:33.943727 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.943698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7krts" event={"ID":"3efdd025-7d22-4539-a223-d79bc17fb7d0","Type":"ContainerStarted","Data":"4c4cd0dc994353eb6f4b718698ff25b66e475044e8fc66905076df38238f8147"} Aug 04 15:11:33.945124 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.945104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" event={"ID":"88c20a04-196b-4fc0-8f62-2c88e189d3c0","Type":"ContainerStarted","Data":"89635df75438f5fc385c6193c22f175eb443de48e99e249dd736204877bbe419"} Aug 04 15:11:33.947076 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.947058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"c344bfd30dc70048e68ec79cfe249728fb673bed105b262e72fcb1ac1abfb3bf"} Aug 04 15:11:33.947150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.947117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"3000c0ff21b58e0a9fc58b8b6f00827135330c427685d01bbf6706053fd6b404"} Aug 04 15:11:33.947190 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.947150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"19876df0fd1847c4731c56acca2f6c2bfb4677ac047b0357f1becb56161fea41"} Aug 04 15:11:33.948368 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.948323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" event={"ID":"ea84f11ede18b206ea05dd1ebd48a2be","Type":"ContainerStarted","Data":"cf792f15a5f463d69e20af54de039d7682229c4d8e100520dbb4b869e43357b0"} Aug 04 15:11:33.949837 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.949817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxc2n" event={"ID":"eddffcd5-7dce-4f24-8997-4c1ffb818b10","Type":"ContainerStarted","Data":"fcc86b8c2766f5c12964902c4800141b4aaea1e44f5f83a3b40f8a7acf001edd"} Aug 04 15:11:33.951261 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.951241 2562 generic.go:356] "Generic (PLEG): container finished" podID="5df7941e-8ef3-4ecc-966b-366cbac458f5" containerID="adbf34fed085242f24efa4dba6012e03ee7820a400eab90fc0735a150eb6aa22" exitCode=0 Aug 04 15:11:33.951333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.951300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerDied","Data":"adbf34fed085242f24efa4dba6012e03ee7820a400eab90fc0735a150eb6aa22"} Aug 04 15:11:33.952708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.952691 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" event={"ID":"83425635-6e3b-4258-8f46-a633932856c4","Type":"ContainerStarted","Data":"92d4820fd510ee21839976ba9b9e066e7896438a67faa799270de0f08edb323f"} Aug 04 15:11:33.954287 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.954263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h4zxx" event={"ID":"75bfc996-cf4e-4c07-b2df-cb89bdee8125","Type":"ContainerStarted","Data":"143a6728a90b6287bb19adfd7ea36a53d8f8353a48b0e6570c2c6e5de88756b3"} Aug 04 15:11:33.997804 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:33.997762 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" podStartSLOduration=21.99774911 podStartE2EDuration="21.99774911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:14.918412072 +0000 UTC m=+4.688805311" watchObservedRunningTime="2026-08-04 15:11:33.99774911 +0000 UTC m=+23.768142342" Aug 04 15:11:34.052820 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.052770 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wxc2n" podStartSLOduration=2.8326875339999997 podStartE2EDuration="23.05274747s" totalImagesPullingTime="20.220059936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.023885124 +0000 UTC m=+23.794278356" watchObservedRunningTime="2026-08-04 15:11:34.05274747 +0000 UTC m=+23.823140703" Aug 04 15:11:34.076314 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.076269 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5p55r" podStartSLOduration=6.557575566 podStartE2EDuration="23.076253039s" totalImagesPullingTime="16.518677473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.054112174 +0000 UTC m=+23.824505405" watchObservedRunningTime="2026-08-04 15:11:34.076253039 +0000 UTC m=+23.846646270" Aug 04 15:11:34.122239 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.122202 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" podStartSLOduration=22.122186288 podStartE2EDuration="22.122186288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.076704085 +0000 UTC m=+23.847097317" watchObservedRunningTime="2026-08-04 15:11:34.122186288 +0000 UTC m=+23.892579521" Aug 04 15:11:34.162148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.162104 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h4zxx" podStartSLOduration=2.492575083 podStartE2EDuration="23.162088255s" totalImagesPullingTime="20.669513172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.122789941 +0000 UTC m=+23.893183173" watchObservedRunningTime="2026-08-04 15:11:34.162088255 +0000 UTC m=+23.932481487" Aug 04 15:11:34.185256 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.185212 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2mqt2" podStartSLOduration=2.921393212 podStartE2EDuration="23.185195824s" totalImagesPullingTime="20.263802612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.161728623 +0000 UTC m=+23.932121857" watchObservedRunningTime="2026-08-04 15:11:34.185195824 +0000 UTC m=+23.955589057" Aug 04 15:11:34.786802 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.786774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:34.787259 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:34.786887 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:34.787259 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.786944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:34.787259 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:34.787085 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:34.854138 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.854113 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 04 15:11:34.957994 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.957958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg7t9" event={"ID":"a7c2ed02-2385-4b00-92c2-f5094a385e4a","Type":"ContainerStarted","Data":"70f76d6515d54798c014686240260e7db0966edece3154bf7b2dd743ec4c1f69"} Aug 04 15:11:34.960295 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.960270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" event={"ID":"88c20a04-196b-4fc0-8f62-2c88e189d3c0","Type":"ContainerStarted","Data":"36d19d30ebc92627a0c0f33422cb102b3f288b84bb92dac1392c2e1941f31dad"} Aug 04 15:11:34.964396 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.964340 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"71fce0d923b6cef9419c0697babb355a2fe349e28def5c293c16fe9df131f6c7"} Aug 04 15:11:34.964502 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.964443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"be45959fb2c17a7ff5f67eb16e22a3fae96065e2ca5cf7f96332092245d5d984"} Aug 04 15:11:34.964502 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.964497 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"14f07a42622f43752068061268b8a5fe1f810a4a8697469b960d503dba91daa3"} Aug 04 15:11:34.968368 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.968331 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:34.968963 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.968942 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:34.978257 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.978217 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rg7t9" podStartSLOduration=3.762437361 podStartE2EDuration="23.978204617s" totalImagesPullingTime="20.215767256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.978036754 +0000 UTC m=+24.748429986" watchObservedRunningTime="2026-08-04 15:11:34.978204617 +0000 UTC m=+24.748597849" Aug 04 15:11:34.978524 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:34.978497 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7krts" podStartSLOduration=3.739714006 podStartE2EDuration="23.978488887s" totalImagesPullingTime="20.238774881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:34.185913149 +0000 UTC m=+23.956306380" watchObservedRunningTime="2026-08-04 15:11:34.978488887 +0000 UTC m=+24.748882118" Aug 04 15:11:35.673508 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:35.673393 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T15:11:34.854136323Z","UUID":"76c02780-01dd-4f4f-b59e-1875a8e24169","Handler":null,"Name":"","Endpoint":""} Aug 04 15:11:35.675102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:35.675078 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 04 15:11:35.675197 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:35.675121 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 04 15:11:35.777578 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:35.777545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:35.777727 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:35.777691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:35.966844 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:35.966769 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:35.967218 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:35.967187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5p55r" Aug 04 15:11:36.783264 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:36.783225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:36.783715 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:36.783673 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:36.783854 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:36.783725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:36.783917 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:36.783844 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:36.971451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:36.971415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" event={"ID":"88c20a04-196b-4fc0-8f62-2c88e189d3c0","Type":"ContainerStarted","Data":"349289f5e8f33e6d3873ba4e4e88e741f0158d6b7b85c7a833ffdfb598668c38"} Aug 04 15:11:36.974669 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:36.974644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"07948db936e083c68c10cf007e8210177cda2b9ebb873c4a1e46f3dd4a226397"} Aug 04 15:11:37.778362 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:37.778165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:37.778531 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:37.778457 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:38.778446 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.778420 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:38.779072 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.778425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:38.779072 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:38.778567 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:38.779072 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:38.778619 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:38.980340 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.980159 2562 generic.go:356] "Generic (PLEG): container finished" podID="5df7941e-8ef3-4ecc-966b-366cbac458f5" containerID="207a6fe6df8009cb4c786ddcda0fb4d83a8ff726616a5dc095e32259a849f66d" exitCode=0 Aug 04 15:11:38.980463 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.980218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerDied","Data":"207a6fe6df8009cb4c786ddcda0fb4d83a8ff726616a5dc095e32259a849f66d"} Aug 04 15:11:38.983978 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.983958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" event={"ID":"b86fa58e-a860-4681-9d75-5eacafae1780","Type":"ContainerStarted","Data":"101c6ecaba3e11f716a97df533bf7cbe13ed730967e630462bb98929a5a7a007"} Aug 04 15:11:38.984198 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.984182 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:38.984289 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.984238 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:38.999282 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.999261 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:38.999578 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:38.999559 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:39.012203 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:39.012165 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76vrz" podStartSLOduration=5.5790079519999995 podStartE2EDuration="28.012152868s" totalImagesPullingTime="22.433144916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:37.001601102 +0000 UTC m=+26.771994333" watchObservedRunningTime="2026-08-04 15:11:39.012152868 +0000 UTC m=+28.782546099" Aug 04 15:11:39.048109 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:39.048072 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" podStartSLOduration=7.386619636 podStartE2EDuration="28.048059198s" totalImagesPullingTime="20.661439562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:39.04800211 +0000 UTC m=+28.818395341" watchObservedRunningTime="2026-08-04 15:11:39.048059198 +0000 UTC m=+28.818452429" Aug 04 15:11:39.777825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:39.777793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:39.777997 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:39.777914 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:39.986112 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:39.986085 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 04 15:11:40.780745 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:40.780718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:40.780921 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:40.780816 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:40.780921 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:40.780866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:40.780998 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:40.780951 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:40.989611 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:40.989574 2562 generic.go:356] "Generic (PLEG): container finished" podID="5df7941e-8ef3-4ecc-966b-366cbac458f5" containerID="5257eff6bd2d049fd9932c9667f651d8e92f2b344897c79cce99568dbc966ca1" exitCode=0 Aug 04 15:11:40.989967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:40.989653 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerDied","Data":"5257eff6bd2d049fd9932c9667f651d8e92f2b344897c79cce99568dbc966ca1"} Aug 04 15:11:40.989967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:40.989748 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 04 15:11:41.778027 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:41.777996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:41.778189 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:41.778097 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:41.826579 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:41.826550 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:11:42.781213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:42.781143 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:42.781213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:42.781154 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:42.781638 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:42.781237 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:42.781638 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:42.781373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:42.995890 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:42.995859 2562 generic.go:356] "Generic (PLEG): container finished" podID="5df7941e-8ef3-4ecc-966b-366cbac458f5" containerID="ba204de0bdf6120704755618315a695a2a766eb98d382f6865c4dfe8ef262ef1" exitCode=0 Aug 04 15:11:42.996049 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:42.995903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerDied","Data":"ba204de0bdf6120704755618315a695a2a766eb98d382f6865c4dfe8ef262ef1"} Aug 04 15:11:43.778045 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:43.778020 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:43.778215 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:43.778122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:44.476193 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:44.476161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:44.476599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:44.476233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:44.476599 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.476301 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:44.476599 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.476317 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:44.476599 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.476374 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret podName:f2a7e6a6-125d-4cf4-845e-fddab92d25c8 nodeName:}" failed. No retries permitted until 2026-08-04 15:12:16.47635762 +0000 UTC m=+66.246750844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret") pod "global-pull-secret-syncer-d2wwg" (UID: "f2a7e6a6-125d-4cf4-845e-fddab92d25c8") : object "kube-system"/"original-pull-secret" not registered Aug 04 15:11:44.476599 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.476388 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs podName:d9245d37-6a56-459b-ab37-a482e6b28715 nodeName:}" failed. No retries permitted until 2026-08-04 15:12:16.476382169 +0000 UTC m=+66.246775379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs") pod "network-metrics-daemon-dpq4x" (UID: "d9245d37-6a56-459b-ab37-a482e6b28715") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 15:11:44.577424 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:44.577380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:44.577652 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.577555 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 15:11:44.577652 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.577574 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 15:11:44.577652 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.577588 2562 projected.go:196] Error preparing data for projected volume kube-api-access-wx748 for pod openshift-network-diagnostics/network-check-target-2lfz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:44.577652 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.577644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748 podName:22d61aa3-0d21-4de8-986b-14546227a512 nodeName:}" failed. No retries permitted until 2026-08-04 15:12:16.577630825 +0000 UTC m=+66.348024035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx748" (UniqueName: "kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748") pod "network-check-target-2lfz8" (UID: "22d61aa3-0d21-4de8-986b-14546227a512") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 15:11:44.780935 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:44.780867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:44.781062 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.781000 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:44.781062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:44.781032 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:44.781130 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:44.781113 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:45.777736 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:45.777700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:45.778193 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:45.777829 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:46.778524 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:46.778494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:46.778978 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:46.778500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:46.778978 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:46.778610 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:46.778978 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:46.778699 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:47.777896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:47.777861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:47.778091 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:47.777980 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:48.778111 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:48.778080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:48.778472 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:48.778199 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:48.778472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:48.778249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:48.778472 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:48.778333 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:49.011670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:49.011640 2562 generic.go:356] "Generic (PLEG): container finished" podID="5df7941e-8ef3-4ecc-966b-366cbac458f5" containerID="2f66eda6bb8f7fa0431c787888b7ef2b8ad21fa91a8fda3a84cf5bfea237d5fa" exitCode=0 Aug 04 15:11:49.011820 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:49.011684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerDied","Data":"2f66eda6bb8f7fa0431c787888b7ef2b8ad21fa91a8fda3a84cf5bfea237d5fa"} Aug 04 15:11:49.778212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:49.778181 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:49.778610 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:49.778272 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:50.016834 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:50.016802 2562 generic.go:356] "Generic (PLEG): container finished" podID="5df7941e-8ef3-4ecc-966b-366cbac458f5" containerID="09a3de561dd3dc684de9986a605c29c5a8de18bce6852ead910fb0e9f537308b" exitCode=0 Aug 04 15:11:50.016981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:50.016844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerDied","Data":"09a3de561dd3dc684de9986a605c29c5a8de18bce6852ead910fb0e9f537308b"} Aug 04 15:11:50.779197 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:50.779160 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:50.779554 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:50.779209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:50.779554 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:50.779294 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:50.779554 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:50.779418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:51.022158 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:51.022122 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsltr" event={"ID":"5df7941e-8ef3-4ecc-966b-366cbac458f5","Type":"ContainerStarted","Data":"c0c66de2e64c8b77ebb78cd1362b142b88ed6d3f1d632cc9b48731b4e42ef247"} Aug 04 15:11:51.777903 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:51.777869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:51.778084 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:51.777978 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:52.388170 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.388002 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gsltr" podStartSLOduration=8.660871874 podStartE2EDuration="41.387978982s" totalImagesPullingTime="32.727107108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:51.059427461 +0000 UTC m=+40.829820693" watchObservedRunningTime="2026-08-04 15:11:52.387978982 +0000 UTC m=+42.158372214" Aug 04 15:11:52.389194 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.389167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2wwg"] Aug 04 15:11:52.389322 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.389304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:52.389463 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:52.389440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:52.390105 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.390080 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2lfz8"] Aug 04 15:11:52.390204 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.390176 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:52.390301 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:52.390280 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:52.392603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.392582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpq4x"] Aug 04 15:11:52.392710 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:52.392695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:52.392829 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:52.392802 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:53.778145 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:53.778115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:53.778635 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:53.778221 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:53.778635 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:53.778274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:53.778635 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:53.778386 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:54.778535 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:54.778498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:54.778978 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:54.778635 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wwg" podUID="f2a7e6a6-125d-4cf4-845e-fddab92d25c8" Aug 04 15:11:55.777685 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:55.777648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:55.777875 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:55.777777 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpq4x" podUID="d9245d37-6a56-459b-ab37-a482e6b28715" Aug 04 15:11:55.777875 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:55.777832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:55.777986 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:11:55.777923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lfz8" podUID="22d61aa3-0d21-4de8-986b-14546227a512" Aug 04 15:11:56.608679 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.608649 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeReady" Aug 04 15:11:56.609190 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.608754 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 04 15:11:56.721994 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.721967 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f7ttv"] Aug 04 15:11:56.743506 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.743479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-47hzx"] Aug 04 15:11:56.743640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.743589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.759520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.759497 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7ttv"] Aug 04 15:11:56.759640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.759548 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-47hzx"] Aug 04 15:11:56.759640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.759579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.765774 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.765754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 04 15:11:56.766009 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.765994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xckv6\"" Aug 04 15:11:56.766061 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.765994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 04 15:11:56.766455 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.766440 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 04 15:11:56.767129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.767116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ssq9w\"" Aug 04 15:11:56.767516 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.767502 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 04 15:11:56.767846 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.767833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 04 15:11:56.768144 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.768131 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 04 15:11:56.771085 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.771064 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xjjkp"] Aug 04 15:11:56.787674 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.787656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:56.791176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.791160 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:11:56.797509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.797491 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xjjkp"] Aug 04 15:11:56.800326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.800307 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 04 15:11:56.802762 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.802742 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kdxng\"" Aug 04 15:11:56.802856 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.802823 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 15:11:56.802911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.802853 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 04 15:11:56.802911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.802895 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 04 15:11:56.868213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/855caa8a-096d-4b49-bcc9-f8fe63c61be7-config-volume\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.868213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96v7l\" (UniqueName: \"kubernetes.io/projected/d968be83-78d8-45bd-883b-e4a294569318-kube-api-access-96v7l\") pod \"ingress-canary-xjjkp\" (UID: \"d968be83-78d8-45bd-883b-e4a294569318\") " pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:56.868213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/855caa8a-096d-4b49-bcc9-f8fe63c61be7-tmp-dir\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.868391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.868391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shx7\" (UniqueName: \"kubernetes.io/projected/855caa8a-096d-4b49-bcc9-f8fe63c61be7-kube-api-access-9shx7\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.868391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/855caa8a-096d-4b49-bcc9-f8fe63c61be7-metrics-tls\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.868523 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-crio-socket\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.868523 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-data-volume\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.868523 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flz9n\" (UniqueName: \"kubernetes.io/projected/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-kube-api-access-flz9n\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.868523 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d968be83-78d8-45bd-883b-e4a294569318-cert\") pod \"ingress-canary-xjjkp\" (UID: \"d968be83-78d8-45bd-883b-e4a294569318\") " pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:56.868523 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.868493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.969566 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96v7l\" (UniqueName: \"kubernetes.io/projected/d968be83-78d8-45bd-883b-e4a294569318-kube-api-access-96v7l\") pod \"ingress-canary-xjjkp\" (UID: \"d968be83-78d8-45bd-883b-e4a294569318\") " pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:56.969667 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/855caa8a-096d-4b49-bcc9-f8fe63c61be7-tmp-dir\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.969667 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.969769 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shx7\" (UniqueName: \"kubernetes.io/projected/855caa8a-096d-4b49-bcc9-f8fe63c61be7-kube-api-access-9shx7\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.969817 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/855caa8a-096d-4b49-bcc9-f8fe63c61be7-metrics-tls\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.969849 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-crio-socket\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.969895 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-data-volume\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.969895 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flz9n\" (UniqueName: \"kubernetes.io/projected/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-kube-api-access-flz9n\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.969982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d968be83-78d8-45bd-883b-e4a294569318-cert\") pod \"ingress-canary-xjjkp\" (UID: \"d968be83-78d8-45bd-883b-e4a294569318\") " pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:56.969982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.969982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/855caa8a-096d-4b49-bcc9-f8fe63c61be7-tmp-dir\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.969982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.969975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/855caa8a-096d-4b49-bcc9-f8fe63c61be7-config-volume\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.970163 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.970141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-crio-socket\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.970557 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.970525 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.970557 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.970551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/855caa8a-096d-4b49-bcc9-f8fe63c61be7-config-volume\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.970700 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.970685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-data-volume\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.973887 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.973864 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.973985 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.973947 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/855caa8a-096d-4b49-bcc9-f8fe63c61be7-metrics-tls\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.974109 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.974093 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d968be83-78d8-45bd-883b-e4a294569318-cert\") pod \"ingress-canary-xjjkp\" (UID: \"d968be83-78d8-45bd-883b-e4a294569318\") " pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:56.989268 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.989247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flz9n\" (UniqueName: \"kubernetes.io/projected/2a2282f8-5f77-47cc-a6c1-9dcd94f1840d-kube-api-access-flz9n\") pod \"insights-runtime-extractor-47hzx\" (UID: \"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d\") " pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:56.989412 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.989309 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shx7\" (UniqueName: \"kubernetes.io/projected/855caa8a-096d-4b49-bcc9-f8fe63c61be7-kube-api-access-9shx7\") pod \"dns-default-f7ttv\" (UID: \"855caa8a-096d-4b49-bcc9-f8fe63c61be7\") " pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:56.989756 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:56.989735 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96v7l\" (UniqueName: \"kubernetes.io/projected/d968be83-78d8-45bd-883b-e4a294569318-kube-api-access-96v7l\") pod \"ingress-canary-xjjkp\" (UID: \"d968be83-78d8-45bd-883b-e4a294569318\") " pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:57.054186 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.054160 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7ttv" Aug 04 15:11:57.067298 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.067277 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-47hzx" Aug 04 15:11:57.096858 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.096651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xjjkp" Aug 04 15:11:57.333127 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:57.333100 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2282f8_5f77_47cc_a6c1_9dcd94f1840d.slice/crio-51c124297d64734c40ed6722e2d006b3d98cde68d532ff77dfb67228c50d2867 WatchSource:0}: Error finding container 51c124297d64734c40ed6722e2d006b3d98cde68d532ff77dfb67228c50d2867: Status 404 returned error can't find the container with id 51c124297d64734c40ed6722e2d006b3d98cde68d532ff77dfb67228c50d2867 Aug 04 15:11:57.342475 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.341565 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-47hzx"] Aug 04 15:11:57.343693 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.343674 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xjjkp"] Aug 04 15:11:57.350079 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:57.350054 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd968be83_78d8_45bd_883b_e4a294569318.slice/crio-fecbc22a0ff5871735ebc14a198047890d4f78f1a6c49082fece85d249c7f055 WatchSource:0}: Error finding container fecbc22a0ff5871735ebc14a198047890d4f78f1a6c49082fece85d249c7f055: Status 404 returned error can't find the container with id fecbc22a0ff5871735ebc14a198047890d4f78f1a6c49082fece85d249c7f055 Aug 04 15:11:57.364872 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.364838 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7ttv"] Aug 04 15:11:57.378363 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:57.378322 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855caa8a_096d_4b49_bcc9_f8fe63c61be7.slice/crio-013c3bfc106af48057f7f5681424eb4466b2a32bfcb1b495d8bcce0e09954782 WatchSource:0}: Error finding container 013c3bfc106af48057f7f5681424eb4466b2a32bfcb1b495d8bcce0e09954782: Status 404 returned error can't find the container with id 013c3bfc106af48057f7f5681424eb4466b2a32bfcb1b495d8bcce0e09954782 Aug 04 15:11:57.778168 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.778093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:11:57.778682 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.778093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:11:57.781621 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.781602 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 15:11:57.782699 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.782681 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7r4m\"" Aug 04 15:11:57.782919 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.782902 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 15:11:57.783001 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.782971 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 15:11:57.783059 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:57.783020 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k8gfq\"" Aug 04 15:11:58.040998 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.040956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xjjkp" event={"ID":"d968be83-78d8-45bd-883b-e4a294569318","Type":"ContainerStarted","Data":"fecbc22a0ff5871735ebc14a198047890d4f78f1a6c49082fece85d249c7f055"} Aug 04 15:11:58.042661 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.042631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7ttv" event={"ID":"855caa8a-096d-4b49-bcc9-f8fe63c61be7","Type":"ContainerStarted","Data":"013c3bfc106af48057f7f5681424eb4466b2a32bfcb1b495d8bcce0e09954782"} Aug 04 15:11:58.044325 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.044291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47hzx" event={"ID":"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d","Type":"ContainerStarted","Data":"7a9e8e2245c428f931c7c375dfc4c777f4cc4955a85681ff81f463b46f3ed273"} Aug 04 15:11:58.044470 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.044364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47hzx" event={"ID":"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d","Type":"ContainerStarted","Data":"51c124297d64734c40ed6722e2d006b3d98cde68d532ff77dfb67228c50d2867"} Aug 04 15:11:58.046890 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.046869 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g"] Aug 04 15:11:58.064113 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.064089 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:11:58.067499 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.067478 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Aug 04 15:11:58.067823 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.067799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g"] Aug 04 15:11:58.067942 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.067868 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dtfsg\"" Aug 04 15:11:58.179819 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.179781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/919f9e8d-ea86-4bb6-800f-9c3edb6e12e5-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dv59g\" (UID: \"919f9e8d-ea86-4bb6-800f-9c3edb6e12e5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:11:58.281264 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.281224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/919f9e8d-ea86-4bb6-800f-9c3edb6e12e5-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dv59g\" (UID: \"919f9e8d-ea86-4bb6-800f-9c3edb6e12e5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:11:58.285536 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.285504 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/919f9e8d-ea86-4bb6-800f-9c3edb6e12e5-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dv59g\" (UID: \"919f9e8d-ea86-4bb6-800f-9c3edb6e12e5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:11:58.376611 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.376535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:11:58.545185 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:58.545002 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g"] Aug 04 15:11:58.548482 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:11:58.548453 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919f9e8d_ea86_4bb6_800f_9c3edb6e12e5.slice/crio-dcda5c7f36c2f551b233aebf5b1d004a2d49e9cdb016ef112adc1c05298acefa WatchSource:0}: Error finding container dcda5c7f36c2f551b233aebf5b1d004a2d49e9cdb016ef112adc1c05298acefa: Status 404 returned error can't find the container with id dcda5c7f36c2f551b233aebf5b1d004a2d49e9cdb016ef112adc1c05298acefa Aug 04 15:11:59.048853 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:59.048817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" event={"ID":"919f9e8d-ea86-4bb6-800f-9c3edb6e12e5","Type":"ContainerStarted","Data":"dcda5c7f36c2f551b233aebf5b1d004a2d49e9cdb016ef112adc1c05298acefa"} Aug 04 15:11:59.051960 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:11:59.051928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47hzx" event={"ID":"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d","Type":"ContainerStarted","Data":"ed99f4dcd606b341f822e943d845136546805b6d7dda757df2eb3c666b2edbb6"} Aug 04 15:12:02.061963 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:02.061776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47hzx" event={"ID":"2a2282f8-5f77-47cc-a6c1-9dcd94f1840d","Type":"ContainerStarted","Data":"f85ec060a561d628e947598cb53ca5c4e7a2e6a63db2f0b7a4b4606cfebaa203"} Aug 04 15:12:02.063440 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:02.063414 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xjjkp" event={"ID":"d968be83-78d8-45bd-883b-e4a294569318","Type":"ContainerStarted","Data":"e0186098eca68f75f714d698e7823f1edf1d68c169f73ea46147412cbe8ec123"} Aug 04 15:12:02.097542 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:02.097486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-47hzx" podStartSLOduration=1.8105546019999998 podStartE2EDuration="6.097465354s" totalImagesPullingTime="4.286910752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:02.096859178 +0000 UTC m=+51.867252404" watchObservedRunningTime="2026-08-04 15:12:02.097465354 +0000 UTC m=+51.867858590" Aug 04 15:12:02.124300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:02.123768 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xjjkp" podStartSLOduration=1.5846558549999998 podStartE2EDuration="6.12375236s" totalImagesPullingTime="4.539096505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:02.122848562 +0000 UTC m=+51.893241794" watchObservedRunningTime="2026-08-04 15:12:02.12375236 +0000 UTC m=+51.894145591" Aug 04 15:12:03.068604 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.068574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7ttv" event={"ID":"855caa8a-096d-4b49-bcc9-f8fe63c61be7","Type":"ContainerStarted","Data":"b29ac1fd6348177da54e5ebcd239e9a1f3ca9950d78fe630e07304be31fad2bc"} Aug 04 15:12:03.069119 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.068626 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7ttv" event={"ID":"855caa8a-096d-4b49-bcc9-f8fe63c61be7","Type":"ContainerStarted","Data":"05ec3909869ceafe120ba97f01779b4eba429baf91a461f33419f229ff6e4e83"} Aug 04 15:12:03.069119 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.068683 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f7ttv" Aug 04 15:12:03.070128 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.070103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" event={"ID":"919f9e8d-ea86-4bb6-800f-9c3edb6e12e5","Type":"ContainerStarted","Data":"737b3ef4ab91c3c90e80469a6d4c8cf9d200e9e5d84503735c9ddae983966629"} Aug 04 15:12:03.070493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.070474 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:12:03.075060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.075043 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" Aug 04 15:12:03.091989 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.091947 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f7ttv" podStartSLOduration=2.559352154 podStartE2EDuration="7.091933413s" totalImagesPullingTime="4.532581259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:03.090282509 +0000 UTC m=+52.860675741" watchObservedRunningTime="2026-08-04 15:12:03.091933413 +0000 UTC m=+52.862326661" Aug 04 15:12:03.108606 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:03.108570 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dv59g" podStartSLOduration=1.744555395 podStartE2EDuration="5.108560022s" totalImagesPullingTime="3.364004627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:03.107401606 +0000 UTC m=+52.877794839" watchObservedRunningTime="2026-08-04 15:12:03.108560022 +0000 UTC m=+52.878953254" Aug 04 15:12:04.069871 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.069816 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-gcw4w"] Aug 04 15:12:04.089312 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.089285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:04.093872 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.093829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mjx4f\"" Aug 04 15:12:04.094045 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.093989 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 04 15:12:04.094907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.094885 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 04 15:12:04.095209 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.095189 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-gcw4w"] Aug 04 15:12:04.198163 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.198130 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-fx49f"] Aug 04 15:12:04.217216 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.217176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-fx49f"] Aug 04 15:12:04.217380 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.217322 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.220574 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.220553 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Aug 04 15:12:04.220822 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.220800 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 04 15:12:04.220822 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.220814 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 04 15:12:04.221034 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.221013 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Aug 04 15:12:04.221117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.221013 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5n22h\"" Aug 04 15:12:04.221117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.220988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 04 15:12:04.227520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.227487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvd62\" (UniqueName: \"kubernetes.io/projected/d085ffeb-e0a8-4896-abfc-0fe296713557-kube-api-access-rvd62\") pod \"downloads-77c974ffcf-gcw4w\" (UID: \"d085ffeb-e0a8-4896-abfc-0fe296713557\") " pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:04.328533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.328469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvd62\" (UniqueName: \"kubernetes.io/projected/d085ffeb-e0a8-4896-abfc-0fe296713557-kube-api-access-rvd62\") pod \"downloads-77c974ffcf-gcw4w\" (UID: \"d085ffeb-e0a8-4896-abfc-0fe296713557\") " pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:04.328533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.328503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.328533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.328529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvdw2\" (UniqueName: \"kubernetes.io/projected/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-kube-api-access-kvdw2\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.328727 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.328621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.328727 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.328684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.340896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.340874 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvd62\" (UniqueName: \"kubernetes.io/projected/d085ffeb-e0a8-4896-abfc-0fe296713557-kube-api-access-rvd62\") pod \"downloads-77c974ffcf-gcw4w\" (UID: \"d085ffeb-e0a8-4896-abfc-0fe296713557\") " pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:04.399857 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.399829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:04.429402 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.429360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.429522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.429413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvdw2\" (UniqueName: \"kubernetes.io/projected/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-kube-api-access-kvdw2\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.429522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.429474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.429522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.429518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.430565 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.430543 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.432380 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.432358 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.432460 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.432363 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.441091 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.441071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvdw2\" (UniqueName: \"kubernetes.io/projected/2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b-kube-api-access-kvdw2\") pod \"prometheus-operator-758d7cb874-fx49f\" (UID: \"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.527750 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.527589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" Aug 04 15:12:04.550700 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.550631 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-gcw4w"] Aug 04 15:12:04.555818 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:04.555794 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd085ffeb_e0a8_4896_abfc_0fe296713557.slice/crio-23d771e2b0201b9a3ff58a039a4ef47df3472901f3f6348dfcd191d21bd72560 WatchSource:0}: Error finding container 23d771e2b0201b9a3ff58a039a4ef47df3472901f3f6348dfcd191d21bd72560: Status 404 returned error can't find the container with id 23d771e2b0201b9a3ff58a039a4ef47df3472901f3f6348dfcd191d21bd72560 Aug 04 15:12:04.680260 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:04.680226 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-fx49f"] Aug 04 15:12:04.683544 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:04.683517 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8deb11_0cdc_48bd_9de2_0683f6c1ee2b.slice/crio-b88b87d65015b685c4c2c326463d15ef70f4ec11420cbcfb004c743bc48883d5 WatchSource:0}: Error finding container b88b87d65015b685c4c2c326463d15ef70f4ec11420cbcfb004c743bc48883d5: Status 404 returned error can't find the container with id b88b87d65015b685c4c2c326463d15ef70f4ec11420cbcfb004c743bc48883d5 Aug 04 15:12:05.077821 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:05.077782 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-gcw4w" event={"ID":"d085ffeb-e0a8-4896-abfc-0fe296713557","Type":"ContainerStarted","Data":"23d771e2b0201b9a3ff58a039a4ef47df3472901f3f6348dfcd191d21bd72560"} Aug 04 15:12:05.078933 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:05.078902 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" event={"ID":"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b","Type":"ContainerStarted","Data":"b88b87d65015b685c4c2c326463d15ef70f4ec11420cbcfb004c743bc48883d5"} Aug 04 15:12:07.088432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:07.088321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" event={"ID":"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b","Type":"ContainerStarted","Data":"bafdf0808bedf7054d6b70767a189f8c658c7929ce3818a232a51f59bca29af9"} Aug 04 15:12:07.088432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:07.088401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" event={"ID":"2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b","Type":"ContainerStarted","Data":"c0ed873a37f0fbe2aa66daf5a2a0594ef145c7eca940deb133894f7ca816acf3"} Aug 04 15:12:07.115168 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:07.115120 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-fx49f" podStartSLOduration=1.163214522 podStartE2EDuration="3.115106161s" totalImagesPullingTime="1.951891639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:07.113513772 +0000 UTC m=+56.883907005" watchObservedRunningTime="2026-08-04 15:12:07.115106161 +0000 UTC m=+56.885499371" Aug 04 15:12:08.592881 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.592843 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz"] Aug 04 15:12:08.595239 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.595215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.598443 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.598414 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 04 15:12:08.598556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.598530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 04 15:12:08.599598 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.599582 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4prbz\"" Aug 04 15:12:08.608095 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.608077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz"] Aug 04 15:12:08.630282 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.630256 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p56ws"] Aug 04 15:12:08.632596 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.632574 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.637028 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.637010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 04 15:12:08.637142 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.637063 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qbrvb\"" Aug 04 15:12:08.637571 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.637542 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 04 15:12:08.641712 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.641693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 04 15:12:08.663758 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-textfile\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.663867 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.663867 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-sys\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.663867 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-wtmp\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.663867 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-metrics-client-ca\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.664043 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.664043 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-tls\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.664043 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.663997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-root\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.664153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.664044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6329feea-4194-48ba-8140-405b95da2e8c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.664153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.664065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tvf\" (UniqueName: \"kubernetes.io/projected/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-kube-api-access-p5tvf\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.664153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.664095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6329feea-4194-48ba-8140-405b95da2e8c-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.664153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.664148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6329feea-4194-48ba-8140-405b95da2e8c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.664315 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.664174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq9ft\" (UniqueName: \"kubernetes.io/projected/6329feea-4194-48ba-8140-405b95da2e8c-kube-api-access-nq9ft\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.764513 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-tls\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.764690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-root\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.764690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6329feea-4194-48ba-8140-405b95da2e8c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.764690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tvf\" (UniqueName: \"kubernetes.io/projected/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-kube-api-access-p5tvf\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.764690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6329feea-4194-48ba-8140-405b95da2e8c-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.764690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764611 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-root\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.764690 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:12:08.764645 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 04 15:12:08.765021 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:12:08.764705 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-tls podName:5b3988bf-b8c9-4599-86a5-7c37e9cb07fc nodeName:}" failed. No retries permitted until 2026-08-04 15:12:09.264690741 +0000 UTC m=+59.035083951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-tls") pod "node-exporter-p56ws" (UID: "5b3988bf-b8c9-4599-86a5-7c37e9cb07fc") : secret "node-exporter-tls" not found Aug 04 15:12:08.765021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6329feea-4194-48ba-8140-405b95da2e8c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.765021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq9ft\" (UniqueName: \"kubernetes.io/projected/6329feea-4194-48ba-8140-405b95da2e8c-kube-api-access-nq9ft\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.765021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.764998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-textfile\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765271 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-sys\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765271 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-wtmp\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765271 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-metrics-client-ca\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765271 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-wtmp\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765467 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6329feea-4194-48ba-8140-405b95da2e8c-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.765563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765499 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-sys\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765708 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765682 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.765838 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.765760 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-textfile\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.766147 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.766125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-metrics-client-ca\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.768304 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.768281 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.768416 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.768378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6329feea-4194-48ba-8140-405b95da2e8c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.768493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.768475 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6329feea-4194-48ba-8140-405b95da2e8c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.778549 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.778497 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq9ft\" (UniqueName: \"kubernetes.io/projected/6329feea-4194-48ba-8140-405b95da2e8c-kube-api-access-nq9ft\") pod \"openshift-state-metrics-6bb4d7b4dd-kv6kz\" (UID: \"6329feea-4194-48ba-8140-405b95da2e8c\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:08.780829 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.780807 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tvf\" (UniqueName: \"kubernetes.io/projected/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-kube-api-access-p5tvf\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:08.906451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:08.906367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" Aug 04 15:12:09.070888 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:09.070855 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz"] Aug 04 15:12:09.080559 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:09.080535 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6329feea_4194_48ba_8140_405b95da2e8c.slice/crio-4d75dccab4840f8156876d5f5012d4da6ab43d18ff5f715db0c7e48cc2d834b9 WatchSource:0}: Error finding container 4d75dccab4840f8156876d5f5012d4da6ab43d18ff5f715db0c7e48cc2d834b9: Status 404 returned error can't find the container with id 4d75dccab4840f8156876d5f5012d4da6ab43d18ff5f715db0c7e48cc2d834b9 Aug 04 15:12:09.097415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:09.097317 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" event={"ID":"6329feea-4194-48ba-8140-405b95da2e8c","Type":"ContainerStarted","Data":"4d75dccab4840f8156876d5f5012d4da6ab43d18ff5f715db0c7e48cc2d834b9"} Aug 04 15:12:09.269816 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:09.269779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-tls\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:09.272545 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:09.272521 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b3988bf-b8c9-4599-86a5-7c37e9cb07fc-node-exporter-tls\") pod \"node-exporter-p56ws\" (UID: \"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc\") " pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:09.543105 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:09.543073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p56ws" Aug 04 15:12:09.553038 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:09.553010 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3988bf_b8c9_4599_86a5_7c37e9cb07fc.slice/crio-59a9ec85d9ba8871323eeb3113931180ca950a5ca60d2dafe7d284071cc2c0d1 WatchSource:0}: Error finding container 59a9ec85d9ba8871323eeb3113931180ca950a5ca60d2dafe7d284071cc2c0d1: Status 404 returned error can't find the container with id 59a9ec85d9ba8871323eeb3113931180ca950a5ca60d2dafe7d284071cc2c0d1 Aug 04 15:12:10.103625 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:10.103571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p56ws" event={"ID":"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc","Type":"ContainerStarted","Data":"59a9ec85d9ba8871323eeb3113931180ca950a5ca60d2dafe7d284071cc2c0d1"} Aug 04 15:12:10.108193 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:10.108089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" event={"ID":"6329feea-4194-48ba-8140-405b95da2e8c","Type":"ContainerStarted","Data":"ad8c78fee3af21857daccc05c725078847768f4e0bf79c4ef4c5d424e5cadad5"} Aug 04 15:12:10.108193 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:10.108155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" event={"ID":"6329feea-4194-48ba-8140-405b95da2e8c","Type":"ContainerStarted","Data":"542e074a60a0f97e6ce0b2275546f17e3c32f010d808ffc7c2f1ba13c19d7ee4"} Aug 04 15:12:11.113918 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.113878 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b3988bf-b8c9-4599-86a5-7c37e9cb07fc" containerID="1b801013c574f71795bc8590c5f7b28dde4c492f2940cf4b8389a1170e1fb67f" exitCode=0 Aug 04 15:12:11.114454 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.113968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p56ws" event={"ID":"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc","Type":"ContainerDied","Data":"1b801013c574f71795bc8590c5f7b28dde4c492f2940cf4b8389a1170e1fb67f"} Aug 04 15:12:11.116397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.116373 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" event={"ID":"6329feea-4194-48ba-8140-405b95da2e8c","Type":"ContainerStarted","Data":"00401baf62acb557051ba7fa56baffad236bcc9baf156a910989f3c1f454708a"} Aug 04 15:12:11.169334 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.169292 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kv6kz" podStartSLOduration=2.000124369 podStartE2EDuration="3.1692715s" totalImagesPullingTime="1.169147131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:11.169207105 +0000 UTC m=+60.939600339" watchObservedRunningTime="2026-08-04 15:12:11.1692715 +0000 UTC m=+60.939664733" Aug 04 15:12:11.830428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.830393 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9"] Aug 04 15:12:11.853403 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.853374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.857527 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.857495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9"] Aug 04 15:12:11.861123 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.861105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Aug 04 15:12:11.861794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.861727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Aug 04 15:12:11.861913 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.861856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-434eia3daq4bl\"" Aug 04 15:12:11.862053 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.862040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Aug 04 15:12:11.862212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.862200 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Aug 04 15:12:11.862403 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.862390 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xmdsv\"" Aug 04 15:12:11.862562 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.862550 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Aug 04 15:12:11.892578 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxhhf\" (UniqueName: \"kubernetes.io/projected/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-kube-api-access-hxhhf\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.892748 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.892748 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.892748 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.892937 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-metrics-client-ca\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.892937 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-tls\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.892937 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.892929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.893124 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.893011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-grpc-tls\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.993533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.993709 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.993709 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-metrics-client-ca\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.993709 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-tls\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.993709 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.993709 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-grpc-tls\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.994062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxhhf\" (UniqueName: \"kubernetes.io/projected/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-kube-api-access-hxhhf\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.994062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.993768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.994911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.994786 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-metrics-client-ca\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.996806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.996760 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.997460 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.997434 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-tls\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.997998 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.997974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-grpc-tls\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.998876 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.998854 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.998989 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.998955 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:11.999446 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:11.999427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:12.008798 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.008779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz5xq" Aug 04 15:12:12.008944 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.008925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxhhf\" (UniqueName: \"kubernetes.io/projected/1fe736d3-1a4a-481e-bf9a-130dd2e0c636-kube-api-access-hxhhf\") pod \"thanos-querier-6f7ddcb789-bdqk9\" (UID: \"1fe736d3-1a4a-481e-bf9a-130dd2e0c636\") " pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:12.123044 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.122970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p56ws" event={"ID":"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc","Type":"ContainerStarted","Data":"dd3777c2d1cd814b660c2871100c161fe6ac81474b459a40af22eee887a3daa7"} Aug 04 15:12:12.123496 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.123064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p56ws" event={"ID":"5b3988bf-b8c9-4599-86a5-7c37e9cb07fc","Type":"ContainerStarted","Data":"51d13153d7a8d6c8df09704a0f1d8fb7a2e6730ac65f0f4efe12ab8ec43281e9"} Aug 04 15:12:12.165220 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.165199 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:12.194543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.193895 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p56ws" podStartSLOduration=2.961046778 podStartE2EDuration="4.193876108s" totalImagesPullingTime="1.152564312s" totalInitContainerRuntime="80.265018ms" isStatefulPod=true podCreationTimestamp="2026-08-04 15:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:12.193099555 +0000 UTC m=+61.963492789" watchObservedRunningTime="2026-08-04 15:12:12.193876108 +0000 UTC m=+61.964269343" Aug 04 15:12:12.352117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:12.352084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9"] Aug 04 15:12:12.356238 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:12.355830 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe736d3_1a4a_481e_bf9a_130dd2e0c636.slice/crio-d9821448f67057f124efa9ece53644a51acb23b797a71fb1fbfa3aff336fd55d WatchSource:0}: Error finding container d9821448f67057f124efa9ece53644a51acb23b797a71fb1fbfa3aff336fd55d: Status 404 returned error can't find the container with id d9821448f67057f124efa9ece53644a51acb23b797a71fb1fbfa3aff336fd55d Aug 04 15:12:13.075864 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.075834 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f7ttv" Aug 04 15:12:13.130304 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.130265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"d9821448f67057f124efa9ece53644a51acb23b797a71fb1fbfa3aff336fd55d"} Aug 04 15:12:13.195313 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.195279 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6cb97bdb56-kzxgj"] Aug 04 15:12:13.198181 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.197899 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.201205 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.201081 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-645kz\"" Aug 04 15:12:13.201205 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.201095 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Aug 04 15:12:13.201205 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.201095 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ubphoo1jmloq\"" Aug 04 15:12:13.202075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.202059 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 04 15:12:13.202251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.202238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Aug 04 15:12:13.204106 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.204087 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Aug 04 15:12:13.211810 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.211787 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cb97bdb56-kzxgj"] Aug 04 15:12:13.305319 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-secret-metrics-server-client-certs\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.305319 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d9b99a65-e40f-40e0-b845-a21ffc4f7071-metrics-server-audit-profiles\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.305563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b99a65-e40f-40e0-b845-a21ffc4f7071-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.305563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-client-ca-bundle\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.305563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-secret-metrics-server-tls\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.305563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d9b99a65-e40f-40e0-b845-a21ffc4f7071-audit-log\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.305563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.305499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dsk\" (UniqueName: \"kubernetes.io/projected/d9b99a65-e40f-40e0-b845-a21ffc4f7071-kube-api-access-j7dsk\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.406810 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.406726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dsk\" (UniqueName: \"kubernetes.io/projected/d9b99a65-e40f-40e0-b845-a21ffc4f7071-kube-api-access-j7dsk\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.406810 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.406773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-secret-metrics-server-client-certs\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.406810 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.406802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d9b99a65-e40f-40e0-b845-a21ffc4f7071-metrics-server-audit-profiles\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407054 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.406847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b99a65-e40f-40e0-b845-a21ffc4f7071-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407054 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.407004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-client-ca-bundle\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407161 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.407098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-secret-metrics-server-tls\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407161 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.407129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d9b99a65-e40f-40e0-b845-a21ffc4f7071-audit-log\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.407497 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d9b99a65-e40f-40e0-b845-a21ffc4f7071-audit-log\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407664 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.407586 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b99a65-e40f-40e0-b845-a21ffc4f7071-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.407900 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.407881 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d9b99a65-e40f-40e0-b845-a21ffc4f7071-metrics-server-audit-profiles\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.409879 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.409856 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-client-ca-bundle\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.410008 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.409990 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-secret-metrics-server-client-certs\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.410706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.410682 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d9b99a65-e40f-40e0-b845-a21ffc4f7071-secret-metrics-server-tls\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.419587 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.419568 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dsk\" (UniqueName: \"kubernetes.io/projected/d9b99a65-e40f-40e0-b845-a21ffc4f7071-kube-api-access-j7dsk\") pod \"metrics-server-6cb97bdb56-kzxgj\" (UID: \"d9b99a65-e40f-40e0-b845-a21ffc4f7071\") " pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.436080 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.436057 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2"] Aug 04 15:12:13.439161 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.439139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.443979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.443955 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Aug 04 15:12:13.444187 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.444173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b4b82\"" Aug 04 15:12:13.455985 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.455966 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2"] Aug 04 15:12:13.508672 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.508621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1dbc5eb-2007-4625-8531-3969cc5ac1d9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-xhxd2\" (UID: \"b1dbc5eb-2007-4625-8531-3969cc5ac1d9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.508847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.508690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2v7\" (UniqueName: \"kubernetes.io/projected/b1dbc5eb-2007-4625-8531-3969cc5ac1d9-kube-api-access-5w2v7\") pod \"monitoring-plugin-6dffbbd67-xhxd2\" (UID: \"b1dbc5eb-2007-4625-8531-3969cc5ac1d9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.510532 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.510503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:13.609914 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.609867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1dbc5eb-2007-4625-8531-3969cc5ac1d9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-xhxd2\" (UID: \"b1dbc5eb-2007-4625-8531-3969cc5ac1d9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.610054 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.609960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2v7\" (UniqueName: \"kubernetes.io/projected/b1dbc5eb-2007-4625-8531-3969cc5ac1d9-kube-api-access-5w2v7\") pod \"monitoring-plugin-6dffbbd67-xhxd2\" (UID: \"b1dbc5eb-2007-4625-8531-3969cc5ac1d9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.613453 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.613396 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1dbc5eb-2007-4625-8531-3969cc5ac1d9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-xhxd2\" (UID: \"b1dbc5eb-2007-4625-8531-3969cc5ac1d9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.621224 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.621200 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2v7\" (UniqueName: \"kubernetes.io/projected/b1dbc5eb-2007-4625-8531-3969cc5ac1d9-kube-api-access-5w2v7\") pod \"monitoring-plugin-6dffbbd67-xhxd2\" (UID: \"b1dbc5eb-2007-4625-8531-3969cc5ac1d9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.664486 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.664400 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cb97bdb56-kzxgj"] Aug 04 15:12:13.668178 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:13.668145 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b99a65_e40f_40e0_b845_a21ffc4f7071.slice/crio-c160176c5c0200da7bcc1bb821f1f919b6de1f3a75ef5c6bc40aba8316309cc4 WatchSource:0}: Error finding container c160176c5c0200da7bcc1bb821f1f919b6de1f3a75ef5c6bc40aba8316309cc4: Status 404 returned error can't find the container with id c160176c5c0200da7bcc1bb821f1f919b6de1f3a75ef5c6bc40aba8316309cc4 Aug 04 15:12:13.751474 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.751440 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:13.902282 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:13.902244 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2"] Aug 04 15:12:14.140959 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:14.140919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" event={"ID":"d9b99a65-e40f-40e0-b845-a21ffc4f7071","Type":"ContainerStarted","Data":"c160176c5c0200da7bcc1bb821f1f919b6de1f3a75ef5c6bc40aba8316309cc4"} Aug 04 15:12:14.490149 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:14.490070 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1dbc5eb_2007_4625_8531_3969cc5ac1d9.slice/crio-ad46dabd6a803113a623b3400895723c6eb812b06638940cf83a7bba708d5f12 WatchSource:0}: Error finding container ad46dabd6a803113a623b3400895723c6eb812b06638940cf83a7bba708d5f12: Status 404 returned error can't find the container with id ad46dabd6a803113a623b3400895723c6eb812b06638940cf83a7bba708d5f12 Aug 04 15:12:15.147938 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:15.147858 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" event={"ID":"b1dbc5eb-2007-4625-8531-3969cc5ac1d9","Type":"ContainerStarted","Data":"ad46dabd6a803113a623b3400895723c6eb812b06638940cf83a7bba708d5f12"} Aug 04 15:12:15.151563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:15.151526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"9e6437d5ce3d79cb29ae88de4651f9ea6e5b60449a62c725d28e12353338b1cd"} Aug 04 15:12:15.151678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:15.151600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"50227786ab556b6cce7623a3c5dda563e82575a1cb2a02499bac478e798a6ffc"} Aug 04 15:12:15.151678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:15.151632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"e2cde7000695e158137a95a79579a61bbb0c6dd00471cda20ed657931ce766ff"} Aug 04 15:12:16.539428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.539392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:12:16.539428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.539434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:12:16.543935 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.543905 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 15:12:16.544785 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.544769 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 15:12:16.553140 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.553115 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9245d37-6a56-459b-ab37-a482e6b28715-metrics-certs\") pod \"network-metrics-daemon-dpq4x\" (UID: \"d9245d37-6a56-459b-ab37-a482e6b28715\") " pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:12:16.553140 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.553130 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2a7e6a6-125d-4cf4-845e-fddab92d25c8-original-pull-secret\") pod \"global-pull-secret-syncer-d2wwg\" (UID: \"f2a7e6a6-125d-4cf4-845e-fddab92d25c8\") " pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:12:16.602358 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.602311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wwg" Aug 04 15:12:16.640021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.639988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:12:16.645190 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.645168 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 15:12:16.654608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.654583 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 15:12:16.663442 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.663416 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx748\" (UniqueName: \"kubernetes.io/projected/22d61aa3-0d21-4de8-986b-14546227a512-kube-api-access-wx748\") pod \"network-check-target-2lfz8\" (UID: \"22d61aa3-0d21-4de8-986b-14546227a512\") " pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:12:16.691214 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.691192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7r4m\"" Aug 04 15:12:16.696101 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.696082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k8gfq\"" Aug 04 15:12:16.698995 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.698975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:12:16.704033 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:16.704016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpq4x" Aug 04 15:12:19.363492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.363459 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7bc85bdb-d5qzd"] Aug 04 15:12:19.389658 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.389632 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7bc85bdb-d5qzd"] Aug 04 15:12:19.389812 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.389786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.393272 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.393245 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 04 15:12:19.393415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.393339 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lzz5b\"" Aug 04 15:12:19.393415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.393339 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 04 15:12:19.394368 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.394332 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 04 15:12:19.394661 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.394643 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 04 15:12:19.394744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.394729 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 04 15:12:19.404125 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.404106 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 04 15:12:19.461135 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-service-ca\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.461290 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-serving-cert\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.461290 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-config\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.461290 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-trusted-ca-bundle\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.461493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nbjj\" (UniqueName: \"kubernetes.io/projected/34c67ba5-2678-451f-878b-75c4f8ebe5fe-kube-api-access-4nbjj\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.461493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-oauth-serving-cert\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.461493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.461386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-oauth-config\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562622 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-service-ca\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-serving-cert\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-config\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-trusted-ca-bundle\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nbjj\" (UniqueName: \"kubernetes.io/projected/34c67ba5-2678-451f-878b-75c4f8ebe5fe-kube-api-access-4nbjj\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-oauth-serving-cert\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.562800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.562779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-oauth-config\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.563979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.563471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-service-ca\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.563979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.563488 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-config\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.563979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.563757 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-oauth-serving-cert\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.563979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.563927 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-trusted-ca-bundle\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.565845 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.565821 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-oauth-config\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.565974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.565953 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-serving-cert\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.576428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.576382 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nbjj\" (UniqueName: \"kubernetes.io/projected/34c67ba5-2678-451f-878b-75c4f8ebe5fe-kube-api-access-4nbjj\") pod \"console-6b7bc85bdb-d5qzd\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:19.704769 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:19.704664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:23.209136 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.208529 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" event={"ID":"d9b99a65-e40f-40e0-b845-a21ffc4f7071","Type":"ContainerStarted","Data":"6b66249f3a504455f83dc58c22168e164c519da1671dfb52e5040f238828cd9a"} Aug 04 15:12:23.219400 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.219056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"9ecedf206b6840e9c55e26f1bac7a85883e30d3e068ae42a3f341a021dd1246b"} Aug 04 15:12:23.234335 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.234202 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" podStartSLOduration=0.886006725 podStartE2EDuration="10.234185366s" totalImagesPullingTime="9.348178641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:23.232691492 +0000 UTC m=+73.003084724" watchObservedRunningTime="2026-08-04 15:12:23.234185366 +0000 UTC m=+73.004578590" Aug 04 15:12:23.270919 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.270892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpq4x"] Aug 04 15:12:23.275622 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:23.275586 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9245d37_6a56_459b_ab37_a482e6b28715.slice/crio-3316b668e8e7c0c12b5e554cf012982f5afd38ed952c544f7da5d0567b9a3d7c WatchSource:0}: Error finding container 3316b668e8e7c0c12b5e554cf012982f5afd38ed952c544f7da5d0567b9a3d7c: Status 404 returned error can't find the container with id 3316b668e8e7c0c12b5e554cf012982f5afd38ed952c544f7da5d0567b9a3d7c Aug 04 15:12:23.477493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.477459 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2lfz8"] Aug 04 15:12:23.482046 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:23.482002 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d61aa3_0d21_4de8_986b_14546227a512.slice/crio-5f012472230c814356a78afaa4fe8d135647acaf68fe3c8b608be38fdabdfa98 WatchSource:0}: Error finding container 5f012472230c814356a78afaa4fe8d135647acaf68fe3c8b608be38fdabdfa98: Status 404 returned error can't find the container with id 5f012472230c814356a78afaa4fe8d135647acaf68fe3c8b608be38fdabdfa98 Aug 04 15:12:23.485636 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.485616 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2wwg"] Aug 04 15:12:23.491001 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:23.490309 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7bc85bdb-d5qzd"] Aug 04 15:12:23.501019 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:12:23.500918 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a7e6a6_125d_4cf4_845e_fddab92d25c8.slice/crio-46a208b6a82c4ef2bbe37e7afcafc062438a71fd79ecdb4220a56d0ca2d3b83f WatchSource:0}: Error finding container 46a208b6a82c4ef2bbe37e7afcafc062438a71fd79ecdb4220a56d0ca2d3b83f: Status 404 returned error can't find the container with id 46a208b6a82c4ef2bbe37e7afcafc062438a71fd79ecdb4220a56d0ca2d3b83f Aug 04 15:12:24.233048 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.229819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"1852d46e9ef1cfa80c3da99b9eb90c63949f4384c05c84af78e27daa125fee41"} Aug 04 15:12:24.233048 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.229886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" event={"ID":"1fe736d3-1a4a-481e-bf9a-130dd2e0c636","Type":"ContainerStarted","Data":"09a3f2957a39c3e59d4a6d5070ee8941b8190305fdad7b26a7877abc14c67cde"} Aug 04 15:12:24.233048 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.230671 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:24.234645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.234563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7bc85bdb-d5qzd" event={"ID":"34c67ba5-2678-451f-878b-75c4f8ebe5fe","Type":"ContainerStarted","Data":"90b3dba748c845fd4cfc30294ada187c89f325e5b7233e345114e2e7c08ccc9f"} Aug 04 15:12:24.237880 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.237664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2lfz8" event={"ID":"22d61aa3-0d21-4de8-986b-14546227a512","Type":"ContainerStarted","Data":"5f012472230c814356a78afaa4fe8d135647acaf68fe3c8b608be38fdabdfa98"} Aug 04 15:12:24.237880 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.237819 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" Aug 04 15:12:24.239403 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.239059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2wwg" event={"ID":"f2a7e6a6-125d-4cf4-845e-fddab92d25c8","Type":"ContainerStarted","Data":"46a208b6a82c4ef2bbe37e7afcafc062438a71fd79ecdb4220a56d0ca2d3b83f"} Aug 04 15:12:24.241070 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.241025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-gcw4w" event={"ID":"d085ffeb-e0a8-4896-abfc-0fe296713557","Type":"ContainerStarted","Data":"fddde4d65d131e5c494ec3502d8fb7c6d47f997a83dca268758f450fb14e9987"} Aug 04 15:12:24.241812 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.241630 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:24.242794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.242762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpq4x" event={"ID":"d9245d37-6a56-459b-ab37-a482e6b28715","Type":"ContainerStarted","Data":"3316b668e8e7c0c12b5e554cf012982f5afd38ed952c544f7da5d0567b9a3d7c"} Aug 04 15:12:24.249279 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.249266 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-gcw4w" Aug 04 15:12:24.279237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.278730 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f7ddcb789-bdqk9" podStartSLOduration=2.835582744 podStartE2EDuration="13.278710108s" totalImagesPullingTime="10.443127364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:24.275891748 +0000 UTC m=+74.046284993" watchObservedRunningTime="2026-08-04 15:12:24.278710108 +0000 UTC m=+74.049103342" Aug 04 15:12:24.309021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:24.308074 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-gcw4w" podStartSLOduration=1.771469129 podStartE2EDuration="20.30805329s" totalImagesPullingTime="18.536584161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:24.30744777 +0000 UTC m=+74.077841004" watchObservedRunningTime="2026-08-04 15:12:24.30805329 +0000 UTC m=+74.078446707" Aug 04 15:12:25.252653 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:25.252611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" event={"ID":"b1dbc5eb-2007-4625-8531-3969cc5ac1d9","Type":"ContainerStarted","Data":"3ed5aa28f06996261bfa4c2f5f3316a025e613dd1e97ad61794ed47185bbf3cf"} Aug 04 15:12:25.253055 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:25.252973 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:25.259097 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:25.259045 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" Aug 04 15:12:25.278407 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:25.278322 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-xhxd2" podStartSLOduration=1.726381034 podStartE2EDuration="12.278303819s" totalImagesPullingTime="10.551922785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:25.277071763 +0000 UTC m=+75.047464996" watchObservedRunningTime="2026-08-04 15:12:25.278303819 +0000 UTC m=+75.048697050" Aug 04 15:12:26.261993 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:26.261957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpq4x" event={"ID":"d9245d37-6a56-459b-ab37-a482e6b28715","Type":"ContainerStarted","Data":"c804822e7485ef72d0a45f941aca495a32d57e268ad3123aa9589c5714b412db"} Aug 04 15:12:26.262512 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:26.262020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpq4x" event={"ID":"d9245d37-6a56-459b-ab37-a482e6b28715","Type":"ContainerStarted","Data":"c5b73e87fbfb9fd6d5fde81b7de18820fadf42c3ba6c4e2db8ee711a9c2bc1aa"} Aug 04 15:12:26.286838 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:26.286770 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dpq4x" podStartSLOduration=73.18747741 podStartE2EDuration="1m15.286749591s" totalImagesPullingTime="2.099272181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:26.285418483 +0000 UTC m=+76.055811719" watchObservedRunningTime="2026-08-04 15:12:26.286749591 +0000 UTC m=+76.057142826" Aug 04 15:12:33.294835 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.294798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7bc85bdb-d5qzd" event={"ID":"34c67ba5-2678-451f-878b-75c4f8ebe5fe","Type":"ContainerStarted","Data":"5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff"} Aug 04 15:12:33.296307 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.296276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2lfz8" event={"ID":"22d61aa3-0d21-4de8-986b-14546227a512","Type":"ContainerStarted","Data":"7377fc9b800793f6ded59a37af4b2f4398d6262ac9f4318f705166a3f17c68bd"} Aug 04 15:12:33.296470 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.296327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:12:33.297668 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.297646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2wwg" event={"ID":"f2a7e6a6-125d-4cf4-845e-fddab92d25c8","Type":"ContainerStarted","Data":"8dee952bf777f67e9818024b5b303bc0254905f0a1e0ddcc7a39b202b147abd5"} Aug 04 15:12:33.320247 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.320205 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7bc85bdb-d5qzd" podStartSLOduration=4.933141213 podStartE2EDuration="14.320193251s" totalImagesPullingTime="9.387052038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:33.318849176 +0000 UTC m=+83.089242410" watchObservedRunningTime="2026-08-04 15:12:33.320193251 +0000 UTC m=+83.090586482" Aug 04 15:12:33.336203 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.336163 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d2wwg" podStartSLOduration=72.946459578 podStartE2EDuration="1m22.336153824s" totalImagesPullingTime="9.389694246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:33.335612362 +0000 UTC m=+83.106005594" watchObservedRunningTime="2026-08-04 15:12:33.336153824 +0000 UTC m=+83.106547056" Aug 04 15:12:33.356185 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.356145 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2lfz8" podStartSLOduration=72.939689469 podStartE2EDuration="1m22.356132355s" totalImagesPullingTime="9.416442886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:33.355571844 +0000 UTC m=+83.125965077" watchObservedRunningTime="2026-08-04 15:12:33.356132355 +0000 UTC m=+83.126525586" Aug 04 15:12:33.511244 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.511212 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:33.511414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:33.511270 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:39.705856 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:39.705818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:39.706437 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:39.705923 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:39.710336 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:39.710313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:40.325326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:40.325298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:12:53.515527 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:53.515492 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:12:53.519171 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:12:53.519153 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6cb97bdb56-kzxgj" Aug 04 15:13:04.303864 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:04.303825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2lfz8" Aug 04 15:13:33.299873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.299836 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76c5965d48-sh4jn"] Aug 04 15:13:33.302981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.302964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.308442 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.308420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Aug 04 15:13:33.308639 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.308620 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Aug 04 15:13:33.309099 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.309082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Aug 04 15:13:33.309394 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.309379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Aug 04 15:13:33.309442 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.309418 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9t729\"" Aug 04 15:13:33.309651 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.309635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Aug 04 15:13:33.319731 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.319712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Aug 04 15:13:33.327562 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.327541 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76c5965d48-sh4jn"] Aug 04 15:13:33.344914 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.344896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-federate-client-tls\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.344929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-serving-certs-ca-bundle\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.344952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-secret-telemeter-client\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.344968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-telemeter-client-tls\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.344992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-metrics-client-ca\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.345007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345242 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.345089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8nj\" (UniqueName: \"kubernetes.io/projected/c8e42645-a82d-49be-a350-9701d87e934e-kube-api-access-zw8nj\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.345242 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.345131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445758 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-federate-client-tls\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-serving-certs-ca-bundle\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-secret-telemeter-client\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-telemeter-client-tls\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-metrics-client-ca\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.445965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8nj\" (UniqueName: \"kubernetes.io/projected/c8e42645-a82d-49be-a350-9701d87e934e-kube-api-access-zw8nj\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.446262 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.445979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.446975 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.446642 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-serving-certs-ca-bundle\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.446975 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.446918 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-metrics-client-ca\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.447488 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.447461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e42645-a82d-49be-a350-9701d87e934e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.448741 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.448715 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.448896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.448873 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-secret-telemeter-client\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.448977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.448963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-telemeter-client-tls\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.449035 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.449020 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c8e42645-a82d-49be-a350-9701d87e934e-federate-client-tls\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.461755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.461727 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8nj\" (UniqueName: \"kubernetes.io/projected/c8e42645-a82d-49be-a350-9701d87e934e-kube-api-access-zw8nj\") pod \"telemeter-client-76c5965d48-sh4jn\" (UID: \"c8e42645-a82d-49be-a350-9701d87e934e\") " pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.617729 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.617637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" Aug 04 15:13:33.872077 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:33.872048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76c5965d48-sh4jn"] Aug 04 15:13:33.872967 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:13:33.872939 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e42645_a82d_49be_a350_9701d87e934e.slice/crio-b5d1555b9e49f1faf29a0bc2be67b5046ba99f445912e4aaaa740ec47e3d7029 WatchSource:0}: Error finding container b5d1555b9e49f1faf29a0bc2be67b5046ba99f445912e4aaaa740ec47e3d7029: Status 404 returned error can't find the container with id b5d1555b9e49f1faf29a0bc2be67b5046ba99f445912e4aaaa740ec47e3d7029 Aug 04 15:13:34.533079 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:34.533045 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" event={"ID":"c8e42645-a82d-49be-a350-9701d87e934e","Type":"ContainerStarted","Data":"b5d1555b9e49f1faf29a0bc2be67b5046ba99f445912e4aaaa740ec47e3d7029"} Aug 04 15:13:37.547639 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:37.547607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" event={"ID":"c8e42645-a82d-49be-a350-9701d87e934e","Type":"ContainerStarted","Data":"f491ccc39044c839f0922f0254e94792880adfbc59d1bb9bd8203cfac4c13523"} Aug 04 15:13:38.553170 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.553127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" event={"ID":"c8e42645-a82d-49be-a350-9701d87e934e","Type":"ContainerStarted","Data":"822b2e4e4681cb1e545565de1f8a103420682062b154c6a13767a9145ede5034"} Aug 04 15:13:38.553654 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.553190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" event={"ID":"c8e42645-a82d-49be-a350-9701d87e934e","Type":"ContainerStarted","Data":"8c9ab808ac13bb4bc9acc1060537ed398a93f635b650c75181d8b2e0fc0ff73b"} Aug 04 15:13:38.592896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.592845 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76c5965d48-sh4jn" podStartSLOduration=1.7530367390000001 podStartE2EDuration="5.592826898s" totalImagesPullingTime="3.839790159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:13:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:13:38.590744401 +0000 UTC m=+148.361137632" watchObservedRunningTime="2026-08-04 15:13:38.592826898 +0000 UTC m=+148.363220130" Aug 04 15:13:38.796013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.795981 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b8c8df587-4bpsk"] Aug 04 15:13:38.798129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.798113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.855496 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.855471 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8c8df587-4bpsk"] Aug 04 15:13:38.889429 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-service-ca\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.889566 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-oauth-serving-cert\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.889566 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-serving-cert\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.889684 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-trusted-ca-bundle\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.889748 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-config\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.889931 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-oauth-config\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.890002 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.889983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mflq\" (UniqueName: \"kubernetes.io/projected/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-kube-api-access-2mflq\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991196 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-trusted-ca-bundle\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-config\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-oauth-config\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mflq\" (UniqueName: \"kubernetes.io/projected/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-kube-api-access-2mflq\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-service-ca\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991597 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-oauth-serving-cert\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.991597 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.991419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-serving-cert\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.992040 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.992005 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-config\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.992154 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.992094 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-trusted-ca-bundle\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.992214 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.992145 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-oauth-serving-cert\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.992214 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.992179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-service-ca\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.994422 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.994395 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-serving-cert\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:38.994556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:38.994534 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-oauth-config\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:39.010369 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:39.010328 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mflq\" (UniqueName: \"kubernetes.io/projected/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-kube-api-access-2mflq\") pod \"console-7b8c8df587-4bpsk\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:39.106541 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:39.106459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:39.242306 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:39.242275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8c8df587-4bpsk"] Aug 04 15:13:39.245414 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:13:39.245393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cf95a1_6c82_4ee1_9447_a4c42f875e91.slice/crio-1f8553e6fd62bfe8fb8a2b569c71f33fb992a725bbbd06f060a8ef681b4e6fa5 WatchSource:0}: Error finding container 1f8553e6fd62bfe8fb8a2b569c71f33fb992a725bbbd06f060a8ef681b4e6fa5: Status 404 returned error can't find the container with id 1f8553e6fd62bfe8fb8a2b569c71f33fb992a725bbbd06f060a8ef681b4e6fa5 Aug 04 15:13:39.561543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:39.561510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c8df587-4bpsk" event={"ID":"d0cf95a1-6c82-4ee1-9447-a4c42f875e91","Type":"ContainerStarted","Data":"37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc"} Aug 04 15:13:39.562006 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:39.561567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c8df587-4bpsk" event={"ID":"d0cf95a1-6c82-4ee1-9447-a4c42f875e91","Type":"ContainerStarted","Data":"1f8553e6fd62bfe8fb8a2b569c71f33fb992a725bbbd06f060a8ef681b4e6fa5"} Aug 04 15:13:39.599316 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:39.599263 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b8c8df587-4bpsk" podStartSLOduration=1.599248065 podStartE2EDuration="1.599248065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:13:39.598309519 +0000 UTC m=+149.368702754" watchObservedRunningTime="2026-08-04 15:13:39.599248065 +0000 UTC m=+149.369641297" Aug 04 15:13:49.107300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:49.107259 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:49.107777 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:49.107335 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:49.111904 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:49.111873 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:49.605788 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:49.605760 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:13:49.690124 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:13:49.690092 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7bc85bdb-d5qzd"] Aug 04 15:14:14.710811 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.710751 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b7bc85bdb-d5qzd" podUID="34c67ba5-2678-451f-878b-75c4f8ebe5fe" containerName="console" containerID="cri-o://5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff" gracePeriod=15 Aug 04 15:14:14.948748 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.948725 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:14:14.987139 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987069 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-oauth-serving-cert\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987139 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987114 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-oauth-config\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987405 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987154 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-service-ca\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987405 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987182 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nbjj\" (UniqueName: \"kubernetes.io/projected/34c67ba5-2678-451f-878b-75c4f8ebe5fe-kube-api-access-4nbjj\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987405 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987219 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-trusted-ca-bundle\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987447 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-config\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987515 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:14:14.987922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987618 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-serving-cert\") pod \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\" (UID: \"34c67ba5-2678-451f-878b-75c4f8ebe5fe\") " Aug 04 15:14:14.987922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.987658 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:14:14.988195 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.988175 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-trusted-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:14.988263 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.988201 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-oauth-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:14.988263 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.988210 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-config" (OuterVolumeSpecName: "console-config") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:14:14.988418 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.988395 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:14:14.989831 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.989771 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 15:14:14.990284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.990256 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 15:14:14.990284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:14.990258 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c67ba5-2678-451f-878b-75c4f8ebe5fe-kube-api-access-4nbjj" (OuterVolumeSpecName: "kube-api-access-4nbjj") pod "34c67ba5-2678-451f-878b-75c4f8ebe5fe" (UID: "34c67ba5-2678-451f-878b-75c4f8ebe5fe"). InnerVolumeSpecName "kube-api-access-4nbjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:14:15.088968 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.088938 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:15.088968 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.088962 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-oauth-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:15.088968 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.088972 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-service-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:15.089162 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.088980 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nbjj\" (UniqueName: \"kubernetes.io/projected/34c67ba5-2678-451f-878b-75c4f8ebe5fe-kube-api-access-4nbjj\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:15.089162 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.088989 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c67ba5-2678-451f-878b-75c4f8ebe5fe-console-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:14:15.700102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.700057 2562 generic.go:356] "Generic (PLEG): container finished" podID="34c67ba5-2678-451f-878b-75c4f8ebe5fe" containerID="5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff" exitCode=0 Aug 04 15:14:15.700274 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.700119 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7bc85bdb-d5qzd" Aug 04 15:14:15.700274 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.700143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7bc85bdb-d5qzd" event={"ID":"34c67ba5-2678-451f-878b-75c4f8ebe5fe","Type":"ContainerDied","Data":"5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff"} Aug 04 15:14:15.700274 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.700215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7bc85bdb-d5qzd" event={"ID":"34c67ba5-2678-451f-878b-75c4f8ebe5fe","Type":"ContainerDied","Data":"90b3dba748c845fd4cfc30294ada187c89f325e5b7233e345114e2e7c08ccc9f"} Aug 04 15:14:15.700274 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.700236 2562 scope.go:117] "RemoveContainer" containerID="5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff" Aug 04 15:14:15.710891 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.710854 2562 scope.go:117] "RemoveContainer" containerID="5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff" Aug 04 15:14:15.711263 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:14:15.711244 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff\": container with ID starting with 5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff not found: ID does not exist" containerID="5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff" Aug 04 15:14:15.711330 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.711276 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff"} err="failed to get container status \"5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff\": rpc error: code = NotFound desc = could not find container \"5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff\": container with ID starting with 5b85b285231f4c8c79f098f188c1f01618b1fbb7f228e35e670a15c3b6bd44ff not found: ID does not exist" Aug 04 15:14:15.728981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.728960 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7bc85bdb-d5qzd"] Aug 04 15:14:15.735945 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:15.735926 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7bc85bdb-d5qzd"] Aug 04 15:14:16.782083 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:16.782052 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c67ba5-2678-451f-878b-75c4f8ebe5fe" path="/var/lib/kubelet/pods/34c67ba5-2678-451f-878b-75c4f8ebe5fe/volumes" Aug 04 15:14:50.668201 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.668165 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4b75876f-s6qxg"] Aug 04 15:14:50.668695 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.668477 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c67ba5-2678-451f-878b-75c4f8ebe5fe" containerName="console" Aug 04 15:14:50.668695 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.668488 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c67ba5-2678-451f-878b-75c4f8ebe5fe" containerName="console" Aug 04 15:14:50.668695 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.668533 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c67ba5-2678-451f-878b-75c4f8ebe5fe" containerName="console" Aug 04 15:14:50.671501 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.671485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.685789 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.685766 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4b75876f-s6qxg"] Aug 04 15:14:50.749809 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.749776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-config\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.749982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.749820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-serving-cert\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.749982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.749888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-oauth-serving-cert\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.749982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.749911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnzcg\" (UniqueName: \"kubernetes.io/projected/2f6a34e1-7a38-482b-8f92-076b59a87e76-kube-api-access-jnzcg\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.749982 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.749944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-oauth-config\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.750158 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.750014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-trusted-ca-bundle\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.750158 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.750039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-service-ca\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-trusted-ca-bundle\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-service-ca\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851288 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-config\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851288 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-serving-cert\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851288 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-oauth-serving-cert\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851288 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnzcg\" (UniqueName: \"kubernetes.io/projected/2f6a34e1-7a38-482b-8f92-076b59a87e76-kube-api-access-jnzcg\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851504 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-oauth-config\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851926 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851887 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-config\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.851926 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851887 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-service-ca\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.852116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.851936 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-oauth-serving-cert\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.852173 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.852136 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-trusted-ca-bundle\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.853690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.853671 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-serving-cert\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.853834 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.853806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-oauth-config\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.861118 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.861095 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnzcg\" (UniqueName: \"kubernetes.io/projected/2f6a34e1-7a38-482b-8f92-076b59a87e76-kube-api-access-jnzcg\") pod \"console-5b4b75876f-s6qxg\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:50.980957 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:50.980899 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:14:51.114406 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:51.114375 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4b75876f-s6qxg"] Aug 04 15:14:51.117377 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:14:51.117334 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6a34e1_7a38_482b_8f92_076b59a87e76.slice/crio-a4102c5b0591e3f26629c06c32dea3a7a2df96bdfcc10c6ef200151c7dbcd5a3 WatchSource:0}: Error finding container a4102c5b0591e3f26629c06c32dea3a7a2df96bdfcc10c6ef200151c7dbcd5a3: Status 404 returned error can't find the container with id a4102c5b0591e3f26629c06c32dea3a7a2df96bdfcc10c6ef200151c7dbcd5a3 Aug 04 15:14:51.824971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:51.824940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b75876f-s6qxg" event={"ID":"2f6a34e1-7a38-482b-8f92-076b59a87e76","Type":"ContainerStarted","Data":"4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6"} Aug 04 15:14:51.825335 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:51.824987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b75876f-s6qxg" event={"ID":"2f6a34e1-7a38-482b-8f92-076b59a87e76","Type":"ContainerStarted","Data":"a4102c5b0591e3f26629c06c32dea3a7a2df96bdfcc10c6ef200151c7dbcd5a3"} Aug 04 15:14:51.851711 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:14:51.851664 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4b75876f-s6qxg" podStartSLOduration=1.851649286 podStartE2EDuration="1.851649286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:14:51.849628343 +0000 UTC m=+221.620021585" watchObservedRunningTime="2026-08-04 15:14:51.851649286 +0000 UTC m=+221.622042519" Aug 04 15:15:00.981965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:00.981929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:15:00.982461 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:00.981979 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:15:00.986791 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:00.986769 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:15:01.865882 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:01.865856 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:15:01.955025 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:01.954997 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8c8df587-4bpsk"] Aug 04 15:15:26.976545 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:26.976490 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b8c8df587-4bpsk" podUID="d0cf95a1-6c82-4ee1-9447-a4c42f875e91" containerName="console" containerID="cri-o://37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc" gracePeriod=15 Aug 04 15:15:27.223871 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.223848 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:15:27.228031 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.227991 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-serving-cert\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228132 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-oauth-config\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228132 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228054 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mflq\" (UniqueName: \"kubernetes.io/projected/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-kube-api-access-2mflq\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228238 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228160 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-trusted-ca-bundle\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228238 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228192 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-oauth-serving-cert\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228238 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228218 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-config\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228427 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228251 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-service-ca\") pod \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\" (UID: \"d0cf95a1-6c82-4ee1-9447-a4c42f875e91\") " Aug 04 15:15:27.228922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228557 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:15:27.228922 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228592 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:15:27.229088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228972 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-config" (OuterVolumeSpecName: "console-config") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:15:27.229088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.228990 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:15:27.230212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.230192 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 15:15:27.230293 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.230235 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 15:15:27.230334 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.230310 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-kube-api-access-2mflq" (OuterVolumeSpecName: "kube-api-access-2mflq") pod "d0cf95a1-6c82-4ee1-9447-a4c42f875e91" (UID: "d0cf95a1-6c82-4ee1-9447-a4c42f875e91"). InnerVolumeSpecName "kube-api-access-2mflq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:15:27.329821 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329790 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-oauth-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.329821 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329816 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mflq\" (UniqueName: \"kubernetes.io/projected/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-kube-api-access-2mflq\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.329821 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329826 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-trusted-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.330015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329834 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-oauth-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.330015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329843 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.330015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329852 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-service-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.330015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.329859 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf95a1-6c82-4ee1-9447-a4c42f875e91-console-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:15:27.961303 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.961271 2562 generic.go:356] "Generic (PLEG): container finished" podID="d0cf95a1-6c82-4ee1-9447-a4c42f875e91" containerID="37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc" exitCode=0 Aug 04 15:15:27.961480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.961314 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c8df587-4bpsk" Aug 04 15:15:27.961480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.961358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c8df587-4bpsk" event={"ID":"d0cf95a1-6c82-4ee1-9447-a4c42f875e91","Type":"ContainerDied","Data":"37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc"} Aug 04 15:15:27.961480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.961398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c8df587-4bpsk" event={"ID":"d0cf95a1-6c82-4ee1-9447-a4c42f875e91","Type":"ContainerDied","Data":"1f8553e6fd62bfe8fb8a2b569c71f33fb992a725bbbd06f060a8ef681b4e6fa5"} Aug 04 15:15:27.961480 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.961418 2562 scope.go:117] "RemoveContainer" containerID="37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc" Aug 04 15:15:27.970252 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.970236 2562 scope.go:117] "RemoveContainer" containerID="37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc" Aug 04 15:15:27.970607 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:15:27.970590 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc\": container with ID starting with 37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc not found: ID does not exist" containerID="37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc" Aug 04 15:15:27.970666 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.970615 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc"} err="failed to get container status \"37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc\": rpc error: code = NotFound desc = could not find container \"37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc\": container with ID starting with 37c4a529a038d3d8b7db2a9754296d7d9bcc7132f4e944c051b7fa6460bcb3bc not found: ID does not exist" Aug 04 15:15:27.983700 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.983677 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8c8df587-4bpsk"] Aug 04 15:15:27.992709 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:27.992689 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b8c8df587-4bpsk"] Aug 04 15:15:28.783381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:28.783335 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0cf95a1-6c82-4ee1-9447-a4c42f875e91" path="/var/lib/kubelet/pods/d0cf95a1-6c82-4ee1-9447-a4c42f875e91/volumes" Aug 04 15:15:56.280062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.279986 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q"] Aug 04 15:15:56.280556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.280276 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0cf95a1-6c82-4ee1-9447-a4c42f875e91" containerName="console" Aug 04 15:15:56.280556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.280287 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0cf95a1-6c82-4ee1-9447-a4c42f875e91" containerName="console" Aug 04 15:15:56.280556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.280339 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0cf95a1-6c82-4ee1-9447-a4c42f875e91" containerName="console" Aug 04 15:15:56.283290 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.283275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.286117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.286087 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 04 15:15:56.286272 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.286126 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 04 15:15:56.287130 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.287110 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f5s65\"" Aug 04 15:15:56.294017 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.293996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q"] Aug 04 15:15:56.347844 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.347815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwtn\" (UniqueName: \"kubernetes.io/projected/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-kube-api-access-dkwtn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.347992 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.347851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.347992 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.347933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.448556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.448521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.448718 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.448565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwtn\" (UniqueName: \"kubernetes.io/projected/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-kube-api-access-dkwtn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.448718 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.448588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.448892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.448874 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.448938 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.448897 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.458438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.458416 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwtn\" (UniqueName: \"kubernetes.io/projected/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-kube-api-access-dkwtn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.592764 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.592743 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:15:56.725219 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:56.725185 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q"] Aug 04 15:15:56.727559 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:15:56.727533 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9882e4_67fc_4ead_8e8c_1b0b0d1de15f.slice/crio-bde3ea2e06e35e42a041cfe22e75047693c7d207ce37bd130085fe28176ebb56 WatchSource:0}: Error finding container bde3ea2e06e35e42a041cfe22e75047693c7d207ce37bd130085fe28176ebb56: Status 404 returned error can't find the container with id bde3ea2e06e35e42a041cfe22e75047693c7d207ce37bd130085fe28176ebb56 Aug 04 15:15:57.075675 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:15:57.075635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" event={"ID":"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f","Type":"ContainerStarted","Data":"bde3ea2e06e35e42a041cfe22e75047693c7d207ce37bd130085fe28176ebb56"} Aug 04 15:16:05.106662 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:05.106628 2562 generic.go:356] "Generic (PLEG): container finished" podID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerID="6e60ca2213048b80a38692b457a04e7c6e2f14c6763eb96118739b485e374f06" exitCode=0 Aug 04 15:16:05.107049 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:05.106703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" event={"ID":"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f","Type":"ContainerDied","Data":"6e60ca2213048b80a38692b457a04e7c6e2f14c6763eb96118739b485e374f06"} Aug 04 15:16:08.120979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:08.120945 2562 generic.go:356] "Generic (PLEG): container finished" podID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerID="d8c6d2236585e51e9183c8985acea1b9e45d935f5772c87887a0adac5739ee25" exitCode=0 Aug 04 15:16:08.121372 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:08.120991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" event={"ID":"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f","Type":"ContainerDied","Data":"d8c6d2236585e51e9183c8985acea1b9e45d935f5772c87887a0adac5739ee25"} Aug 04 15:16:10.627014 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:10.626989 2562 kubelet.go:1648] "Image garbage collection succeeded" Aug 04 15:16:15.151890 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:15.151857 2562 generic.go:356] "Generic (PLEG): container finished" podID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerID="67d2b17bc18b0ff3bc16c8740eab92e34e5f31be3fa4703242b331c4b9ce1197" exitCode=0 Aug 04 15:16:15.152284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:15.151956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" event={"ID":"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f","Type":"ContainerDied","Data":"67d2b17bc18b0ff3bc16c8740eab92e34e5f31be3fa4703242b331c4b9ce1197"} Aug 04 15:16:16.279310 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.279286 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:16:16.420641 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.420555 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkwtn\" (UniqueName: \"kubernetes.io/projected/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-kube-api-access-dkwtn\") pod \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " Aug 04 15:16:16.420641 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.420600 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-bundle\") pod \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " Aug 04 15:16:16.420641 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.420644 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-util\") pod \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\" (UID: \"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f\") " Aug 04 15:16:16.421265 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.421233 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-bundle" (OuterVolumeSpecName: "bundle") pod "af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" (UID: "af9882e4-67fc-4ead-8e8c-1b0b0d1de15f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:16:16.422897 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.422864 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-kube-api-access-dkwtn" (OuterVolumeSpecName: "kube-api-access-dkwtn") pod "af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" (UID: "af9882e4-67fc-4ead-8e8c-1b0b0d1de15f"). InnerVolumeSpecName "kube-api-access-dkwtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:16:16.425546 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.425525 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-util" (OuterVolumeSpecName: "util") pod "af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" (UID: "af9882e4-67fc-4ead-8e8c-1b0b0d1de15f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:16:16.522088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.522058 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkwtn\" (UniqueName: \"kubernetes.io/projected/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-kube-api-access-dkwtn\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:16.522088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.522082 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:16.522088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:16.522092 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af9882e4-67fc-4ead-8e8c-1b0b0d1de15f-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:17.161622 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:17.161546 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" Aug 04 15:16:17.161765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:17.161545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gg58q" event={"ID":"af9882e4-67fc-4ead-8e8c-1b0b0d1de15f","Type":"ContainerDied","Data":"bde3ea2e06e35e42a041cfe22e75047693c7d207ce37bd130085fe28176ebb56"} Aug 04 15:16:17.161765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:17.161666 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bde3ea2e06e35e42a041cfe22e75047693c7d207ce37bd130085fe28176ebb56" Aug 04 15:16:24.575753 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.575719 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6"] Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.575997 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="pull" Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.576008 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="pull" Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.576016 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="extract" Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.576021 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="extract" Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.576034 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="util" Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.576039 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="util" Aug 04 15:16:24.576121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.576089 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af9882e4-67fc-4ead-8e8c-1b0b0d1de15f" containerName="extract" Aug 04 15:16:24.579179 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.579164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.581949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.581927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8qvfj\"" Aug 04 15:16:24.582096 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.581974 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Aug 04 15:16:24.582096 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.582044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Aug 04 15:16:24.593885 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.593865 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6"] Aug 04 15:16:24.687694 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.687664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9876e1ca-4d37-43d8-a847-dc009a339a42-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qflx6\" (UID: \"9876e1ca-4d37-43d8-a847-dc009a339a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.687849 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.687701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqp5h\" (UniqueName: \"kubernetes.io/projected/9876e1ca-4d37-43d8-a847-dc009a339a42-kube-api-access-sqp5h\") pod \"cert-manager-operator-controller-manager-55c444bf86-qflx6\" (UID: \"9876e1ca-4d37-43d8-a847-dc009a339a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.788874 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.788844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9876e1ca-4d37-43d8-a847-dc009a339a42-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qflx6\" (UID: \"9876e1ca-4d37-43d8-a847-dc009a339a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.788874 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.788877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqp5h\" (UniqueName: \"kubernetes.io/projected/9876e1ca-4d37-43d8-a847-dc009a339a42-kube-api-access-sqp5h\") pod \"cert-manager-operator-controller-manager-55c444bf86-qflx6\" (UID: \"9876e1ca-4d37-43d8-a847-dc009a339a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.789188 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.789171 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9876e1ca-4d37-43d8-a847-dc009a339a42-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qflx6\" (UID: \"9876e1ca-4d37-43d8-a847-dc009a339a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.798111 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.798090 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqp5h\" (UniqueName: \"kubernetes.io/projected/9876e1ca-4d37-43d8-a847-dc009a339a42-kube-api-access-sqp5h\") pod \"cert-manager-operator-controller-manager-55c444bf86-qflx6\" (UID: \"9876e1ca-4d37-43d8-a847-dc009a339a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:24.888505 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:24.888423 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" Aug 04 15:16:25.023034 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:25.022996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6"] Aug 04 15:16:25.028533 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:16:25.028502 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9876e1ca_4d37_43d8_a847_dc009a339a42.slice/crio-6a8bf966b7fe3c5604aa694b396f588b505026422e03bb2bb680089d668dd478 WatchSource:0}: Error finding container 6a8bf966b7fe3c5604aa694b396f588b505026422e03bb2bb680089d668dd478: Status 404 returned error can't find the container with id 6a8bf966b7fe3c5604aa694b396f588b505026422e03bb2bb680089d668dd478 Aug 04 15:16:25.030722 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:25.030706 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 15:16:25.191950 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:25.191869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" event={"ID":"9876e1ca-4d37-43d8-a847-dc009a339a42","Type":"ContainerStarted","Data":"6a8bf966b7fe3c5604aa694b396f588b505026422e03bb2bb680089d668dd478"} Aug 04 15:16:27.203847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:27.203789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" event={"ID":"9876e1ca-4d37-43d8-a847-dc009a339a42","Type":"ContainerStarted","Data":"5927231035bee424d686750a0b6c007b16557a718c61db6711a1922b32e70dea"} Aug 04 15:16:27.227992 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:27.227934 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qflx6" podStartSLOduration=1.687229929 podStartE2EDuration="3.227915022s" totalImagesPullingTime="1.540685093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:27.224908568 +0000 UTC m=+316.995301812" watchObservedRunningTime="2026-08-04 15:16:27.227915022 +0000 UTC m=+316.998308256" Aug 04 15:16:28.621399 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.621357 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh"] Aug 04 15:16:28.624893 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.624869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.627755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.627733 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 04 15:16:28.628831 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.628815 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 04 15:16:28.628904 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.628888 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f5s65\"" Aug 04 15:16:28.637060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.637042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh"] Aug 04 15:16:28.650298 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.650275 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pdzvf"] Aug 04 15:16:28.653643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.653627 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.656438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.656409 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-74xfs\"" Aug 04 15:16:28.657091 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.657072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 04 15:16:28.657174 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.657105 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 04 15:16:28.664555 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.664536 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pdzvf"] Aug 04 15:16:28.718860 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.718827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkqf\" (UniqueName: \"kubernetes.io/projected/12107108-eb49-44d8-bbcd-de64e558f489-kube-api-access-lwkqf\") pod \"cert-manager-webhook-6486ffd997-pdzvf\" (UID: \"12107108-eb49-44d8-bbcd-de64e558f489\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.718860 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.718863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.719050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.718883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.719050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.718932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12107108-eb49-44d8-bbcd-de64e558f489-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pdzvf\" (UID: \"12107108-eb49-44d8-bbcd-de64e558f489\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.719050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.719013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xw6c\" (UniqueName: \"kubernetes.io/projected/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-kube-api-access-7xw6c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.819586 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.819554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkqf\" (UniqueName: \"kubernetes.io/projected/12107108-eb49-44d8-bbcd-de64e558f489-kube-api-access-lwkqf\") pod \"cert-manager-webhook-6486ffd997-pdzvf\" (UID: \"12107108-eb49-44d8-bbcd-de64e558f489\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.819996 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.819970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.820198 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.820172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.820311 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.820236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12107108-eb49-44d8-bbcd-de64e558f489-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pdzvf\" (UID: \"12107108-eb49-44d8-bbcd-de64e558f489\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.820311 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.820293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xw6c\" (UniqueName: \"kubernetes.io/projected/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-kube-api-access-7xw6c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.820830 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.820807 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.821213 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.821191 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.830060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.830031 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12107108-eb49-44d8-bbcd-de64e558f489-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pdzvf\" (UID: \"12107108-eb49-44d8-bbcd-de64e558f489\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.830144 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.830130 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xw6c\" (UniqueName: \"kubernetes.io/projected/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-kube-api-access-7xw6c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.830183 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.830165 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkqf\" (UniqueName: \"kubernetes.io/projected/12107108-eb49-44d8-bbcd-de64e558f489-kube-api-access-lwkqf\") pod \"cert-manager-webhook-6486ffd997-pdzvf\" (UID: \"12107108-eb49-44d8-bbcd-de64e558f489\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:28.934504 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.934428 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:28.971608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:28.971580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:29.081310 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:29.081283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh"] Aug 04 15:16:29.083608 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:16:29.083581 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773c8c9e_ce91_4f3e_ba33_fe0cf2d24884.slice/crio-82844a077f2afe33a67148c3e09fda62712686e0f765f33c82985f4c77a1ec0e WatchSource:0}: Error finding container 82844a077f2afe33a67148c3e09fda62712686e0f765f33c82985f4c77a1ec0e: Status 404 returned error can't find the container with id 82844a077f2afe33a67148c3e09fda62712686e0f765f33c82985f4c77a1ec0e Aug 04 15:16:29.119507 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:29.119486 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pdzvf"] Aug 04 15:16:29.123523 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:16:29.123500 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12107108_eb49_44d8_bbcd_de64e558f489.slice/crio-7b265389f762f2dc646687ea2e4e7bcbc7ad75a5f8e2459e1175303faf9586d5 WatchSource:0}: Error finding container 7b265389f762f2dc646687ea2e4e7bcbc7ad75a5f8e2459e1175303faf9586d5: Status 404 returned error can't find the container with id 7b265389f762f2dc646687ea2e4e7bcbc7ad75a5f8e2459e1175303faf9586d5 Aug 04 15:16:29.212271 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:29.212243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" event={"ID":"12107108-eb49-44d8-bbcd-de64e558f489","Type":"ContainerStarted","Data":"7b265389f762f2dc646687ea2e4e7bcbc7ad75a5f8e2459e1175303faf9586d5"} Aug 04 15:16:29.213605 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:29.213581 2562 generic.go:356] "Generic (PLEG): container finished" podID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerID="8a29941972feb7ac8741a10b262a2c21d9f3eb897cf1fb9468b0ca6c25a59cc6" exitCode=0 Aug 04 15:16:29.213712 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:29.213661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" event={"ID":"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884","Type":"ContainerDied","Data":"8a29941972feb7ac8741a10b262a2c21d9f3eb897cf1fb9468b0ca6c25a59cc6"} Aug 04 15:16:29.213767 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:29.213711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" event={"ID":"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884","Type":"ContainerStarted","Data":"82844a077f2afe33a67148c3e09fda62712686e0f765f33c82985f4c77a1ec0e"} Aug 04 15:16:32.229916 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:32.229867 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" event={"ID":"12107108-eb49-44d8-bbcd-de64e558f489","Type":"ContainerStarted","Data":"bdf9353b1d2a4cab4d39dcbaaae423b45a7d12753ddd9982e13e4bfa1f76aaac"} Aug 04 15:16:32.230331 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:32.229932 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:32.248497 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:32.248441 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" podStartSLOduration=1.302444893 podStartE2EDuration="4.248424143s" totalImagesPullingTime="2.94597925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:32.247289798 +0000 UTC m=+322.017683029" watchObservedRunningTime="2026-08-04 15:16:32.248424143 +0000 UTC m=+322.018817375" Aug 04 15:16:33.235614 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:33.235582 2562 generic.go:356] "Generic (PLEG): container finished" podID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerID="c60201ee79a72ebfd9ec49f990e44c74d4932c658bd5d7cc7aae404655e05ef7" exitCode=0 Aug 04 15:16:33.236061 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:33.235665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" event={"ID":"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884","Type":"ContainerDied","Data":"c60201ee79a72ebfd9ec49f990e44c74d4932c658bd5d7cc7aae404655e05ef7"} Aug 04 15:16:34.241743 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:34.241714 2562 generic.go:356] "Generic (PLEG): container finished" podID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerID="9599f3ecb3db38f86092c5e790b683eee079bcbdb9dc2759ddf6c0f762dd21d7" exitCode=0 Aug 04 15:16:34.242120 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:34.241770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" event={"ID":"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884","Type":"ContainerDied","Data":"9599f3ecb3db38f86092c5e790b683eee079bcbdb9dc2759ddf6c0f762dd21d7"} Aug 04 15:16:35.388808 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.388781 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:35.474221 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.474196 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-util\") pod \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " Aug 04 15:16:35.474415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.474245 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xw6c\" (UniqueName: \"kubernetes.io/projected/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-kube-api-access-7xw6c\") pod \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " Aug 04 15:16:35.474415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.474272 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-bundle\") pod \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\" (UID: \"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884\") " Aug 04 15:16:35.474702 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.474666 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-bundle" (OuterVolumeSpecName: "bundle") pod "773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" (UID: "773c8c9e-ce91-4f3e-ba33-fe0cf2d24884"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:16:35.476443 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.476413 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-kube-api-access-7xw6c" (OuterVolumeSpecName: "kube-api-access-7xw6c") pod "773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" (UID: "773c8c9e-ce91-4f3e-ba33-fe0cf2d24884"). InnerVolumeSpecName "kube-api-access-7xw6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:16:35.479167 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.479141 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-util" (OuterVolumeSpecName: "util") pod "773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" (UID: "773c8c9e-ce91-4f3e-ba33-fe0cf2d24884"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:16:35.575395 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.575363 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:35.575395 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.575391 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xw6c\" (UniqueName: \"kubernetes.io/projected/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-kube-api-access-7xw6c\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:35.575555 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:35.575406 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/773c8c9e-ce91-4f3e-ba33-fe0cf2d24884-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:36.251841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:36.251795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" event={"ID":"773c8c9e-ce91-4f3e-ba33-fe0cf2d24884","Type":"ContainerDied","Data":"82844a077f2afe33a67148c3e09fda62712686e0f765f33c82985f4c77a1ec0e"} Aug 04 15:16:36.251841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:36.251835 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnsdhh" Aug 04 15:16:36.252044 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:36.251855 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82844a077f2afe33a67148c3e09fda62712686e0f765f33c82985f4c77a1ec0e" Aug 04 15:16:38.238026 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:38.237990 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pdzvf" Aug 04 15:16:39.011217 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011187 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9fqvx"] Aug 04 15:16:39.011576 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011557 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="pull" Aug 04 15:16:39.011670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011578 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="pull" Aug 04 15:16:39.011670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011605 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="extract" Aug 04 15:16:39.011670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011614 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="extract" Aug 04 15:16:39.011670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011642 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="util" Aug 04 15:16:39.011670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011650 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="util" Aug 04 15:16:39.011907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.011722 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="773c8c9e-ce91-4f3e-ba33-fe0cf2d24884" containerName="extract" Aug 04 15:16:39.014803 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.014783 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.017441 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.017423 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vpgkn\"" Aug 04 15:16:39.024478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.024458 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9fqvx"] Aug 04 15:16:39.101026 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.100995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36e23f99-2498-4cde-9014-989f37c4498e-bound-sa-token\") pod \"cert-manager-55b4d954d5-9fqvx\" (UID: \"36e23f99-2498-4cde-9014-989f37c4498e\") " pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.101149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.101038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmkq\" (UniqueName: \"kubernetes.io/projected/36e23f99-2498-4cde-9014-989f37c4498e-kube-api-access-vsmkq\") pod \"cert-manager-55b4d954d5-9fqvx\" (UID: \"36e23f99-2498-4cde-9014-989f37c4498e\") " pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.202326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.202288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36e23f99-2498-4cde-9014-989f37c4498e-bound-sa-token\") pod \"cert-manager-55b4d954d5-9fqvx\" (UID: \"36e23f99-2498-4cde-9014-989f37c4498e\") " pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.202479 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.202341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmkq\" (UniqueName: \"kubernetes.io/projected/36e23f99-2498-4cde-9014-989f37c4498e-kube-api-access-vsmkq\") pod \"cert-manager-55b4d954d5-9fqvx\" (UID: \"36e23f99-2498-4cde-9014-989f37c4498e\") " pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.211094 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.211065 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36e23f99-2498-4cde-9014-989f37c4498e-bound-sa-token\") pod \"cert-manager-55b4d954d5-9fqvx\" (UID: \"36e23f99-2498-4cde-9014-989f37c4498e\") " pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.211191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.211120 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmkq\" (UniqueName: \"kubernetes.io/projected/36e23f99-2498-4cde-9014-989f37c4498e-kube-api-access-vsmkq\") pod \"cert-manager-55b4d954d5-9fqvx\" (UID: \"36e23f99-2498-4cde-9014-989f37c4498e\") " pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.323314 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.323283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9fqvx" Aug 04 15:16:39.450856 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:39.450829 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9fqvx"] Aug 04 15:16:39.453518 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:16:39.453487 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36e23f99_2498_4cde_9014_989f37c4498e.slice/crio-423c0718517b4f1ea20ee31839cf345a3f45b3d61870f31227acff1efd6ca890 WatchSource:0}: Error finding container 423c0718517b4f1ea20ee31839cf345a3f45b3d61870f31227acff1efd6ca890: Status 404 returned error can't find the container with id 423c0718517b4f1ea20ee31839cf345a3f45b3d61870f31227acff1efd6ca890 Aug 04 15:16:40.269328 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:40.269293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9fqvx" event={"ID":"36e23f99-2498-4cde-9014-989f37c4498e","Type":"ContainerStarted","Data":"2fb2e0e4644b5ca8fe5e10663d1b1d4a4a25bae6770852093ab90c837bfdfda5"} Aug 04 15:16:40.269497 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:40.269334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9fqvx" event={"ID":"36e23f99-2498-4cde-9014-989f37c4498e","Type":"ContainerStarted","Data":"423c0718517b4f1ea20ee31839cf345a3f45b3d61870f31227acff1efd6ca890"} Aug 04 15:16:40.287003 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:40.286955 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9fqvx" podStartSLOduration=2.286941005 podStartE2EDuration="2.286941005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:40.285999806 +0000 UTC m=+330.056393039" watchObservedRunningTime="2026-08-04 15:16:40.286941005 +0000 UTC m=+330.057334236" Aug 04 15:16:46.783825 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.783792 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6"] Aug 04 15:16:46.786036 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.786019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:46.789058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.789036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Aug 04 15:16:46.789058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.789036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Aug 04 15:16:46.790249 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.790234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-894sh\"" Aug 04 15:16:46.795703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.795682 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6"] Aug 04 15:16:46.865661 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.865633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7885623f-422d-481b-b2c3-464ea17acf1f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8rmp6\" (UID: \"7885623f-422d-481b-b2c3-464ea17acf1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:46.865813 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.865675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dvzs\" (UniqueName: \"kubernetes.io/projected/7885623f-422d-481b-b2c3-464ea17acf1f-kube-api-access-6dvzs\") pod \"openshift-lws-operator-fd8ccff4c-8rmp6\" (UID: \"7885623f-422d-481b-b2c3-464ea17acf1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:46.967041 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.967011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7885623f-422d-481b-b2c3-464ea17acf1f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8rmp6\" (UID: \"7885623f-422d-481b-b2c3-464ea17acf1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:46.967168 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.967050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dvzs\" (UniqueName: \"kubernetes.io/projected/7885623f-422d-481b-b2c3-464ea17acf1f-kube-api-access-6dvzs\") pod \"openshift-lws-operator-fd8ccff4c-8rmp6\" (UID: \"7885623f-422d-481b-b2c3-464ea17acf1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:46.967488 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.967470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7885623f-422d-481b-b2c3-464ea17acf1f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8rmp6\" (UID: \"7885623f-422d-481b-b2c3-464ea17acf1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:46.975953 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:46.975931 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dvzs\" (UniqueName: \"kubernetes.io/projected/7885623f-422d-481b-b2c3-464ea17acf1f-kube-api-access-6dvzs\") pod \"openshift-lws-operator-fd8ccff4c-8rmp6\" (UID: \"7885623f-422d-481b-b2c3-464ea17acf1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:47.095649 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:47.095622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" Aug 04 15:16:47.225130 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:47.225108 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6"] Aug 04 15:16:47.227601 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:16:47.227566 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7885623f_422d_481b_b2c3_464ea17acf1f.slice/crio-7ab88df2af986989cab0f4499fb95b3ee04c83fb21423e813b9d3097fcc93181 WatchSource:0}: Error finding container 7ab88df2af986989cab0f4499fb95b3ee04c83fb21423e813b9d3097fcc93181: Status 404 returned error can't find the container with id 7ab88df2af986989cab0f4499fb95b3ee04c83fb21423e813b9d3097fcc93181 Aug 04 15:16:47.301491 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:47.301459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" event={"ID":"7885623f-422d-481b-b2c3-464ea17acf1f","Type":"ContainerStarted","Data":"7ab88df2af986989cab0f4499fb95b3ee04c83fb21423e813b9d3097fcc93181"} Aug 04 15:16:49.314617 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:49.314584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" event={"ID":"7885623f-422d-481b-b2c3-464ea17acf1f","Type":"ContainerStarted","Data":"207c76294a370c0570e9f253331d5cdc13008de2d187dea7ee2e4780d77a38d5"} Aug 04 15:16:49.336696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:49.336642 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8rmp6" podStartSLOduration=1.575996014 podStartE2EDuration="3.336623355s" totalImagesPullingTime="1.760627341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:49.336519242 +0000 UTC m=+339.106912474" watchObservedRunningTime="2026-08-04 15:16:49.336623355 +0000 UTC m=+339.107016588" Aug 04 15:16:51.858175 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.858143 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg"] Aug 04 15:16:51.860569 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.860553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:51.863580 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.863560 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 04 15:16:51.863580 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.863572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f5s65\"" Aug 04 15:16:51.864862 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.864841 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 04 15:16:51.871153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.871132 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg"] Aug 04 15:16:51.906433 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.906403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:51.906556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.906491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgd4d\" (UniqueName: \"kubernetes.io/projected/a867cbf7-14f8-451e-84b6-42cf0140e7cc-kube-api-access-bgd4d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:51.906556 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:51.906535 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.007138 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.007100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.007326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.007172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgd4d\" (UniqueName: \"kubernetes.io/projected/a867cbf7-14f8-451e-84b6-42cf0140e7cc-kube-api-access-bgd4d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.007326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.007200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.007581 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.007559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.007581 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.007573 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.016181 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.016160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgd4d\" (UniqueName: \"kubernetes.io/projected/a867cbf7-14f8-451e-84b6-42cf0140e7cc-kube-api-access-bgd4d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.170398 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.170293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:52.300509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.300487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg"] Aug 04 15:16:52.302871 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:16:52.302842 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda867cbf7_14f8_451e_84b6_42cf0140e7cc.slice/crio-9b836a976c66841f4ac264f3ff84323262e3fd630b330f341847734f8450b175 WatchSource:0}: Error finding container 9b836a976c66841f4ac264f3ff84323262e3fd630b330f341847734f8450b175: Status 404 returned error can't find the container with id 9b836a976c66841f4ac264f3ff84323262e3fd630b330f341847734f8450b175 Aug 04 15:16:52.329653 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:52.329624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" event={"ID":"a867cbf7-14f8-451e-84b6-42cf0140e7cc","Type":"ContainerStarted","Data":"9b836a976c66841f4ac264f3ff84323262e3fd630b330f341847734f8450b175"} Aug 04 15:16:53.335139 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:53.335106 2562 generic.go:356] "Generic (PLEG): container finished" podID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerID="5fb9262f5cd30969e806d0e7aa51e6041a541f58e0dc00d556d8c313c6dfa2da" exitCode=0 Aug 04 15:16:53.335500 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:53.335149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" event={"ID":"a867cbf7-14f8-451e-84b6-42cf0140e7cc","Type":"ContainerDied","Data":"5fb9262f5cd30969e806d0e7aa51e6041a541f58e0dc00d556d8c313c6dfa2da"} Aug 04 15:16:56.350018 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:56.349974 2562 generic.go:356] "Generic (PLEG): container finished" podID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerID="84f993265977ae6e58c942f045b5a8c26c15bedac5ab08b2ddeefad920c32578" exitCode=0 Aug 04 15:16:56.350488 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:56.350067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" event={"ID":"a867cbf7-14f8-451e-84b6-42cf0140e7cc","Type":"ContainerDied","Data":"84f993265977ae6e58c942f045b5a8c26c15bedac5ab08b2ddeefad920c32578"} Aug 04 15:16:57.356570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:57.356533 2562 generic.go:356] "Generic (PLEG): container finished" podID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerID="73bd38b9aae292349abdfa72fc320a189e1500a604230db76b45e380ce3a4a47" exitCode=0 Aug 04 15:16:57.356570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:57.356573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" event={"ID":"a867cbf7-14f8-451e-84b6-42cf0140e7cc","Type":"ContainerDied","Data":"73bd38b9aae292349abdfa72fc320a189e1500a604230db76b45e380ce3a4a47"} Aug 04 15:16:58.483300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.483270 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:58.559949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.559918 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-util\") pod \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " Aug 04 15:16:58.560123 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.559966 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-bundle\") pod \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " Aug 04 15:16:58.560123 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.559984 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgd4d\" (UniqueName: \"kubernetes.io/projected/a867cbf7-14f8-451e-84b6-42cf0140e7cc-kube-api-access-bgd4d\") pod \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\" (UID: \"a867cbf7-14f8-451e-84b6-42cf0140e7cc\") " Aug 04 15:16:58.560640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.560616 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-bundle" (OuterVolumeSpecName: "bundle") pod "a867cbf7-14f8-451e-84b6-42cf0140e7cc" (UID: "a867cbf7-14f8-451e-84b6-42cf0140e7cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:16:58.562099 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.562074 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a867cbf7-14f8-451e-84b6-42cf0140e7cc-kube-api-access-bgd4d" (OuterVolumeSpecName: "kube-api-access-bgd4d") pod "a867cbf7-14f8-451e-84b6-42cf0140e7cc" (UID: "a867cbf7-14f8-451e-84b6-42cf0140e7cc"). InnerVolumeSpecName "kube-api-access-bgd4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:16:58.564586 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.564562 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-util" (OuterVolumeSpecName: "util") pod "a867cbf7-14f8-451e-84b6-42cf0140e7cc" (UID: "a867cbf7-14f8-451e-84b6-42cf0140e7cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:16:58.661169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.661103 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:58.661169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.661130 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgd4d\" (UniqueName: \"kubernetes.io/projected/a867cbf7-14f8-451e-84b6-42cf0140e7cc-kube-api-access-bgd4d\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:58.661169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:58.661140 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a867cbf7-14f8-451e-84b6-42cf0140e7cc-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:16:59.367209 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:59.367174 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" event={"ID":"a867cbf7-14f8-451e-84b6-42cf0140e7cc","Type":"ContainerDied","Data":"9b836a976c66841f4ac264f3ff84323262e3fd630b330f341847734f8450b175"} Aug 04 15:16:59.367209 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:59.367205 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpxhjg" Aug 04 15:16:59.367444 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:16:59.367230 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b836a976c66841f4ac264f3ff84323262e3fd630b330f341847734f8450b175" Aug 04 15:17:04.224767 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.224732 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw"] Aug 04 15:17:04.225129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225032 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="pull" Aug 04 15:17:04.225129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225046 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="pull" Aug 04 15:17:04.225129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225071 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="extract" Aug 04 15:17:04.225129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225080 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="extract" Aug 04 15:17:04.225129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225099 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="util" Aug 04 15:17:04.225129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225105 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="util" Aug 04 15:17:04.225387 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.225184 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a867cbf7-14f8-451e-84b6-42cf0140e7cc" containerName="extract" Aug 04 15:17:04.229294 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.229275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.235115 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.235091 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jm652\"" Aug 04 15:17:04.235253 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.235099 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Aug 04 15:17:04.235327 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.235121 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Aug 04 15:17:04.235327 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.235126 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Aug 04 15:17:04.244204 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.244181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw"] Aug 04 15:17:04.309726 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.309698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l564s\" (UniqueName: \"kubernetes.io/projected/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-kube-api-access-l564s\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.309850 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.309744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-cert\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.309850 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.309768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-metrics-cert\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.309927 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.309870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-manager-config\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.410399 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.410370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-manager-config\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.410522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.410415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l564s\" (UniqueName: \"kubernetes.io/projected/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-kube-api-access-l564s\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.410522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.410455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-cert\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.410522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.410478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-metrics-cert\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.411066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.411039 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-manager-config\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.413114 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.413090 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-cert\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.413205 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.413160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-metrics-cert\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.434784 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.434763 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l564s\" (UniqueName: \"kubernetes.io/projected/9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c-kube-api-access-l564s\") pod \"lws-controller-manager-59d7b7db79-vdjmw\" (UID: \"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c\") " pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.539257 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.539226 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:04.670621 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:04.670595 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw"] Aug 04 15:17:04.672227 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:17:04.672202 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1f9d5e_91de_4fb9_9ea2_fe0a5d46925c.slice/crio-45ae1bcdd72af8fa78ad8cb24c740ef843cebaa2b33618485b11339479ae8e2e WatchSource:0}: Error finding container 45ae1bcdd72af8fa78ad8cb24c740ef843cebaa2b33618485b11339479ae8e2e: Status 404 returned error can't find the container with id 45ae1bcdd72af8fa78ad8cb24c740ef843cebaa2b33618485b11339479ae8e2e Aug 04 15:17:05.394841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.394804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" event={"ID":"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c","Type":"ContainerStarted","Data":"45ae1bcdd72af8fa78ad8cb24c740ef843cebaa2b33618485b11339479ae8e2e"} Aug 04 15:17:05.608058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.608019 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq"] Aug 04 15:17:05.611005 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.610989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.616841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.614062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 04 15:17:05.616841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.614306 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 04 15:17:05.616841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.614542 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 04 15:17:05.616841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.614770 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 04 15:17:05.616841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.614972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fjn9c\"" Aug 04 15:17:05.627510 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.627488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq"] Aug 04 15:17:05.721242 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.721148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdd8d\" (UniqueName: \"kubernetes.io/projected/122b47bc-a5b7-4bfe-87e4-ccb58b729689-kube-api-access-gdd8d\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.721242 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.721200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/122b47bc-a5b7-4bfe-87e4-ccb58b729689-manifests\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.721502 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.721248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/122b47bc-a5b7-4bfe-87e4-ccb58b729689-webhook-cert\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.721502 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.721276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/122b47bc-a5b7-4bfe-87e4-ccb58b729689-tmp\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.721502 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.721306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/122b47bc-a5b7-4bfe-87e4-ccb58b729689-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.822322 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.822274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/122b47bc-a5b7-4bfe-87e4-ccb58b729689-manifests\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.822509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.822372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/122b47bc-a5b7-4bfe-87e4-ccb58b729689-webhook-cert\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.822509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.822404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/122b47bc-a5b7-4bfe-87e4-ccb58b729689-tmp\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.822509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.822437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/122b47bc-a5b7-4bfe-87e4-ccb58b729689-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.822689 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.822516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdd8d\" (UniqueName: \"kubernetes.io/projected/122b47bc-a5b7-4bfe-87e4-ccb58b729689-kube-api-access-gdd8d\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.822755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.822729 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/122b47bc-a5b7-4bfe-87e4-ccb58b729689-manifests\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.824824 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.824797 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/122b47bc-a5b7-4bfe-87e4-ccb58b729689-tmp\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.824933 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.824916 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/122b47bc-a5b7-4bfe-87e4-ccb58b729689-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.824993 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.824928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/122b47bc-a5b7-4bfe-87e4-ccb58b729689-webhook-cert\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.832176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.832157 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdd8d\" (UniqueName: \"kubernetes.io/projected/122b47bc-a5b7-4bfe-87e4-ccb58b729689-kube-api-access-gdd8d\") pod \"opendatahub-operator-controller-manager-77c9c696b6-sgmrq\" (UID: \"122b47bc-a5b7-4bfe-87e4-ccb58b729689\") " pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:05.927627 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:05.927588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:06.100927 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:17:06.100893 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122b47bc_a5b7_4bfe_87e4_ccb58b729689.slice/crio-ff03f976fb449b4c5eed14d3177de4056c3c102c779b7c49313a2c078a10a13b WatchSource:0}: Error finding container ff03f976fb449b4c5eed14d3177de4056c3c102c779b7c49313a2c078a10a13b: Status 404 returned error can't find the container with id ff03f976fb449b4c5eed14d3177de4056c3c102c779b7c49313a2c078a10a13b Aug 04 15:17:06.106688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:06.106660 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq"] Aug 04 15:17:06.401079 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:06.401048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" event={"ID":"122b47bc-a5b7-4bfe-87e4-ccb58b729689","Type":"ContainerStarted","Data":"ff03f976fb449b4c5eed14d3177de4056c3c102c779b7c49313a2c078a10a13b"} Aug 04 15:17:07.408172 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:07.408134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" event={"ID":"9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c","Type":"ContainerStarted","Data":"a8d7219ad4fa36f0ce2c690e59efacd341b8aeab8961c1f738c60b9a32b463f6"} Aug 04 15:17:07.408638 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:07.408233 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:07.429165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:07.429105 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" podStartSLOduration=1.443446694 podStartE2EDuration="3.429085239s" totalImagesPullingTime="1.985638545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:07.426565909 +0000 UTC m=+357.196959141" watchObservedRunningTime="2026-08-04 15:17:07.429085239 +0000 UTC m=+357.199478471" Aug 04 15:17:11.428702 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:11.428658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" event={"ID":"122b47bc-a5b7-4bfe-87e4-ccb58b729689","Type":"ContainerStarted","Data":"deb2b9d6046647b4f05d55068b1ac8bc86358b116d1f4cebfd4a4c33d34d3208"} Aug 04 15:17:12.435047 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:12.435012 2562 generic.go:356] "Generic (PLEG): container finished" podID="122b47bc-a5b7-4bfe-87e4-ccb58b729689" containerID="deb2b9d6046647b4f05d55068b1ac8bc86358b116d1f4cebfd4a4c33d34d3208" exitCode=0 Aug 04 15:17:12.435543 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:12.435099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" event={"ID":"122b47bc-a5b7-4bfe-87e4-ccb58b729689","Type":"ContainerDied","Data":"deb2b9d6046647b4f05d55068b1ac8bc86358b116d1f4cebfd4a4c33d34d3208"} Aug 04 15:17:13.441496 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:13.441458 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" event={"ID":"122b47bc-a5b7-4bfe-87e4-ccb58b729689","Type":"ContainerStarted","Data":"7b7f253ca61aa46d70a9f8fc889162b4a233e838b7d5b32a4af47fed7b7d92a3"} Aug 04 15:17:13.441964 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:13.441589 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:13.466249 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:13.466197 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" podStartSLOduration=2.621592949 podStartE2EDuration="8.466182368s" totalImagesPullingTime="4.767634391s" totalInitContainerRuntime="1.076955028s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:13.465340167 +0000 UTC m=+363.235733410" watchObservedRunningTime="2026-08-04 15:17:13.466182368 +0000 UTC m=+363.236575600" Aug 04 15:17:18.415967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:18.415934 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59d7b7db79-vdjmw" Aug 04 15:17:24.447598 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:24.447573 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77c9c696b6-sgmrq" Aug 04 15:17:37.724220 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.724188 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p"] Aug 04 15:17:37.727549 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.727534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.730782 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.730754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 04 15:17:37.730911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.730856 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 04 15:17:37.730981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.730916 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ng5lw\"" Aug 04 15:17:37.731357 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.731326 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 04 15:17:37.746052 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.746028 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p"] Aug 04 15:17:37.755060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.755033 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq"] Aug 04 15:17:37.758108 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.758094 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.760667 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.760648 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8qn28\"" Aug 04 15:17:37.760757 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.760747 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Aug 04 15:17:37.760757 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.760753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Aug 04 15:17:37.760965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.760950 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Aug 04 15:17:37.768617 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.768706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.768706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.768706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8qt\" (UniqueName: \"kubernetes.io/projected/29a68da1-e28e-4750-9cd8-db25b4309c0a-kube-api-access-ld8qt\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.768836 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.768836 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.768836 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.768836 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.768977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.768977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.768977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f00bee8-00b5-4839-80b7-f497b2e48126-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.768977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.768977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.769125 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.768981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.769125 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.769013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qvl\" (UniqueName: \"kubernetes.io/projected/6f00bee8-00b5-4839-80b7-f497b2e48126-kube-api-access-n6qvl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.769125 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.769037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29a68da1-e28e-4750-9cd8-db25b4309c0a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.779572 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.779550 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq"] Aug 04 15:17:37.870087 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870087 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8qt\" (UniqueName: \"kubernetes.io/projected/29a68da1-e28e-4750-9cd8-db25b4309c0a-kube-api-access-ld8qt\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f00bee8-00b5-4839-80b7-f497b2e48126-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qvl\" (UniqueName: \"kubernetes.io/projected/6f00bee8-00b5-4839-80b7-f497b2e48126-kube-api-access-n6qvl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29a68da1-e28e-4750-9cd8-db25b4309c0a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.870912 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.870846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.871278 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.871118 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.871278 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.871163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f00bee8-00b5-4839-80b7-f497b2e48126-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.871599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.871403 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.871599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.871555 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.873423 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.873379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.873969 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.873848 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.873969 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.873872 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.873969 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.873925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29a68da1-e28e-4750-9cd8-db25b4309c0a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.873969 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.873931 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29a68da1-e28e-4750-9cd8-db25b4309c0a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.874221 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.874174 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.883191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.883160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8qt\" (UniqueName: \"kubernetes.io/projected/29a68da1-e28e-4750-9cd8-db25b4309c0a-kube-api-access-ld8qt\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:37.883279 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.883168 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f00bee8-00b5-4839-80b7-f497b2e48126-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.884755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.884732 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qvl\" (UniqueName: \"kubernetes.io/projected/6f00bee8-00b5-4839-80b7-f497b2e48126-kube-api-access-n6qvl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p\" (UID: \"6f00bee8-00b5-4839-80b7-f497b2e48126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:37.887623 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:37.887597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29a68da1-e28e-4750-9cd8-db25b4309c0a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-px6pq\" (UID: \"29a68da1-e28e-4750-9cd8-db25b4309c0a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:38.036849 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:38.036817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:38.067337 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:38.067306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:38.189006 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:38.188980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p"] Aug 04 15:17:38.191547 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:17:38.191512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f00bee8_00b5_4839_80b7_f497b2e48126.slice/crio-746e84b7eed507dc6659c19ae6a35149a27f9c58bfab4b8329660cf7aff5396e WatchSource:0}: Error finding container 746e84b7eed507dc6659c19ae6a35149a27f9c58bfab4b8329660cf7aff5396e: Status 404 returned error can't find the container with id 746e84b7eed507dc6659c19ae6a35149a27f9c58bfab4b8329660cf7aff5396e Aug 04 15:17:38.213170 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:38.213144 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq"] Aug 04 15:17:38.217519 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:17:38.217494 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a68da1_e28e_4750_9cd8_db25b4309c0a.slice/crio-1d96b0d82419ceb336cdaac101a9b2f4e4d74dffb803cfc9a953c4e2658869c4 WatchSource:0}: Error finding container 1d96b0d82419ceb336cdaac101a9b2f4e4d74dffb803cfc9a953c4e2658869c4: Status 404 returned error can't find the container with id 1d96b0d82419ceb336cdaac101a9b2f4e4d74dffb803cfc9a953c4e2658869c4 Aug 04 15:17:38.566695 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:38.566658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" event={"ID":"29a68da1-e28e-4750-9cd8-db25b4309c0a","Type":"ContainerStarted","Data":"1d96b0d82419ceb336cdaac101a9b2f4e4d74dffb803cfc9a953c4e2658869c4"} Aug 04 15:17:38.567908 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:38.567881 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" event={"ID":"6f00bee8-00b5-4839-80b7-f497b2e48126","Type":"ContainerStarted","Data":"746e84b7eed507dc6659c19ae6a35149a27f9c58bfab4b8329660cf7aff5396e"} Aug 04 15:17:42.114438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.114379 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:17:42.114751 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.114479 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:17:42.117638 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.117610 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:17:42.117739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.117674 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:17:42.117739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.117702 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:17:42.595425 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.595339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" event={"ID":"6f00bee8-00b5-4839-80b7-f497b2e48126","Type":"ContainerStarted","Data":"ffeef0b242d616606ce74f09024bb268a8c33212a39c9a1bbb92969211eee16d"} Aug 04 15:17:42.597112 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.597086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" event={"ID":"29a68da1-e28e-4750-9cd8-db25b4309c0a","Type":"ContainerStarted","Data":"f7e605232ae87e9160bed47468b35c93f3952ff41411b88acf2067a6dc6bbbed"} Aug 04 15:17:42.597230 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.597217 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:42.630929 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.630878 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" podStartSLOduration=1.7070718459999998 podStartE2EDuration="5.630862524s" totalImagesPullingTime="3.923790678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:42.629466149 +0000 UTC m=+392.399859395" watchObservedRunningTime="2026-08-04 15:17:42.630862524 +0000 UTC m=+392.401255758" Aug 04 15:17:42.667440 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:42.667385 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" podStartSLOduration=1.7727447710000002 podStartE2EDuration="5.66736218s" totalImagesPullingTime="3.894617409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:42.664873171 +0000 UTC m=+392.435266404" watchObservedRunningTime="2026-08-04 15:17:42.66736218 +0000 UTC m=+392.437755405" Aug 04 15:17:43.037522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:43.037497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:43.039028 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:43.039001 2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Aug 04 15:17:43.039153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:43.039057 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" podUID="6f00bee8-00b5-4839-80b7-f497b2e48126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Aug 04 15:17:43.604066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:43.604041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-px6pq" Aug 04 15:17:44.040876 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:44.040849 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:44.607074 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:44.607043 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:17:44.608052 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:17:44.608030 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p" Aug 04 15:18:33.685688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.685612 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk"] Aug 04 15:18:33.688029 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.688013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.690602 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.690582 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 04 15:18:33.691606 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.691590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 04 15:18:33.691695 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.691592 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f5s65\"" Aug 04 15:18:33.698096 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.698073 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk"] Aug 04 15:18:33.747703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.747672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.747845 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.747708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7nqp\" (UniqueName: \"kubernetes.io/projected/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-kube-api-access-b7nqp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.747845 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.747794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.781861 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.781834 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572"] Aug 04 15:18:33.784177 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.784162 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.793952 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.793931 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572"] Aug 04 15:18:33.849008 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.848982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.849149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrmx\" (UniqueName: \"kubernetes.io/projected/9b7de877-5ceb-4ff2-a028-674f257bf724-kube-api-access-khrmx\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.849149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.849149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7nqp\" (UniqueName: \"kubernetes.io/projected/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-kube-api-access-b7nqp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.849149 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.849280 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.849441 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849426 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.849485 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.849472 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.858260 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.858235 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7nqp\" (UniqueName: \"kubernetes.io/projected/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-kube-api-access-b7nqp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:33.884756 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.884732 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml"] Aug 04 15:18:33.887135 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.887122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:33.897840 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.897820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml"] Aug 04 15:18:33.949978 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.949900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:33.949978 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.949957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.950156 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.950012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:33.950156 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.950045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrmx\" (UniqueName: \"kubernetes.io/projected/9b7de877-5ceb-4ff2-a028-674f257bf724-kube-api-access-khrmx\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.950156 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.950097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.950156 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.950118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlx6w\" (UniqueName: \"kubernetes.io/projected/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-kube-api-access-mlx6w\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:33.950391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.950315 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.950438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.950420 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.959635 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.959615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrmx\" (UniqueName: \"kubernetes.io/projected/9b7de877-5ceb-4ff2-a028-674f257bf724-kube-api-access-khrmx\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:33.991973 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.991954 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp"] Aug 04 15:18:33.994444 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.994429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:33.997996 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:33.997977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:34.007750 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.007725 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp"] Aug 04 15:18:34.050875 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.050844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlx6w\" (UniqueName: \"kubernetes.io/projected/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-kube-api-access-mlx6w\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.051039 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.050894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.051039 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.050949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.051039 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.050972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vsr8\" (UniqueName: \"kubernetes.io/projected/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-kube-api-access-6vsr8\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.051197 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.051041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.051197 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.051069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.051451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.051426 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.051451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.051445 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.060694 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.060668 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlx6w\" (UniqueName: \"kubernetes.io/projected/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-kube-api-access-mlx6w\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.093661 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.093637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:34.144424 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.144395 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk"] Aug 04 15:18:34.145164 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:18:34.145127 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b0cba3_9f7b_4a78_b268_7e481c5c0294.slice/crio-7de73fd26a5ec8028387f3a380a3522f9f05820b64a73db4c57bf9d730181e93 WatchSource:0}: Error finding container 7de73fd26a5ec8028387f3a380a3522f9f05820b64a73db4c57bf9d730181e93: Status 404 returned error can't find the container with id 7de73fd26a5ec8028387f3a380a3522f9f05820b64a73db4c57bf9d730181e93 Aug 04 15:18:34.152678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.152087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.152678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.152175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vsr8\" (UniqueName: \"kubernetes.io/projected/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-kube-api-access-6vsr8\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.152678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.152262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.152678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.152525 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.152678 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.152616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.162300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.162257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vsr8\" (UniqueName: \"kubernetes.io/projected/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-kube-api-access-6vsr8\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.197314 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.197285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:34.238164 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.238128 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572"] Aug 04 15:18:34.241844 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:18:34.241787 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7de877_5ceb_4ff2_a028_674f257bf724.slice/crio-5e2c351474a8019b0dbc1a04e7eba9207ca4b7f24f7d1d7114f774c046306a6e WatchSource:0}: Error finding container 5e2c351474a8019b0dbc1a04e7eba9207ca4b7f24f7d1d7114f774c046306a6e: Status 404 returned error can't find the container with id 5e2c351474a8019b0dbc1a04e7eba9207ca4b7f24f7d1d7114f774c046306a6e Aug 04 15:18:34.303743 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.303712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:34.346626 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.346596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml"] Aug 04 15:18:34.347218 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:18:34.347193 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7ae4c7_7914_4da5_a91a_1d5012d86b2b.slice/crio-69d3b07076138a9e007a6d017f17b5acaf8d16df0a29fa45c7c6bf8a47f597db WatchSource:0}: Error finding container 69d3b07076138a9e007a6d017f17b5acaf8d16df0a29fa45c7c6bf8a47f597db: Status 404 returned error can't find the container with id 69d3b07076138a9e007a6d017f17b5acaf8d16df0a29fa45c7c6bf8a47f597db Aug 04 15:18:34.453828 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.453706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp"] Aug 04 15:18:34.499098 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:18:34.499039 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6dc0cec_671b_4b14_8dd2_754e69c69ed8.slice/crio-1d81c676e82d682fff219204e242ea967fd89fa329827c69916a4b198b532a36 WatchSource:0}: Error finding container 1d81c676e82d682fff219204e242ea967fd89fa329827c69916a4b198b532a36: Status 404 returned error can't find the container with id 1d81c676e82d682fff219204e242ea967fd89fa329827c69916a4b198b532a36 Aug 04 15:18:34.836166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.836136 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerID="23a110e7bbaac0a7ba3a23ad2254524b557169b74ceaab287cbfe03fdba0bddf" exitCode=0 Aug 04 15:18:34.836631 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.836216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" event={"ID":"9b7de877-5ceb-4ff2-a028-674f257bf724","Type":"ContainerDied","Data":"23a110e7bbaac0a7ba3a23ad2254524b557169b74ceaab287cbfe03fdba0bddf"} Aug 04 15:18:34.836631 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.836269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" event={"ID":"9b7de877-5ceb-4ff2-a028-674f257bf724","Type":"ContainerStarted","Data":"5e2c351474a8019b0dbc1a04e7eba9207ca4b7f24f7d1d7114f774c046306a6e"} Aug 04 15:18:34.837734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.837679 2562 generic.go:356] "Generic (PLEG): container finished" podID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerID="d4873b2c3667249756c4e556badc3dbd0e4dcf5495a5de1fb59bb5e175ed8a17" exitCode=0 Aug 04 15:18:34.837794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.837768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" event={"ID":"c0b0cba3-9f7b-4a78-b268-7e481c5c0294","Type":"ContainerDied","Data":"d4873b2c3667249756c4e556badc3dbd0e4dcf5495a5de1fb59bb5e175ed8a17"} Aug 04 15:18:34.837855 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.837824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" event={"ID":"c0b0cba3-9f7b-4a78-b268-7e481c5c0294","Type":"ContainerStarted","Data":"7de73fd26a5ec8028387f3a380a3522f9f05820b64a73db4c57bf9d730181e93"} Aug 04 15:18:34.839223 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.839206 2562 generic.go:356] "Generic (PLEG): container finished" podID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerID="8c719e5a80024ebe640ea0a3b3498b35497810c35f27558262efd94944a614f0" exitCode=0 Aug 04 15:18:34.839300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.839283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" event={"ID":"e6dc0cec-671b-4b14-8dd2-754e69c69ed8","Type":"ContainerDied","Data":"8c719e5a80024ebe640ea0a3b3498b35497810c35f27558262efd94944a614f0"} Aug 04 15:18:34.839369 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.839323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" event={"ID":"e6dc0cec-671b-4b14-8dd2-754e69c69ed8","Type":"ContainerStarted","Data":"1d81c676e82d682fff219204e242ea967fd89fa329827c69916a4b198b532a36"} Aug 04 15:18:34.840977 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.840958 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerID="1090e383f851f4fadb9b1215c79069e5447687666f6b8ece163ec0701eecefbe" exitCode=0 Aug 04 15:18:34.841057 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.840988 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" event={"ID":"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b","Type":"ContainerDied","Data":"1090e383f851f4fadb9b1215c79069e5447687666f6b8ece163ec0701eecefbe"} Aug 04 15:18:34.841057 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:34.841019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" event={"ID":"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b","Type":"ContainerStarted","Data":"69d3b07076138a9e007a6d017f17b5acaf8d16df0a29fa45c7c6bf8a47f597db"} Aug 04 15:18:36.860052 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.860015 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerID="d361c7f86b0f059bbe355e41d482e45b9aec0c2a29382fa0d862e0cf76b41293" exitCode=0 Aug 04 15:18:36.860476 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.860109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" event={"ID":"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b","Type":"ContainerDied","Data":"d361c7f86b0f059bbe355e41d482e45b9aec0c2a29382fa0d862e0cf76b41293"} Aug 04 15:18:36.861995 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.861964 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerID="c29d51dad85ebc07a910783ec04127fe0fdd133e94e99aabbd5a7a8b1cf5c87f" exitCode=0 Aug 04 15:18:36.862086 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.862034 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" event={"ID":"9b7de877-5ceb-4ff2-a028-674f257bf724","Type":"ContainerDied","Data":"c29d51dad85ebc07a910783ec04127fe0fdd133e94e99aabbd5a7a8b1cf5c87f"} Aug 04 15:18:36.863754 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.863738 2562 generic.go:356] "Generic (PLEG): container finished" podID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerID="2d2c14c73cc593158267341b4a463870ba9fa9580c997bd8cbc5a30f1eb359c1" exitCode=0 Aug 04 15:18:36.863841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.863811 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" event={"ID":"c0b0cba3-9f7b-4a78-b268-7e481c5c0294","Type":"ContainerDied","Data":"2d2c14c73cc593158267341b4a463870ba9fa9580c997bd8cbc5a30f1eb359c1"} Aug 04 15:18:36.865907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.865887 2562 generic.go:356] "Generic (PLEG): container finished" podID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerID="51b8666b7171c2c9a92300e65bc2779df20dae0e2cbac764dbd7bebe4e8b919a" exitCode=0 Aug 04 15:18:36.865996 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:36.865923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" event={"ID":"e6dc0cec-671b-4b14-8dd2-754e69c69ed8","Type":"ContainerDied","Data":"51b8666b7171c2c9a92300e65bc2779df20dae0e2cbac764dbd7bebe4e8b919a"} Aug 04 15:18:37.873945 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.873914 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerID="c899005f740b9df4b780ed27f65405ba9de3b5d349923a14bf92d89ec865b88d" exitCode=0 Aug 04 15:18:37.874419 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.873981 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" event={"ID":"9b7de877-5ceb-4ff2-a028-674f257bf724","Type":"ContainerDied","Data":"c899005f740b9df4b780ed27f65405ba9de3b5d349923a14bf92d89ec865b88d"} Aug 04 15:18:37.875996 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.875977 2562 generic.go:356] "Generic (PLEG): container finished" podID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerID="417228d6e6116769b0bad482909586b171503da7a6054f7d406cec85e923ba61" exitCode=0 Aug 04 15:18:37.876081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.876064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" event={"ID":"c0b0cba3-9f7b-4a78-b268-7e481c5c0294","Type":"ContainerDied","Data":"417228d6e6116769b0bad482909586b171503da7a6054f7d406cec85e923ba61"} Aug 04 15:18:37.877873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.877850 2562 generic.go:356] "Generic (PLEG): container finished" podID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerID="709816bcd573e361cadadf11f53ec1ab587f80d8c4921e93def4d1e4397c157d" exitCode=0 Aug 04 15:18:37.877976 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.877924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" event={"ID":"e6dc0cec-671b-4b14-8dd2-754e69c69ed8","Type":"ContainerDied","Data":"709816bcd573e361cadadf11f53ec1ab587f80d8c4921e93def4d1e4397c157d"} Aug 04 15:18:37.879851 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.879829 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerID="a6770fc105488d4fa5acc1eb10a62aaf778f4883155c069b7d7eb2f487a1206a" exitCode=0 Aug 04 15:18:37.879917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:37.879862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" event={"ID":"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b","Type":"ContainerDied","Data":"a6770fc105488d4fa5acc1eb10a62aaf778f4883155c069b7d7eb2f487a1206a"} Aug 04 15:18:39.066334 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.066302 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:39.085840 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.085817 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:39.090741 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.090721 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:18:39.095076 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.095056 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:39.095333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.095318 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-util\") pod \"9b7de877-5ceb-4ff2-a028-674f257bf724\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " Aug 04 15:18:39.095439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.095402 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khrmx\" (UniqueName: \"kubernetes.io/projected/9b7de877-5ceb-4ff2-a028-674f257bf724-kube-api-access-khrmx\") pod \"9b7de877-5ceb-4ff2-a028-674f257bf724\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " Aug 04 15:18:39.095439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.095422 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-bundle\") pod \"9b7de877-5ceb-4ff2-a028-674f257bf724\" (UID: \"9b7de877-5ceb-4ff2-a028-674f257bf724\") " Aug 04 15:18:39.096187 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.096161 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-bundle" (OuterVolumeSpecName: "bundle") pod "9b7de877-5ceb-4ff2-a028-674f257bf724" (UID: "9b7de877-5ceb-4ff2-a028-674f257bf724"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.097453 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.097427 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7de877-5ceb-4ff2-a028-674f257bf724-kube-api-access-khrmx" (OuterVolumeSpecName: "kube-api-access-khrmx") pod "9b7de877-5ceb-4ff2-a028-674f257bf724" (UID: "9b7de877-5ceb-4ff2-a028-674f257bf724"). InnerVolumeSpecName "kube-api-access-khrmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:18:39.101563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.101533 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-util" (OuterVolumeSpecName: "util") pod "9b7de877-5ceb-4ff2-a028-674f257bf724" (UID: "9b7de877-5ceb-4ff2-a028-674f257bf724"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.196331 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196258 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-util\") pod \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " Aug 04 15:18:39.196331 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196310 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7nqp\" (UniqueName: \"kubernetes.io/projected/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-kube-api-access-b7nqp\") pod \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " Aug 04 15:18:39.196331 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196325 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-bundle\") pod \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " Aug 04 15:18:39.196613 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196370 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-bundle\") pod \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " Aug 04 15:18:39.196613 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196401 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-bundle\") pod \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " Aug 04 15:18:39.196613 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196494 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-util\") pod \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\" (UID: \"c0b0cba3-9f7b-4a78-b268-7e481c5c0294\") " Aug 04 15:18:39.196613 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196524 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-util\") pod \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " Aug 04 15:18:39.196613 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196559 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlx6w\" (UniqueName: \"kubernetes.io/projected/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-kube-api-access-mlx6w\") pod \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\" (UID: \"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b\") " Aug 04 15:18:39.196613 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196587 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vsr8\" (UniqueName: \"kubernetes.io/projected/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-kube-api-access-6vsr8\") pod \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\" (UID: \"e6dc0cec-671b-4b14-8dd2-754e69c69ed8\") " Aug 04 15:18:39.196899 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196842 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.196899 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196863 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khrmx\" (UniqueName: \"kubernetes.io/projected/9b7de877-5ceb-4ff2-a028-674f257bf724-kube-api-access-khrmx\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.196899 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196880 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7de877-5ceb-4ff2-a028-674f257bf724-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.197046 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.196985 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-bundle" (OuterVolumeSpecName: "bundle") pod "c0b0cba3-9f7b-4a78-b268-7e481c5c0294" (UID: "c0b0cba3-9f7b-4a78-b268-7e481c5c0294"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.197046 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.197019 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-bundle" (OuterVolumeSpecName: "bundle") pod "2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" (UID: "2d7ae4c7-7914-4da5-a91a-1d5012d86b2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.197384 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.197327 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-bundle" (OuterVolumeSpecName: "bundle") pod "e6dc0cec-671b-4b14-8dd2-754e69c69ed8" (UID: "e6dc0cec-671b-4b14-8dd2-754e69c69ed8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.199090 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.199065 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-kube-api-access-mlx6w" (OuterVolumeSpecName: "kube-api-access-mlx6w") pod "2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" (UID: "2d7ae4c7-7914-4da5-a91a-1d5012d86b2b"). InnerVolumeSpecName "kube-api-access-mlx6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:18:39.199206 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.199188 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-kube-api-access-b7nqp" (OuterVolumeSpecName: "kube-api-access-b7nqp") pod "c0b0cba3-9f7b-4a78-b268-7e481c5c0294" (UID: "c0b0cba3-9f7b-4a78-b268-7e481c5c0294"). InnerVolumeSpecName "kube-api-access-b7nqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:18:39.199305 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.199288 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-kube-api-access-6vsr8" (OuterVolumeSpecName: "kube-api-access-6vsr8") pod "e6dc0cec-671b-4b14-8dd2-754e69c69ed8" (UID: "e6dc0cec-671b-4b14-8dd2-754e69c69ed8"). InnerVolumeSpecName "kube-api-access-6vsr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:18:39.203318 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.203297 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-util" (OuterVolumeSpecName: "util") pod "c0b0cba3-9f7b-4a78-b268-7e481c5c0294" (UID: "c0b0cba3-9f7b-4a78-b268-7e481c5c0294"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.205744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.205718 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-util" (OuterVolumeSpecName: "util") pod "2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" (UID: "2d7ae4c7-7914-4da5-a91a-1d5012d86b2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.205830 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.205809 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-util" (OuterVolumeSpecName: "util") pod "e6dc0cec-671b-4b14-8dd2-754e69c69ed8" (UID: "e6dc0cec-671b-4b14-8dd2-754e69c69ed8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:18:39.297832 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297805 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297832 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297827 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297839 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlx6w\" (UniqueName: \"kubernetes.io/projected/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-kube-api-access-mlx6w\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297849 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vsr8\" (UniqueName: \"kubernetes.io/projected/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-kube-api-access-6vsr8\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297857 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-util\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297866 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7nqp\" (UniqueName: \"kubernetes.io/projected/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-kube-api-access-b7nqp\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297873 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b0cba3-9f7b-4a78-b268-7e481c5c0294-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297881 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6dc0cec-671b-4b14-8dd2-754e69c69ed8-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.297966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.297888 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d7ae4c7-7914-4da5-a91a-1d5012d86b2b-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:18:39.899407 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.899374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" event={"ID":"9b7de877-5ceb-4ff2-a028-674f257bf724","Type":"ContainerDied","Data":"5e2c351474a8019b0dbc1a04e7eba9207ca4b7f24f7d1d7114f774c046306a6e"} Aug 04 15:18:39.899590 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.899413 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053w2572" Aug 04 15:18:39.899590 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.899427 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e2c351474a8019b0dbc1a04e7eba9207ca4b7f24f7d1d7114f774c046306a6e" Aug 04 15:18:39.901330 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.901308 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" Aug 04 15:18:39.901476 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.901338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c8jrbk" event={"ID":"c0b0cba3-9f7b-4a78-b268-7e481c5c0294","Type":"ContainerDied","Data":"7de73fd26a5ec8028387f3a380a3522f9f05820b64a73db4c57bf9d730181e93"} Aug 04 15:18:39.901476 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.901410 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7de73fd26a5ec8028387f3a380a3522f9f05820b64a73db4c57bf9d730181e93" Aug 04 15:18:39.903333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.903304 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" Aug 04 15:18:39.903333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.903314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0knknp" event={"ID":"e6dc0cec-671b-4b14-8dd2-754e69c69ed8","Type":"ContainerDied","Data":"1d81c676e82d682fff219204e242ea967fd89fa329827c69916a4b198b532a36"} Aug 04 15:18:39.903511 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.903377 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d81c676e82d682fff219204e242ea967fd89fa329827c69916a4b198b532a36" Aug 04 15:18:39.905242 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.905217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" event={"ID":"2d7ae4c7-7914-4da5-a91a-1d5012d86b2b","Type":"ContainerDied","Data":"69d3b07076138a9e007a6d017f17b5acaf8d16df0a29fa45c7c6bf8a47f597db"} Aug 04 15:18:39.905367 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.905255 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69d3b07076138a9e007a6d017f17b5acaf8d16df0a29fa45c7c6bf8a47f597db" Aug 04 15:18:39.905367 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:18:39.905255 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rnml" Aug 04 15:19:51.086216 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086186 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc"] Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086523 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086535 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086543 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086548 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086559 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086565 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086571 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086577 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086585 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086591 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086597 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086602 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086607 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086612 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086618 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086622 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="util" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086629 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086635 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086644 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086649 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086654 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086659 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="extract" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086664 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="pull" Aug 04 15:19:51.086676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086669 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="pull" Aug 04 15:19:51.087361 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086716 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6dc0cec-671b-4b14-8dd2-754e69c69ed8" containerName="extract" Aug 04 15:19:51.087361 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086724 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b0cba3-9f7b-4a78-b268-7e481c5c0294" containerName="extract" Aug 04 15:19:51.087361 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086730 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7ae4c7-7914-4da5-a91a-1d5012d86b2b" containerName="extract" Aug 04 15:19:51.087361 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.086736 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7de877-5ceb-4ff2-a028-674f257bf724" containerName="extract" Aug 04 15:19:51.089536 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.089514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.092561 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.092542 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4zbvv\"" Aug 04 15:19:51.102023 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.101996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc"] Aug 04 15:19:51.206183 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6830c55-7bba-4292-957d-e1c8122e3059-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206183 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6830c55-7bba-4292-957d-e1c8122e3059-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206415 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6830c55-7bba-4292-957d-e1c8122e3059-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206583 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206583 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.206583 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.206536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx9hv\" (UniqueName: \"kubernetes.io/projected/e6830c55-7bba-4292-957d-e1c8122e3059-kube-api-access-hx9hv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307072 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6830c55-7bba-4292-957d-e1c8122e3059-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6830c55-7bba-4292-957d-e1c8122e3059-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6830c55-7bba-4292-957d-e1c8122e3059-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307668 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx9hv\" (UniqueName: \"kubernetes.io/projected/e6830c55-7bba-4292-957d-e1c8122e3059-kube-api-access-hx9hv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307668 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307634 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307804 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307925 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307857 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6830c55-7bba-4292-957d-e1c8122e3059-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.307979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.307927 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.308080 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.308061 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.310061 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.310034 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6830c55-7bba-4292-957d-e1c8122e3059-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.310269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.310251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6830c55-7bba-4292-957d-e1c8122e3059-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.316170 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.316141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx9hv\" (UniqueName: \"kubernetes.io/projected/e6830c55-7bba-4292-957d-e1c8122e3059-kube-api-access-hx9hv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.316259 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.316187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6830c55-7bba-4292-957d-e1c8122e3059-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-fxmtc\" (UID: \"e6830c55-7bba-4292-957d-e1c8122e3059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.399455 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.399378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:51.540489 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.540464 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc"] Aug 04 15:19:51.542105 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:19:51.542065 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6830c55_7bba_4292_957d_e1c8122e3059.slice/crio-aa1cccc7df64d2bc8c7be6e6f3a3992e329038c757b18da541b246e4111ceef2 WatchSource:0}: Error finding container aa1cccc7df64d2bc8c7be6e6f3a3992e329038c757b18da541b246e4111ceef2: Status 404 returned error can't find the container with id aa1cccc7df64d2bc8c7be6e6f3a3992e329038c757b18da541b246e4111ceef2 Aug 04 15:19:51.544250 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.544219 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:19:51.544314 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.544284 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:19:51.544374 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:51.544321 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:19:52.261029 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:52.260994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" event={"ID":"e6830c55-7bba-4292-957d-e1c8122e3059","Type":"ContainerStarted","Data":"06eaab4d0963a059747a781a6ab512cd0874052d46589b1f49faca2e3edb90bd"} Aug 04 15:19:52.261419 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:52.261072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" event={"ID":"e6830c55-7bba-4292-957d-e1c8122e3059","Type":"ContainerStarted","Data":"aa1cccc7df64d2bc8c7be6e6f3a3992e329038c757b18da541b246e4111ceef2"} Aug 04 15:19:52.286453 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:52.286406 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" podStartSLOduration=1.286391467 podStartE2EDuration="1.286391467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:19:52.283837863 +0000 UTC m=+522.054231099" watchObservedRunningTime="2026-08-04 15:19:52.286391467 +0000 UTC m=+522.056784698" Aug 04 15:19:52.400429 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:52.400402 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:52.406552 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:52.406530 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:53.265601 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:53.265574 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:19:53.266545 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:19:53.266526 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:21:06.104337 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.104307 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99"] Aug 04 15:21:06.106578 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.106564 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.109177 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.109161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6hvbs\"" Aug 04 15:21:06.109235 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.109206 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Aug 04 15:21:06.122453 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.122420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99"] Aug 04 15:21:06.139465 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.139433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6b50c6-d5ad-4b0d-a01a-a2322800b42b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ggb99\" (UID: \"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.139586 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.139521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8kjq\" (UniqueName: \"kubernetes.io/projected/2b6b50c6-d5ad-4b0d-a01a-a2322800b42b-kube-api-access-h8kjq\") pod \"payload-pre-processing-687dbb6cf6-ggb99\" (UID: \"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.240626 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.240595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8kjq\" (UniqueName: \"kubernetes.io/projected/2b6b50c6-d5ad-4b0d-a01a-a2322800b42b-kube-api-access-h8kjq\") pod \"payload-pre-processing-687dbb6cf6-ggb99\" (UID: \"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.240784 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.240664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6b50c6-d5ad-4b0d-a01a-a2322800b42b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ggb99\" (UID: \"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.241380 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.241333 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6b50c6-d5ad-4b0d-a01a-a2322800b42b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ggb99\" (UID: \"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.249190 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.249162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8kjq\" (UniqueName: \"kubernetes.io/projected/2b6b50c6-d5ad-4b0d-a01a-a2322800b42b-kube-api-access-h8kjq\") pod \"payload-pre-processing-687dbb6cf6-ggb99\" (UID: \"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.418855 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.418780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:06.548498 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.548471 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99"] Aug 04 15:21:06.550544 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:21:06.550519 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6b50c6_d5ad_4b0d_a01a_a2322800b42b.slice/crio-0608b5a887eb566af71b21c677b8228ba245d1cb86af0616dd023de6b48c572f WatchSource:0}: Error finding container 0608b5a887eb566af71b21c677b8228ba245d1cb86af0616dd023de6b48c572f: Status 404 returned error can't find the container with id 0608b5a887eb566af71b21c677b8228ba245d1cb86af0616dd023de6b48c572f Aug 04 15:21:06.631882 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:06.631845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" event={"ID":"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b","Type":"ContainerStarted","Data":"0608b5a887eb566af71b21c677b8228ba245d1cb86af0616dd023de6b48c572f"} Aug 04 15:21:09.648429 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:09.648396 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" event={"ID":"2b6b50c6-d5ad-4b0d-a01a-a2322800b42b","Type":"ContainerStarted","Data":"27b28286544d19e14c6675dfbb5f3ebe2055e57978d81266cfa8771cd273f101"} Aug 04 15:21:09.648827 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:09.648472 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:09.665751 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:09.665694 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" podStartSLOduration=1.132814406 podStartE2EDuration="3.665677476s" totalImagesPullingTime="2.53286307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:21:09.665248811 +0000 UTC m=+599.435642047" watchObservedRunningTime="2026-08-04 15:21:09.665677476 +0000 UTC m=+599.436070710" Aug 04 15:21:15.682972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:15.682940 2562 generic.go:356] "Generic (PLEG): container finished" podID="e6830c55-7bba-4292-957d-e1c8122e3059" containerID="06eaab4d0963a059747a781a6ab512cd0874052d46589b1f49faca2e3edb90bd" exitCode=0 Aug 04 15:21:15.683401 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:15.683018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" event={"ID":"e6830c55-7bba-4292-957d-e1c8122e3059","Type":"ContainerDied","Data":"06eaab4d0963a059747a781a6ab512cd0874052d46589b1f49faca2e3edb90bd"} Aug 04 15:21:15.683456 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:15.683415 2562 scope.go:117] "RemoveContainer" containerID="06eaab4d0963a059747a781a6ab512cd0874052d46589b1f49faca2e3edb90bd" Aug 04 15:21:15.684381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:15.684354 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:21:15.684448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:15.684420 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:21:15.684483 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:15.684453 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:21:16.690554 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:16.690514 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" event={"ID":"e6830c55-7bba-4292-957d-e1c8122e3059","Type":"ContainerStarted","Data":"3e813ec35262b6a89e439852c3aace466f80229e381d704a7d434812f10c6d6c"} Aug 04 15:21:17.399689 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:17.399645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:21:17.400432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:17.400086 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-fxmtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Aug 04 15:21:17.400432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:17.400149 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" podUID="e6830c55-7bba-4292-957d-e1c8122e3059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Aug 04 15:21:18.400586 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:18.400549 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-fxmtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Aug 04 15:21:18.401166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:18.401135 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" podUID="e6830c55-7bba-4292-957d-e1c8122e3059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Aug 04 15:21:19.400422 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:19.400386 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-fxmtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Aug 04 15:21:19.400720 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:19.400690 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" podUID="e6830c55-7bba-4292-957d-e1c8122e3059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Aug 04 15:21:20.400782 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:20.400740 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-fxmtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Aug 04 15:21:20.401281 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:20.400806 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" podUID="e6830c55-7bba-4292-957d-e1c8122e3059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Aug 04 15:21:20.656157 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:20.656063 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ggb99" Aug 04 15:21:21.399987 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:21.399938 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-fxmtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Aug 04 15:21:21.400190 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:21.400009 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" podUID="e6830c55-7bba-4292-957d-e1c8122e3059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Aug 04 15:21:22.403883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:22.403854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:21:22.404234 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:22.404125 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:21:22.404759 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:22.404744 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fxmtc" Aug 04 15:21:32.806885 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.806806 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl"] Aug 04 15:21:32.810558 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.810533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:32.813652 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.813630 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n5m5q\"" Aug 04 15:21:32.813746 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.813631 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 04 15:21:32.813746 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.813712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Aug 04 15:21:32.814615 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.814597 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 04 15:21:32.821681 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.821662 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl"] Aug 04 15:21:32.983566 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.983529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:32.983566 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.983567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1464832-6b2c-431f-853c-13877923ad7a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:32.983776 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.983668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b56cx\" (UniqueName: \"kubernetes.io/projected/c1464832-6b2c-431f-853c-13877923ad7a-kube-api-access-b56cx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:32.983776 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.983742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:32.983857 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.983786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:32.983857 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:32.983805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084339 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b56cx\" (UniqueName: \"kubernetes.io/projected/c1464832-6b2c-431f-853c-13877923ad7a-kube-api-access-b56cx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084339 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084547 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084547 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084547 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084547 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1464832-6b2c-431f-853c-13877923ad7a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084870 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084838 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.084870 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.085018 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.084877 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.086711 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.086691 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1464832-6b2c-431f-853c-13877923ad7a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.086973 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.086957 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1464832-6b2c-431f-853c-13877923ad7a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.092514 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.092490 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b56cx\" (UniqueName: \"kubernetes.io/projected/c1464832-6b2c-431f-853c-13877923ad7a-kube-api-access-b56cx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qhgzl\" (UID: \"c1464832-6b2c-431f-853c-13877923ad7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.121892 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.121860 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:33.253195 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.253164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl"] Aug 04 15:21:33.254594 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:21:33.254564 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1464832_6b2c_431f_853c_13877923ad7a.slice/crio-ff4f554d858ef124adb9e6036aaa4faaa80d8c2653b0d19b4dc5a50d4d43f8ce WatchSource:0}: Error finding container ff4f554d858ef124adb9e6036aaa4faaa80d8c2653b0d19b4dc5a50d4d43f8ce: Status 404 returned error can't find the container with id ff4f554d858ef124adb9e6036aaa4faaa80d8c2653b0d19b4dc5a50d4d43f8ce Aug 04 15:21:33.255765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.255749 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 15:21:33.788955 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:33.788914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" event={"ID":"c1464832-6b2c-431f-853c-13877923ad7a","Type":"ContainerStarted","Data":"ff4f554d858ef124adb9e6036aaa4faaa80d8c2653b0d19b4dc5a50d4d43f8ce"} Aug 04 15:21:34.796061 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:34.796007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" event={"ID":"c1464832-6b2c-431f-853c-13877923ad7a","Type":"ContainerStarted","Data":"70ca7d8096e0d5e2c2dede6beceefed7fa87610b59f7544a219892207c0fedc7"} Aug 04 15:21:34.817428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:34.817377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" podStartSLOduration=1.371062159 podStartE2EDuration="2.817338292s" totalImagesPullingTime="1.446276133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:21:34.81574937 +0000 UTC m=+624.586142614" watchObservedRunningTime="2026-08-04 15:21:34.817338292 +0000 UTC m=+624.587731524" Aug 04 15:21:43.122013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:43.121982 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:43.122413 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:43.122041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:43.134190 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:43.134171 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:43.851421 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:43.851395 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qhgzl" Aug 04 15:21:53.895331 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.895287 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv"] Aug 04 15:21:53.899160 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.899142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:53.902106 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.902087 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Aug 04 15:21:53.910201 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.910181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv"] Aug 04 15:21:53.970015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.969987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8trj\" (UniqueName: \"kubernetes.io/projected/32738002-7694-41ea-b0d3-ea07f1feb6ac-kube-api-access-v8trj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:53.970152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.970038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32738002-7694-41ea-b0d3-ea07f1feb6ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:53.970152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.970111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:53.970152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.970143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:53.970267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.970170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:53.970267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:53.970201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.071604 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.071554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.071790 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.071613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.071790 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.071653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.071790 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.071699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.071790 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.071757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8trj\" (UniqueName: \"kubernetes.io/projected/32738002-7694-41ea-b0d3-ea07f1feb6ac-kube-api-access-v8trj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.072011 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.071830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32738002-7694-41ea-b0d3-ea07f1feb6ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.072457 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.072417 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.072863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.072841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.072946 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.072911 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.074670 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.074650 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32738002-7694-41ea-b0d3-ea07f1feb6ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.074894 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.074876 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32738002-7694-41ea-b0d3-ea07f1feb6ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.080645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.080617 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8trj\" (UniqueName: \"kubernetes.io/projected/32738002-7694-41ea-b0d3-ea07f1feb6ac-kube-api-access-v8trj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rqqkv\" (UID: \"32738002-7694-41ea-b0d3-ea07f1feb6ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.210235 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.210138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:21:54.344869 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.344845 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv"] Aug 04 15:21:54.346641 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:21:54.346610 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32738002_7694_41ea_b0d3_ea07f1feb6ac.slice/crio-d40bc4667acc2d961fd2430d121ac0b66021dd618b691c34f4cc657fa4932eca WatchSource:0}: Error finding container d40bc4667acc2d961fd2430d121ac0b66021dd618b691c34f4cc657fa4932eca: Status 404 returned error can't find the container with id d40bc4667acc2d961fd2430d121ac0b66021dd618b691c34f4cc657fa4932eca Aug 04 15:21:54.897816 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.897717 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" event={"ID":"32738002-7694-41ea-b0d3-ea07f1feb6ac","Type":"ContainerStarted","Data":"b7981ffcc213a41812caa7e4b2658ca7542cb466d15a557e1d2e9add8af10c24"} Aug 04 15:21:54.897816 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.897785 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" event={"ID":"32738002-7694-41ea-b0d3-ea07f1feb6ac","Type":"ContainerStarted","Data":"d40bc4667acc2d961fd2430d121ac0b66021dd618b691c34f4cc657fa4932eca"} Aug 04 15:21:54.918295 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:21:54.918250 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" podStartSLOduration=1.722491212 podStartE2EDuration="1.91823263s" totalImagesPullingTime="195.741418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:21:54.917245275 +0000 UTC m=+644.687638508" watchObservedRunningTime="2026-08-04 15:21:54.91823263 +0000 UTC m=+644.688625863" Aug 04 15:22:04.210771 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:04.210730 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:22:04.211244 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:04.210816 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:22:04.223452 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:04.223417 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:22:04.965105 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:04.965077 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rqqkv" Aug 04 15:22:31.700893 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.700855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t"] Aug 04 15:22:31.705854 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.705833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.708484 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.708464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Aug 04 15:22:31.723284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.723260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t"] Aug 04 15:22:31.802431 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.802397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.802431 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.802434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.802635 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.802454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.802635 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.802547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.802635 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.802574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a371947-2ce6-42c5-a2af-97b76a28591e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.802728 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.802643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p7rz\" (UniqueName: \"kubernetes.io/projected/1a371947-2ce6-42c5-a2af-97b76a28591e-kube-api-access-8p7rz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.903710 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.903677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p7rz\" (UniqueName: \"kubernetes.io/projected/1a371947-2ce6-42c5-a2af-97b76a28591e-kube-api-access-8p7rz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.903907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.903727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.903907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.903829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.903907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.903860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.903907 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.903892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.904103 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.903914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a371947-2ce6-42c5-a2af-97b76a28591e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.904225 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.904199 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.904291 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.904232 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.904382 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.904326 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.906259 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.906235 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a371947-2ce6-42c5-a2af-97b76a28591e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.906610 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.906592 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a371947-2ce6-42c5-a2af-97b76a28591e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:31.912262 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:31.912242 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p7rz\" (UniqueName: \"kubernetes.io/projected/1a371947-2ce6-42c5-a2af-97b76a28591e-kube-api-access-8p7rz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zw28t\" (UID: \"1a371947-2ce6-42c5-a2af-97b76a28591e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:32.015625 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:32.015530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:32.158082 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:32.158049 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t"] Aug 04 15:22:32.159454 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:22:32.159423 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a371947_2ce6_42c5_a2af_97b76a28591e.slice/crio-62c5020471d8f0ff41fa172483d734d2f6efae7fe2a867690606dab3b0b45bc4 WatchSource:0}: Error finding container 62c5020471d8f0ff41fa172483d734d2f6efae7fe2a867690606dab3b0b45bc4: Status 404 returned error can't find the container with id 62c5020471d8f0ff41fa172483d734d2f6efae7fe2a867690606dab3b0b45bc4 Aug 04 15:22:33.095783 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:33.095738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" event={"ID":"1a371947-2ce6-42c5-a2af-97b76a28591e","Type":"ContainerStarted","Data":"5cd467d750f13a6d738fbea2c2009fe0691d943dc7a56da965b9b21279b366b9"} Aug 04 15:22:33.096210 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:33.095809 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" event={"ID":"1a371947-2ce6-42c5-a2af-97b76a28591e","Type":"ContainerStarted","Data":"62c5020471d8f0ff41fa172483d734d2f6efae7fe2a867690606dab3b0b45bc4"} Aug 04 15:22:33.116817 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:33.116767 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" podStartSLOduration=1.768838914 podStartE2EDuration="2.116750698s" totalImagesPullingTime="347.911784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:22:33.114395865 +0000 UTC m=+682.884789097" watchObservedRunningTime="2026-08-04 15:22:33.116750698 +0000 UTC m=+682.887143929" Aug 04 15:22:42.015932 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:42.015895 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:42.016508 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:42.015987 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:42.028519 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:42.028495 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:22:42.155128 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:22:42.155101 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zw28t" Aug 04 15:28:15.342515 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:15.342475 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4b75876f-s6qxg"] Aug 04 15:28:40.362168 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.362116 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b4b75876f-s6qxg" podUID="2f6a34e1-7a38-482b-8f92-076b59a87e76" containerName="console" containerID="cri-o://4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6" gracePeriod=15 Aug 04 15:28:40.608533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.608510 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:28:40.735030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.734943 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-oauth-serving-cert\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735004 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-serving-cert\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735053 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-config\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735078 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-oauth-config\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735118 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnzcg\" (UniqueName: \"kubernetes.io/projected/2f6a34e1-7a38-482b-8f92-076b59a87e76-kube-api-access-jnzcg\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735148 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-service-ca\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735169 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-trusted-ca-bundle\") pod \"2f6a34e1-7a38-482b-8f92-076b59a87e76\" (UID: \"2f6a34e1-7a38-482b-8f92-076b59a87e76\") " Aug 04 15:28:40.735538 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735329 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:28:40.735725 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735699 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:28:40.735852 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735760 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:28:40.735852 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.735832 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-config" (OuterVolumeSpecName: "console-config") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:28:40.737810 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.737778 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6a34e1-7a38-482b-8f92-076b59a87e76-kube-api-access-jnzcg" (OuterVolumeSpecName: "kube-api-access-jnzcg") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "kube-api-access-jnzcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:28:40.738063 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.738040 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 15:28:40.738387 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.738335 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f6a34e1-7a38-482b-8f92-076b59a87e76" (UID: "2f6a34e1-7a38-482b-8f92-076b59a87e76"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 15:28:40.836110 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836083 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.836110 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836105 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.836110 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836115 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f6a34e1-7a38-482b-8f92-076b59a87e76-console-oauth-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.836384 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836124 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnzcg\" (UniqueName: \"kubernetes.io/projected/2f6a34e1-7a38-482b-8f92-076b59a87e76-kube-api-access-jnzcg\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.836384 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836132 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-service-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.836384 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836140 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-trusted-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.836384 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.836148 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f6a34e1-7a38-482b-8f92-076b59a87e76-oauth-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:28:40.979169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.979142 2562 generic.go:356] "Generic (PLEG): container finished" podID="2f6a34e1-7a38-482b-8f92-076b59a87e76" containerID="4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6" exitCode=0 Aug 04 15:28:40.979280 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.979185 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b75876f-s6qxg" Aug 04 15:28:40.979280 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.979230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b75876f-s6qxg" event={"ID":"2f6a34e1-7a38-482b-8f92-076b59a87e76","Type":"ContainerDied","Data":"4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6"} Aug 04 15:28:40.979393 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.979281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b75876f-s6qxg" event={"ID":"2f6a34e1-7a38-482b-8f92-076b59a87e76","Type":"ContainerDied","Data":"a4102c5b0591e3f26629c06c32dea3a7a2df96bdfcc10c6ef200151c7dbcd5a3"} Aug 04 15:28:40.979393 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.979306 2562 scope.go:117] "RemoveContainer" containerID="4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6" Aug 04 15:28:40.988378 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.988333 2562 scope.go:117] "RemoveContainer" containerID="4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6" Aug 04 15:28:40.988637 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:28:40.988615 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6\": container with ID starting with 4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6 not found: ID does not exist" containerID="4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6" Aug 04 15:28:40.988696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.988639 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6"} err="failed to get container status \"4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6\": rpc error: code = NotFound desc = could not find container \"4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6\": container with ID starting with 4f4f3c869842682be2cf54fa435deb2b729e500df24c2432d11dfbb07dc6efe6 not found: ID does not exist" Aug 04 15:28:40.997013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:40.996992 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4b75876f-s6qxg"] Aug 04 15:28:41.000596 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:41.000574 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4b75876f-s6qxg"] Aug 04 15:28:42.784450 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:28:42.784419 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6a34e1-7a38-482b-8f92-076b59a87e76" path="/var/lib/kubelet/pods/2f6a34e1-7a38-482b-8f92-076b59a87e76/volumes" Aug 04 15:30:00.148319 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.148282 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r"] Aug 04 15:30:00.148883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.148654 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6a34e1-7a38-482b-8f92-076b59a87e76" containerName="console" Aug 04 15:30:00.148883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.148665 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6a34e1-7a38-482b-8f92-076b59a87e76" containerName="console" Aug 04 15:30:00.148883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.148731 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6a34e1-7a38-482b-8f92-076b59a87e76" containerName="console" Aug 04 15:30:00.151827 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.151811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" Aug 04 15:30:00.154628 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.154606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2g8l5\"" Aug 04 15:30:00.161198 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.161174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r"] Aug 04 15:30:00.162426 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.162406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" Aug 04 15:30:00.293787 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.293760 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r"] Aug 04 15:30:00.295191 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:30:00.295156 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83cded8b_3637_4b37_a826_9340d7c78d33.slice/crio-8b8867978b079428e7a6a1b2c0caa10ddddf92012bd98a2cbc27fdab99002990 WatchSource:0}: Error finding container 8b8867978b079428e7a6a1b2c0caa10ddddf92012bd98a2cbc27fdab99002990: Status 404 returned error can't find the container with id 8b8867978b079428e7a6a1b2c0caa10ddddf92012bd98a2cbc27fdab99002990 Aug 04 15:30:00.297096 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.297079 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 15:30:00.391742 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:00.391710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" event={"ID":"83cded8b-3637-4b37-a826-9340d7c78d33","Type":"ContainerStarted","Data":"8b8867978b079428e7a6a1b2c0caa10ddddf92012bd98a2cbc27fdab99002990"} Aug 04 15:30:03.409304 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:03.409272 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" event={"ID":"83cded8b-3637-4b37-a826-9340d7c78d33","Type":"ContainerStarted","Data":"cb0c58799437d1e29de48ee9f929a61e787c60b68b989fafd4457e366fba9e80"} Aug 04 15:30:03.427717 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:03.427661 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" podStartSLOduration=0.761133436 podStartE2EDuration="3.427646125s" totalImagesPullingTime="2.666512689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:30:03.425602503 +0000 UTC m=+1133.195995742" watchObservedRunningTime="2026-08-04 15:30:03.427646125 +0000 UTC m=+1133.198039357" Aug 04 15:30:04.417861 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:04.417824 2562 generic.go:356] "Generic (PLEG): container finished" podID="83cded8b-3637-4b37-a826-9340d7c78d33" containerID="cb0c58799437d1e29de48ee9f929a61e787c60b68b989fafd4457e366fba9e80" exitCode=0 Aug 04 15:30:04.418272 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:04.417910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" event={"ID":"83cded8b-3637-4b37-a826-9340d7c78d33","Type":"ContainerDied","Data":"cb0c58799437d1e29de48ee9f929a61e787c60b68b989fafd4457e366fba9e80"} Aug 04 15:30:05.556047 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:05.556024 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" Aug 04 15:30:06.431811 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:06.431777 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" Aug 04 15:30:06.431981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:06.431787 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-cgw9r" event={"ID":"83cded8b-3637-4b37-a826-9340d7c78d33","Type":"ContainerDied","Data":"8b8867978b079428e7a6a1b2c0caa10ddddf92012bd98a2cbc27fdab99002990"} Aug 04 15:30:06.431981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:30:06.431964 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b8867978b079428e7a6a1b2c0caa10ddddf92012bd98a2cbc27fdab99002990" Aug 04 15:42:06.722796 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.722762 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m"] Aug 04 15:42:06.723267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.723156 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cded8b-3637-4b37-a826-9340d7c78d33" containerName="cleanup" Aug 04 15:42:06.723267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.723169 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cded8b-3637-4b37-a826-9340d7c78d33" containerName="cleanup" Aug 04 15:42:06.723267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.723267 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cded8b-3637-4b37-a826-9340d7c78d33" containerName="cleanup" Aug 04 15:42:06.726446 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.726427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.735091 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.735070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-197040d2-openshift-default-dockercfg-6nsdk\"" Aug 04 15:42:06.776478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.776450 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m"] Aug 04 15:42:06.838946 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.838911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-data\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.838968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-certs\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.838993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istiod-ca-cert\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.839046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-token\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.839095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-socket\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839131 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.839118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzbw\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-kube-api-access-jlzbw\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839371 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.839183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-envoy\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839371 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.839234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-credential-socket\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.839371 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.839262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-podinfo\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940289 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-data\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-certs\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istiod-ca-cert\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-token\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-socket\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzbw\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-kube-api-access-jlzbw\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-envoy\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-credential-socket\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940719 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-podinfo\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940785 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-certs\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940901 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940853 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-data\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.940946 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.940921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-socket\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.941115 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.941090 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-credential-socket\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.941241 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.941216 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istiod-ca-cert\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.943006 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.942983 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-envoy\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.943192 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.943177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-podinfo\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.950102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.950083 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzbw\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-kube-api-access-jlzbw\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:06.950498 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:06.950474 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-token\") pod \"e2e-ait-197040d2-openshift-default-954d56d74-hmb2m\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:07.036479 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:07.036456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:07.193950 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:07.193925 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m"] Aug 04 15:42:07.196313 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:42:07.196287 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf556d5e0_c5bc_4431_8aac_e36b8b16a960.slice/crio-36b90b63e0a17bf53bf3ef0e54808df79831e37005f60976a60de9b596d4670d WatchSource:0}: Error finding container 36b90b63e0a17bf53bf3ef0e54808df79831e37005f60976a60de9b596d4670d: Status 404 returned error can't find the container with id 36b90b63e0a17bf53bf3ef0e54808df79831e37005f60976a60de9b596d4670d Aug 04 15:42:07.198796 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:07.198759 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:07.198897 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:07.198841 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:07.198897 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:07.198885 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:08.183570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:08.183535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" event={"ID":"f556d5e0-c5bc-4431-8aac-e36b8b16a960","Type":"ContainerStarted","Data":"cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42"} Aug 04 15:42:08.184048 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:08.183591 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" event={"ID":"f556d5e0-c5bc-4431-8aac-e36b8b16a960","Type":"ContainerStarted","Data":"36b90b63e0a17bf53bf3ef0e54808df79831e37005f60976a60de9b596d4670d"} Aug 04 15:42:08.209485 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:08.209439 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podStartSLOduration=2.209424527 podStartE2EDuration="2.209424527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:08.208037309 +0000 UTC m=+1857.978430544" watchObservedRunningTime="2026-08-04 15:42:08.209424527 +0000 UTC m=+1857.979817829" Aug 04 15:42:09.037250 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:09.037206 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:09.041891 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:09.041867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:09.189116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:09.189086 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:09.190044 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:09.190023 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:11.969088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.969051 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v"] Aug 04 15:42:11.972541 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.972523 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:11.976656 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.976626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-197040d2\"" Aug 04 15:42:11.976793 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.976766 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-197040d2-dockercfg-rt44c\"" Aug 04 15:42:11.982493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.982469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8fcn\" (UniqueName: \"kubernetes.io/projected/2813967c-b6ed-48f0-9fb6-3be019e389aa-kube-api-access-t8fcn\") pod \"payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:11.982619 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.982538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2813967c-b6ed-48f0-9fb6-3be019e389aa-plugins-config-volume\") pod \"payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:11.998544 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:11.998519 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v"] Aug 04 15:42:12.046310 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.046269 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv"] Aug 04 15:42:12.049526 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.049511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.075881 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.075853 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv"] Aug 04 15:42:12.083068 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.083037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8fcn\" (UniqueName: \"kubernetes.io/projected/2813967c-b6ed-48f0-9fb6-3be019e389aa-kube-api-access-t8fcn\") pod \"payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:12.083186 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.083071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2813967c-b6ed-48f0-9fb6-3be019e389aa-plugins-config-volume\") pod \"payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:12.083843 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.083817 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2813967c-b6ed-48f0-9fb6-3be019e389aa-plugins-config-volume\") pod \"payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:12.097398 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.097365 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8fcn\" (UniqueName: \"kubernetes.io/projected/2813967c-b6ed-48f0-9fb6-3be019e389aa-kube-api-access-t8fcn\") pod \"payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:12.184530 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.184496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.184687 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.184617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvf6l\" (UniqueName: \"kubernetes.io/projected/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-kube-api-access-nvf6l\") pod \"payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.283412 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.283303 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:12.285651 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.285628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.285761 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.285699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvf6l\" (UniqueName: \"kubernetes.io/projected/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-kube-api-access-nvf6l\") pod \"payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.286548 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.286384 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.295186 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.295155 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvf6l\" (UniqueName: \"kubernetes.io/projected/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-kube-api-access-nvf6l\") pod \"payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.359904 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.359869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:12.441009 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.440976 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v"] Aug 04 15:42:12.441994 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:42:12.441963 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2813967c_b6ed_48f0_9fb6_3be019e389aa.slice/crio-c8b15e70faac4a017063f0845cdd6c30e9a5f4a3a96d18b1df60c328c3bb4568 WatchSource:0}: Error finding container c8b15e70faac4a017063f0845cdd6c30e9a5f4a3a96d18b1df60c328c3bb4568: Status 404 returned error can't find the container with id c8b15e70faac4a017063f0845cdd6c30e9a5f4a3a96d18b1df60c328c3bb4568 Aug 04 15:42:12.509616 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:12.509592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv"] Aug 04 15:42:12.510425 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:42:12.510396 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b789c2f_c5a7_435d_ad5c_b2f421eb964c.slice/crio-4ed5ba950a5634d53da81c2b8bba50a2e3d50290f1eabb4a96e85460c10e0f51 WatchSource:0}: Error finding container 4ed5ba950a5634d53da81c2b8bba50a2e3d50290f1eabb4a96e85460c10e0f51: Status 404 returned error can't find the container with id 4ed5ba950a5634d53da81c2b8bba50a2e3d50290f1eabb4a96e85460c10e0f51 Aug 04 15:42:13.211137 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.211103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" event={"ID":"5b789c2f-c5a7-435d-ad5c-b2f421eb964c","Type":"ContainerStarted","Data":"1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6"} Aug 04 15:42:13.211601 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.211162 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" event={"ID":"5b789c2f-c5a7-435d-ad5c-b2f421eb964c","Type":"ContainerStarted","Data":"4ed5ba950a5634d53da81c2b8bba50a2e3d50290f1eabb4a96e85460c10e0f51"} Aug 04 15:42:13.211601 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.211282 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:13.212864 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.212840 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" event={"ID":"2813967c-b6ed-48f0-9fb6-3be019e389aa","Type":"ContainerStarted","Data":"42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401"} Aug 04 15:42:13.212990 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.212876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" event={"ID":"2813967c-b6ed-48f0-9fb6-3be019e389aa","Type":"ContainerStarted","Data":"c8b15e70faac4a017063f0845cdd6c30e9a5f4a3a96d18b1df60c328c3bb4568"} Aug 04 15:42:13.212990 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.212895 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:13.236936 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.236882 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" podStartSLOduration=1.236869979 podStartE2EDuration="1.236869979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:13.234852645 +0000 UTC m=+1863.005245877" watchObservedRunningTime="2026-08-04 15:42:13.236869979 +0000 UTC m=+1863.007263211" Aug 04 15:42:13.266734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:13.266689 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" podStartSLOduration=2.266676849 podStartE2EDuration="2.266676849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:13.263437738 +0000 UTC m=+1863.033830970" watchObservedRunningTime="2026-08-04 15:42:13.266676849 +0000 UTC m=+1863.037070080" Aug 04 15:42:24.190523 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.190485 2562 patch_prober.go:28] interesting pod/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Aug 04 15:42:24.190989 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.190550 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Aug 04 15:42:24.227896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.227871 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:24.228061 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.227943 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:24.282610 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.282574 2562 generic.go:356] "Generic (PLEG): container finished" podID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerID="cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42" exitCode=0 Aug 04 15:42:24.282798 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.282646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" event={"ID":"f556d5e0-c5bc-4431-8aac-e36b8b16a960","Type":"ContainerDied","Data":"cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42"} Aug 04 15:42:24.283091 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.283073 2562 scope.go:117] "RemoveContainer" containerID="cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42" Aug 04 15:42:24.284331 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.284295 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:24.284439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.284399 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:24.284479 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:24.284450 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:25.291592 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:25.291547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" event={"ID":"f556d5e0-c5bc-4431-8aac-e36b8b16a960","Type":"ContainerStarted","Data":"711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813"} Aug 04 15:42:26.037191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:26.037157 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:26.037382 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:26.037340 2562 patch_prober.go:28] interesting pod/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Aug 04 15:42:26.037452 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:26.037437 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Aug 04 15:42:27.037783 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:27.037750 2562 patch_prober.go:28] interesting pod/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Aug 04 15:42:27.038170 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:27.037804 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Aug 04 15:42:28.037622 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:28.037589 2562 patch_prober.go:28] interesting pod/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Aug 04 15:42:28.037836 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:28.037664 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Aug 04 15:42:29.037800 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:29.037763 2562 patch_prober.go:28] interesting pod/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Aug 04 15:42:29.037989 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:29.037822 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Aug 04 15:42:30.036953 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:30.036919 2562 patch_prober.go:28] interesting pod/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Aug 04 15:42:30.037119 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:30.036968 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Aug 04 15:42:31.041501 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:31.041430 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:31.041896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:31.041834 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:31.042462 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:31.042444 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:51.375803 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.375769 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v"] Aug 04 15:42:51.376337 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.376031 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" podUID="2813967c-b6ed-48f0-9fb6-3be019e389aa" containerName="payload-processing" containerID="cri-o://42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401" gracePeriod=30 Aug 04 15:42:51.383884 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.383616 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv"] Aug 04 15:42:51.383884 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.383790 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" podUID="5b789c2f-c5a7-435d-ad5c-b2f421eb964c" containerName="payload-pre-processing" containerID="cri-o://1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6" gracePeriod=30 Aug 04 15:42:51.656772 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.656741 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:51.671936 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.671902 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:51.727593 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.727561 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m"] Aug 04 15:42:51.727798 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.727776 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" containerID="cri-o://711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813" gracePeriod=30 Aug 04 15:42:51.756007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.755972 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8fcn\" (UniqueName: \"kubernetes.io/projected/2813967c-b6ed-48f0-9fb6-3be019e389aa-kube-api-access-t8fcn\") pod \"2813967c-b6ed-48f0-9fb6-3be019e389aa\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " Aug 04 15:42:51.756155 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.756022 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2813967c-b6ed-48f0-9fb6-3be019e389aa-plugins-config-volume\") pod \"2813967c-b6ed-48f0-9fb6-3be019e389aa\" (UID: \"2813967c-b6ed-48f0-9fb6-3be019e389aa\") " Aug 04 15:42:51.756458 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.756426 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2813967c-b6ed-48f0-9fb6-3be019e389aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2813967c-b6ed-48f0-9fb6-3be019e389aa" (UID: "2813967c-b6ed-48f0-9fb6-3be019e389aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:42:51.758299 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.758281 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2813967c-b6ed-48f0-9fb6-3be019e389aa-kube-api-access-t8fcn" (OuterVolumeSpecName: "kube-api-access-t8fcn") pod "2813967c-b6ed-48f0-9fb6-3be019e389aa" (UID: "2813967c-b6ed-48f0-9fb6-3be019e389aa"). InnerVolumeSpecName "kube-api-access-t8fcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:42:51.857123 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.857093 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-plugins-config-volume\") pod \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " Aug 04 15:42:51.857311 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.857133 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvf6l\" (UniqueName: \"kubernetes.io/projected/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-kube-api-access-nvf6l\") pod \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\" (UID: \"5b789c2f-c5a7-435d-ad5c-b2f421eb964c\") " Aug 04 15:42:51.857539 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.857514 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8fcn\" (UniqueName: \"kubernetes.io/projected/2813967c-b6ed-48f0-9fb6-3be019e389aa-kube-api-access-t8fcn\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:51.857643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.857543 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2813967c-b6ed-48f0-9fb6-3be019e389aa-plugins-config-volume\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:51.857643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.857557 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b789c2f-c5a7-435d-ad5c-b2f421eb964c" (UID: "5b789c2f-c5a7-435d-ad5c-b2f421eb964c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:42:51.859392 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.859373 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-kube-api-access-nvf6l" (OuterVolumeSpecName: "kube-api-access-nvf6l") pod "5b789c2f-c5a7-435d-ad5c-b2f421eb964c" (UID: "5b789c2f-c5a7-435d-ad5c-b2f421eb964c"). InnerVolumeSpecName "kube-api-access-nvf6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:42:51.958979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.958907 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-plugins-config-volume\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:51.958979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:51.958938 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvf6l\" (UniqueName: \"kubernetes.io/projected/5b789c2f-c5a7-435d-ad5c-b2f421eb964c-kube-api-access-nvf6l\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:52.444219 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.444190 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b789c2f-c5a7-435d-ad5c-b2f421eb964c" containerID="1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6" exitCode=0 Aug 04 15:42:52.444642 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.444235 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" Aug 04 15:42:52.444642 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.444280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" event={"ID":"5b789c2f-c5a7-435d-ad5c-b2f421eb964c","Type":"ContainerDied","Data":"1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6"} Aug 04 15:42:52.444642 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.444365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv" event={"ID":"5b789c2f-c5a7-435d-ad5c-b2f421eb964c","Type":"ContainerDied","Data":"4ed5ba950a5634d53da81c2b8bba50a2e3d50290f1eabb4a96e85460c10e0f51"} Aug 04 15:42:52.444642 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.444403 2562 scope.go:117] "RemoveContainer" containerID="1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6" Aug 04 15:42:52.445739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.445655 2562 generic.go:356] "Generic (PLEG): container finished" podID="2813967c-b6ed-48f0-9fb6-3be019e389aa" containerID="42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401" exitCode=0 Aug 04 15:42:52.445739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.445687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" event={"ID":"2813967c-b6ed-48f0-9fb6-3be019e389aa","Type":"ContainerDied","Data":"42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401"} Aug 04 15:42:52.445739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.445710 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" Aug 04 15:42:52.445739 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.445738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v" event={"ID":"2813967c-b6ed-48f0-9fb6-3be019e389aa","Type":"ContainerDied","Data":"c8b15e70faac4a017063f0845cdd6c30e9a5f4a3a96d18b1df60c328c3bb4568"} Aug 04 15:42:52.453251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.453234 2562 scope.go:117] "RemoveContainer" containerID="1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6" Aug 04 15:42:52.453568 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:42:52.453548 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6\": container with ID starting with 1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6 not found: ID does not exist" containerID="1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6" Aug 04 15:42:52.453665 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.453575 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6"} err="failed to get container status \"1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6\": rpc error: code = NotFound desc = could not find container \"1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6\": container with ID starting with 1fbff037a6218b554e8538be92be5588c01a67fdb5aaf05a421388b6f431fef6 not found: ID does not exist" Aug 04 15:42:52.453665 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.453592 2562 scope.go:117] "RemoveContainer" containerID="42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401" Aug 04 15:42:52.461744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.461730 2562 scope.go:117] "RemoveContainer" containerID="42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401" Aug 04 15:42:52.461975 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:42:52.461957 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401\": container with ID starting with 42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401 not found: ID does not exist" containerID="42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401" Aug 04 15:42:52.462029 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.461981 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401"} err="failed to get container status \"42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401\": rpc error: code = NotFound desc = could not find container \"42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401\": container with ID starting with 42781ec938d13da59d471c947118ae0893d746a35f2f121f847576c4b0d1b401 not found: ID does not exist" Aug 04 15:42:52.474078 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.474056 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v"] Aug 04 15:42:52.478579 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.478559 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-197040d2-5dd76dc6fd-nhk4v"] Aug 04 15:42:52.492462 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.492444 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv"] Aug 04 15:42:52.494327 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.494308 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-197040d2-7dc779c48-gs8pv"] Aug 04 15:42:52.744233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744154 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv"] Aug 04 15:42:52.744646 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744627 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2813967c-b6ed-48f0-9fb6-3be019e389aa" containerName="payload-processing" Aug 04 15:42:52.744740 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744648 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2813967c-b6ed-48f0-9fb6-3be019e389aa" containerName="payload-processing" Aug 04 15:42:52.744740 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744676 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b789c2f-c5a7-435d-ad5c-b2f421eb964c" containerName="payload-pre-processing" Aug 04 15:42:52.744740 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744686 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b789c2f-c5a7-435d-ad5c-b2f421eb964c" containerName="payload-pre-processing" Aug 04 15:42:52.744881 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744787 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2813967c-b6ed-48f0-9fb6-3be019e389aa" containerName="payload-processing" Aug 04 15:42:52.744881 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.744805 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b789c2f-c5a7-435d-ad5c-b2f421eb964c" containerName="payload-pre-processing" Aug 04 15:42:52.749974 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.749952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.753254 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.753234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-25b12afe-gw-openshift-default-dockercfg-lbbpz\"" Aug 04 15:42:52.762162 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.762138 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv"] Aug 04 15:42:52.785495 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.785465 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2813967c-b6ed-48f0-9fb6-3be019e389aa" path="/var/lib/kubelet/pods/2813967c-b6ed-48f0-9fb6-3be019e389aa/volumes" Aug 04 15:42:52.785840 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.785828 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b789c2f-c5a7-435d-ad5c-b2f421eb964c" path="/var/lib/kubelet/pods/5b789c2f-c5a7-435d-ad5c-b2f421eb964c/volumes" Aug 04 15:42:52.866911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.866877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-socket\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.866922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-token\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.866945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-data\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.867004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-podinfo\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.867040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-certs\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.867085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-envoy\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.867146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8z5\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-kube-api-access-8c8z5\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.867184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-credential-socket\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.867233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.867206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd4ec94-319d-4dce-a481-92c410ce307b-istiod-ca-cert\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.967721 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.967688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-socket\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.967898 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.967736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-token\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.967963 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.967942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-data\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968027 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-podinfo\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968080 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-certs\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968080 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-socket\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968187 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-envoy\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968187 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8z5\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-kube-api-access-8c8z5\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968187 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-credential-socket\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968362 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd4ec94-319d-4dce-a481-92c410ce307b-istiod-ca-cert\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968362 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-data\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968469 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968380 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-certs\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968595 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-credential-socket\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.968860 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.968809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd4ec94-319d-4dce-a481-92c410ce307b-istiod-ca-cert\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.970508 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.970480 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-envoy\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.970734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.970716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-podinfo\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.976888 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.976863 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-token\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:52.977074 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:52.977057 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8z5\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-kube-api-access-8c8z5\") pod \"e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:53.061321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.061295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:53.201746 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.201717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv"] Aug 04 15:42:53.203048 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:42:53.203019 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd4ec94_319d_4dce_a481_92c410ce307b.slice/crio-451aeebe773bc06bea339743372c5f9bcb35907dd29590bbc48b5539ea5927aa WatchSource:0}: Error finding container 451aeebe773bc06bea339743372c5f9bcb35907dd29590bbc48b5539ea5927aa: Status 404 returned error can't find the container with id 451aeebe773bc06bea339743372c5f9bcb35907dd29590bbc48b5539ea5927aa Aug 04 15:42:53.205094 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.205063 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:53.205172 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.205126 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:53.205172 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.205155 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:42:53.464409 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.464295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" event={"ID":"3cd4ec94-319d-4dce-a481-92c410ce307b","Type":"ContainerStarted","Data":"f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271"} Aug 04 15:42:53.464409 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.464405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" event={"ID":"3cd4ec94-319d-4dce-a481-92c410ce307b","Type":"ContainerStarted","Data":"451aeebe773bc06bea339743372c5f9bcb35907dd29590bbc48b5539ea5927aa"} Aug 04 15:42:53.489176 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:53.489127 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podStartSLOduration=1.489110663 podStartE2EDuration="1.489110663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:53.486438792 +0000 UTC m=+1903.256832026" watchObservedRunningTime="2026-08-04 15:42:53.489110663 +0000 UTC m=+1903.259503894" Aug 04 15:42:54.061937 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:54.061901 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:54.067067 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:54.067041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:54.470446 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:54.470336 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:54.471298 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:54.471279 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:42:55.990416 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:55.990385 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2"] Aug 04 15:42:55.993097 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:55.993076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:55.995799 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:55.995773 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-25b12afe\"" Aug 04 15:42:55.995905 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:55.995801 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-25b12afe-dockercfg-2vmgg\"" Aug 04 15:42:55.996417 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:55.996400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f6aab1-009f-40e9-93e6-341a58ea5390-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:55.996521 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:55.996444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb56l\" (UniqueName: \"kubernetes.io/projected/98f6aab1-009f-40e9-93e6-341a58ea5390-kube-api-access-wb56l\") pod \"payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:56.004277 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.004256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2"] Aug 04 15:42:56.065856 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.065823 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx"] Aug 04 15:42:56.068522 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.068503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.080183 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.080158 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx"] Aug 04 15:42:56.097164 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.097137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f6aab1-009f-40e9-93e6-341a58ea5390-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:56.097261 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.097183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77g5\" (UniqueName: \"kubernetes.io/projected/43615b8d-837a-4121-a2e9-ec1771cce033-kube-api-access-v77g5\") pod \"payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.097339 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.097310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43615b8d-837a-4121-a2e9-ec1771cce033-plugins-config-volume\") pod \"payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.097463 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.097447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb56l\" (UniqueName: \"kubernetes.io/projected/98f6aab1-009f-40e9-93e6-341a58ea5390-kube-api-access-wb56l\") pod \"payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:56.097873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.097856 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f6aab1-009f-40e9-93e6-341a58ea5390-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:56.111957 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.111926 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb56l\" (UniqueName: \"kubernetes.io/projected/98f6aab1-009f-40e9-93e6-341a58ea5390-kube-api-access-wb56l\") pod \"payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:56.198776 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.198745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77g5\" (UniqueName: \"kubernetes.io/projected/43615b8d-837a-4121-a2e9-ec1771cce033-kube-api-access-v77g5\") pod \"payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.198776 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.198780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43615b8d-837a-4121-a2e9-ec1771cce033-plugins-config-volume\") pod \"payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.199450 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.199433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43615b8d-837a-4121-a2e9-ec1771cce033-plugins-config-volume\") pod \"payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.216110 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.216085 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77g5\" (UniqueName: \"kubernetes.io/projected/43615b8d-837a-4121-a2e9-ec1771cce033-kube-api-access-v77g5\") pod \"payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.304325 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.304292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:56.379878 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.379846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:56.451428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.451397 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2"] Aug 04 15:42:56.452213 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:42:56.452177 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f6aab1_009f_40e9_93e6_341a58ea5390.slice/crio-a9bb12b38bd8c89c5471beee669730988bfb55c135baab5527ffbeba629adec7 WatchSource:0}: Error finding container a9bb12b38bd8c89c5471beee669730988bfb55c135baab5527ffbeba629adec7: Status 404 returned error can't find the container with id a9bb12b38bd8c89c5471beee669730988bfb55c135baab5527ffbeba629adec7 Aug 04 15:42:56.483140 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.483112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" event={"ID":"98f6aab1-009f-40e9-93e6-341a58ea5390","Type":"ContainerStarted","Data":"a9bb12b38bd8c89c5471beee669730988bfb55c135baab5527ffbeba629adec7"} Aug 04 15:42:56.540324 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.540297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx"] Aug 04 15:42:56.540862 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:42:56.540837 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43615b8d_837a_4121_a2e9_ec1771cce033.slice/crio-1cd06d4d33a995fd608784af6287cd9fe53cac3250708c8701e0df35ab1af056 WatchSource:0}: Error finding container 1cd06d4d33a995fd608784af6287cd9fe53cac3250708c8701e0df35ab1af056: Status 404 returned error can't find the container with id 1cd06d4d33a995fd608784af6287cd9fe53cac3250708c8701e0df35ab1af056 Aug 04 15:42:56.958529 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:56.958497 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:57.007845 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.007816 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istiod-ca-cert\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.007854 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-certs\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.007873 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-socket\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.007898 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-data\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008006 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlzbw\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-kube-api-access-jlzbw\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008088 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-envoy\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008158 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-credential-socket\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-token\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008243 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-podinfo\") pod \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\" (UID: \"f556d5e0-c5bc-4431-8aac-e36b8b16a960\") " Aug 04 15:42:57.008685 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008236 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-data" (OuterVolumeSpecName: "istio-data") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:42:57.008685 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008482 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:42:57.008944 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008687 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:42:57.008944 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.008706 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:42:57.009071 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.009042 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:42:57.010555 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.010527 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:42:57.010703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.010688 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:42:57.010857 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.010837 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-token" (OuterVolumeSpecName: "istio-token") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:42:57.011058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.011038 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-kube-api-access-jlzbw" (OuterVolumeSpecName: "kube-api-access-jlzbw") pod "f556d5e0-c5bc-4431-8aac-e36b8b16a960" (UID: "f556d5e0-c5bc-4431-8aac-e36b8b16a960"). InnerVolumeSpecName "kube-api-access-jlzbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:42:57.109570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109496 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109520 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109531 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109543 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109553 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109570 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109566 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlzbw\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-kube-api-access-jlzbw\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109834 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109578 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109834 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109591 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f556d5e0-c5bc-4431-8aac-e36b8b16a960-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.109834 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.109603 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f556d5e0-c5bc-4431-8aac-e36b8b16a960-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:42:57.491467 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.491370 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" event={"ID":"98f6aab1-009f-40e9-93e6-341a58ea5390","Type":"ContainerStarted","Data":"a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715"} Aug 04 15:42:57.491467 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.491436 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:42:57.493137 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.493108 2562 generic.go:356] "Generic (PLEG): container finished" podID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerID="711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813" exitCode=0 Aug 04 15:42:57.493246 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.493159 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" Aug 04 15:42:57.493246 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.493183 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" event={"ID":"f556d5e0-c5bc-4431-8aac-e36b8b16a960","Type":"ContainerDied","Data":"711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813"} Aug 04 15:42:57.493246 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.493229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m" event={"ID":"f556d5e0-c5bc-4431-8aac-e36b8b16a960","Type":"ContainerDied","Data":"36b90b63e0a17bf53bf3ef0e54808df79831e37005f60976a60de9b596d4670d"} Aug 04 15:42:57.493444 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.493253 2562 scope.go:117] "RemoveContainer" containerID="711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813" Aug 04 15:42:57.495147 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.495121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" event={"ID":"43615b8d-837a-4121-a2e9-ec1771cce033","Type":"ContainerStarted","Data":"86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192"} Aug 04 15:42:57.495268 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.495168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" event={"ID":"43615b8d-837a-4121-a2e9-ec1771cce033","Type":"ContainerStarted","Data":"1cd06d4d33a995fd608784af6287cd9fe53cac3250708c8701e0df35ab1af056"} Aug 04 15:42:57.495580 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.495323 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:42:57.511847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.511791 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" podStartSLOduration=2.511774981 podStartE2EDuration="2.511774981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:57.508907958 +0000 UTC m=+1907.279301190" watchObservedRunningTime="2026-08-04 15:42:57.511774981 +0000 UTC m=+1907.282168212" Aug 04 15:42:57.513132 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.513104 2562 scope.go:117] "RemoveContainer" containerID="cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42" Aug 04 15:42:57.522150 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.522122 2562 scope.go:117] "RemoveContainer" containerID="711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813" Aug 04 15:42:57.522446 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:42:57.522416 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813\": container with ID starting with 711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813 not found: ID does not exist" containerID="711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813" Aug 04 15:42:57.522540 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.522455 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813"} err="failed to get container status \"711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813\": rpc error: code = NotFound desc = could not find container \"711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813\": container with ID starting with 711b98c23e7fdf30a0260d3185e346725a0188c8d4cd894578f9b616f4fdf813 not found: ID does not exist" Aug 04 15:42:57.522540 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.522479 2562 scope.go:117] "RemoveContainer" containerID="cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42" Aug 04 15:42:57.522764 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:42:57.522745 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42\": container with ID starting with cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42 not found: ID does not exist" containerID="cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42" Aug 04 15:42:57.522820 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.522773 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42"} err="failed to get container status \"cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42\": rpc error: code = NotFound desc = could not find container \"cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42\": container with ID starting with cc9cba0d13ff7c6d4e7e28997488e8cce07a0927f7e0eb477725955de70f0d42 not found: ID does not exist" Aug 04 15:42:57.528216 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.528178 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" podStartSLOduration=1.5281662790000001 podStartE2EDuration="1.528166279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:57.527261136 +0000 UTC m=+1907.297654371" watchObservedRunningTime="2026-08-04 15:42:57.528166279 +0000 UTC m=+1907.298559511" Aug 04 15:42:57.545970 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.545953 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m"] Aug 04 15:42:57.549829 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:57.549809 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-197040d2-openshift-default-954d56d74-hmb2m"] Aug 04 15:42:58.784252 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:42:58.784218 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" path="/var/lib/kubelet/pods/f556d5e0-c5bc-4431-8aac-e36b8b16a960/volumes" Aug 04 15:43:08.505272 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.505224 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.45:9004: connect: connection refused" Aug 04 15:43:08.505793 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.505743 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:43:08.571971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.571934 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerID="f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271" exitCode=0 Aug 04 15:43:08.572134 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.571998 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" event={"ID":"3cd4ec94-319d-4dce-a481-92c410ce307b","Type":"ContainerDied","Data":"f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271"} Aug 04 15:43:08.572401 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.572386 2562 scope.go:117] "RemoveContainer" containerID="f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271" Aug 04 15:43:08.573483 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.573447 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:08.573592 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.573535 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:08.573592 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:08.573583 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:09.470840 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:09.470798 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:09.579066 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:09.579025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" event={"ID":"3cd4ec94-319d-4dce-a481-92c410ce307b","Type":"ContainerStarted","Data":"d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc"} Aug 04 15:43:10.061958 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:10.061923 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:10.063109 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:10.063083 2562 patch_prober.go:28] interesting pod/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Aug 04 15:43:10.063237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:10.063133 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Aug 04 15:43:11.062482 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:11.062445 2562 patch_prober.go:28] interesting pod/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Aug 04 15:43:11.062864 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:11.062509 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Aug 04 15:43:12.062179 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:12.062144 2562 patch_prober.go:28] interesting pod/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Aug 04 15:43:12.062373 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:12.062207 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Aug 04 15:43:13.062531 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:13.062491 2562 patch_prober.go:28] interesting pod/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Aug 04 15:43:13.062917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:13.062549 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Aug 04 15:43:14.062207 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:14.062163 2562 patch_prober.go:28] interesting pod/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Aug 04 15:43:14.062445 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:14.062227 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Aug 04 15:43:15.065679 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:15.065649 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:15.066056 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:15.065903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:15.066610 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:15.066591 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:16.304665 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:16.304618 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.45:9004: connect: connection refused" Aug 04 15:43:18.504451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:18.504422 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:43:26.577822 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.577783 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx"] Aug 04 15:43:26.578455 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.578036 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" podUID="43615b8d-837a-4121-a2e9-ec1771cce033" containerName="payload-processing" containerID="cri-o://86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192" gracePeriod=30 Aug 04 15:43:26.585463 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.585435 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2"] Aug 04 15:43:26.585837 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.585805 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerName="payload-pre-processing" containerID="cri-o://a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715" gracePeriod=30 Aug 04 15:43:26.860532 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.860507 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:43:26.863866 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.863840 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:43:26.943125 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.943095 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv"] Aug 04 15:43:26.943326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.943304 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" containerID="cri-o://d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc" gracePeriod=30 Aug 04 15:43:26.986232 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.986203 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f6aab1-009f-40e9-93e6-341a58ea5390-plugins-config-volume\") pod \"98f6aab1-009f-40e9-93e6-341a58ea5390\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " Aug 04 15:43:26.986381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.986244 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43615b8d-837a-4121-a2e9-ec1771cce033-plugins-config-volume\") pod \"43615b8d-837a-4121-a2e9-ec1771cce033\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " Aug 04 15:43:26.986381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.986289 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb56l\" (UniqueName: \"kubernetes.io/projected/98f6aab1-009f-40e9-93e6-341a58ea5390-kube-api-access-wb56l\") pod \"98f6aab1-009f-40e9-93e6-341a58ea5390\" (UID: \"98f6aab1-009f-40e9-93e6-341a58ea5390\") " Aug 04 15:43:26.986381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.986370 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v77g5\" (UniqueName: \"kubernetes.io/projected/43615b8d-837a-4121-a2e9-ec1771cce033-kube-api-access-v77g5\") pod \"43615b8d-837a-4121-a2e9-ec1771cce033\" (UID: \"43615b8d-837a-4121-a2e9-ec1771cce033\") " Aug 04 15:43:26.986661 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.986632 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98f6aab1-009f-40e9-93e6-341a58ea5390-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98f6aab1-009f-40e9-93e6-341a58ea5390" (UID: "98f6aab1-009f-40e9-93e6-341a58ea5390"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:43:26.986749 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.986655 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43615b8d-837a-4121-a2e9-ec1771cce033-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "43615b8d-837a-4121-a2e9-ec1771cce033" (UID: "43615b8d-837a-4121-a2e9-ec1771cce033"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:43:26.988638 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.988614 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43615b8d-837a-4121-a2e9-ec1771cce033-kube-api-access-v77g5" (OuterVolumeSpecName: "kube-api-access-v77g5") pod "43615b8d-837a-4121-a2e9-ec1771cce033" (UID: "43615b8d-837a-4121-a2e9-ec1771cce033"). InnerVolumeSpecName "kube-api-access-v77g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:43:26.988837 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:26.988813 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f6aab1-009f-40e9-93e6-341a58ea5390-kube-api-access-wb56l" (OuterVolumeSpecName: "kube-api-access-wb56l") pod "98f6aab1-009f-40e9-93e6-341a58ea5390" (UID: "98f6aab1-009f-40e9-93e6-341a58ea5390"). InnerVolumeSpecName "kube-api-access-wb56l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:43:27.087735 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.087655 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f6aab1-009f-40e9-93e6-341a58ea5390-plugins-config-volume\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:27.087735 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.087684 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43615b8d-837a-4121-a2e9-ec1771cce033-plugins-config-volume\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:27.087735 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.087694 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb56l\" (UniqueName: \"kubernetes.io/projected/98f6aab1-009f-40e9-93e6-341a58ea5390-kube-api-access-wb56l\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:27.087735 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.087702 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v77g5\" (UniqueName: \"kubernetes.io/projected/43615b8d-837a-4121-a2e9-ec1771cce033-kube-api-access-v77g5\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:27.681869 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.681835 2562 generic.go:356] "Generic (PLEG): container finished" podID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerID="a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715" exitCode=0 Aug 04 15:43:27.682283 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.681882 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" Aug 04 15:43:27.682283 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.681920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" event={"ID":"98f6aab1-009f-40e9-93e6-341a58ea5390","Type":"ContainerDied","Data":"a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715"} Aug 04 15:43:27.682283 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.681976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2" event={"ID":"98f6aab1-009f-40e9-93e6-341a58ea5390","Type":"ContainerDied","Data":"a9bb12b38bd8c89c5471beee669730988bfb55c135baab5527ffbeba629adec7"} Aug 04 15:43:27.682283 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.682005 2562 scope.go:117] "RemoveContainer" containerID="a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715" Aug 04 15:43:27.683731 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.683612 2562 generic.go:356] "Generic (PLEG): container finished" podID="43615b8d-837a-4121-a2e9-ec1771cce033" containerID="86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192" exitCode=0 Aug 04 15:43:27.683731 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.683646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" event={"ID":"43615b8d-837a-4121-a2e9-ec1771cce033","Type":"ContainerDied","Data":"86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192"} Aug 04 15:43:27.683731 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.683725 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" event={"ID":"43615b8d-837a-4121-a2e9-ec1771cce033","Type":"ContainerDied","Data":"1cd06d4d33a995fd608784af6287cd9fe53cac3250708c8701e0df35ab1af056"} Aug 04 15:43:27.683945 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.683795 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx" Aug 04 15:43:27.692710 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.692312 2562 scope.go:117] "RemoveContainer" containerID="a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715" Aug 04 15:43:27.692710 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:43:27.692607 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715\": container with ID starting with a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715 not found: ID does not exist" containerID="a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715" Aug 04 15:43:27.692710 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.692640 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715"} err="failed to get container status \"a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715\": rpc error: code = NotFound desc = could not find container \"a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715\": container with ID starting with a7268e1d61d4e5def103ded73d44b906bf88ec1f0c80f4495fa5c21aeb67c715 not found: ID does not exist" Aug 04 15:43:27.692710 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.692663 2562 scope.go:117] "RemoveContainer" containerID="86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192" Aug 04 15:43:27.703587 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.703435 2562 scope.go:117] "RemoveContainer" containerID="86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192" Aug 04 15:43:27.704153 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:43:27.704125 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192\": container with ID starting with 86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192 not found: ID does not exist" containerID="86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192" Aug 04 15:43:27.704237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.704159 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192"} err="failed to get container status \"86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192\": rpc error: code = NotFound desc = could not find container \"86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192\": container with ID starting with 86939c1eedd408cd8afdef747f76dda25b476e8f4303e72a45b36904a5e91192 not found: ID does not exist" Aug 04 15:43:27.715831 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.715805 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx"] Aug 04 15:43:27.758727 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.758701 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-25b12afe-76c6cc586f-swjbx"] Aug 04 15:43:27.777092 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777067 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28"] Aug 04 15:43:27.777438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777426 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerName="payload-pre-processing" Aug 04 15:43:27.777490 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777439 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerName="payload-pre-processing" Aug 04 15:43:27.777490 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777449 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43615b8d-837a-4121-a2e9-ec1771cce033" containerName="payload-processing" Aug 04 15:43:27.777490 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777454 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="43615b8d-837a-4121-a2e9-ec1771cce033" containerName="payload-processing" Aug 04 15:43:27.777490 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777462 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" Aug 04 15:43:27.777490 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777467 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" Aug 04 15:43:27.777643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777533 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" Aug 04 15:43:27.777643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777542 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="43615b8d-837a-4121-a2e9-ec1771cce033" containerName="payload-processing" Aug 04 15:43:27.777643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.777548 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" containerName="payload-pre-processing" Aug 04 15:43:27.780547 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.780532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.787193 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.787170 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-018493d3-openshift-default-dockercfg-cbv8f\"" Aug 04 15:43:27.794776 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.794758 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2"] Aug 04 15:43:27.796833 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.796815 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-25b12afe-74985759c6-tccc2"] Aug 04 15:43:27.831198 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.831159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28"] Aug 04 15:43:27.895237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-podinfo\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-socket\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-envoy\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da53ade-12ba-4145-99a7-8f2b8253e37b-istiod-ca-cert\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84lh\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-kube-api-access-j84lh\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-token\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895649 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-certs\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895649 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-data\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.895649 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.895573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-credential-socket\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996530 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-data\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996530 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-credential-socket\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-podinfo\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-socket\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-envoy\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da53ade-12ba-4145-99a7-8f2b8253e37b-istiod-ca-cert\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.996765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84lh\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-kube-api-access-j84lh\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-token\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-certs\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996892 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-data\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.996939 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-socket\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997233 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.997129 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-credential-socket\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997376 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.997262 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da53ade-12ba-4145-99a7-8f2b8253e37b-istiod-ca-cert\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.997563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.997387 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-certs\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.998979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.998949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-envoy\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:27.999221 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:27.999201 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-podinfo\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:28.019760 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.019733 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-token\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:28.020877 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.020857 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84lh\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-kube-api-access-j84lh\") pod \"e2e-ait-018493d3-openshift-default-85c676bcbd-csf28\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:28.098110 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.098079 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:28.233550 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.233395 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28"] Aug 04 15:43:28.236498 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:43:28.236468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da53ade_12ba_4145_99a7_8f2b8253e37b.slice/crio-8ce46902bb7eef03baf4360afa14693af909fbf58d6470ca6522a0515fce9764 WatchSource:0}: Error finding container 8ce46902bb7eef03baf4360afa14693af909fbf58d6470ca6522a0515fce9764: Status 404 returned error can't find the container with id 8ce46902bb7eef03baf4360afa14693af909fbf58d6470ca6522a0515fce9764 Aug 04 15:43:28.238769 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.238734 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:28.238865 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.238795 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:28.238865 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.238823 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:28.692528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.692495 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" event={"ID":"4da53ade-12ba-4145-99a7-8f2b8253e37b","Type":"ContainerStarted","Data":"2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886"} Aug 04 15:43:28.692876 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.692552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" event={"ID":"4da53ade-12ba-4145-99a7-8f2b8253e37b","Type":"ContainerStarted","Data":"8ce46902bb7eef03baf4360afa14693af909fbf58d6470ca6522a0515fce9764"} Aug 04 15:43:28.721284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.721236 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podStartSLOduration=1.721221742 podStartE2EDuration="1.721221742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:43:28.721116937 +0000 UTC m=+1938.491510170" watchObservedRunningTime="2026-08-04 15:43:28.721221742 +0000 UTC m=+1938.491614973" Aug 04 15:43:28.782868 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.782840 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43615b8d-837a-4121-a2e9-ec1771cce033" path="/var/lib/kubelet/pods/43615b8d-837a-4121-a2e9-ec1771cce033/volumes" Aug 04 15:43:28.783186 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:28.783173 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98f6aab1-009f-40e9-93e6-341a58ea5390" path="/var/lib/kubelet/pods/98f6aab1-009f-40e9-93e6-341a58ea5390/volumes" Aug 04 15:43:29.099092 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:29.099062 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:29.103789 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:29.103766 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:29.698383 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:29.698331 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:29.699240 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:29.699218 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:30.068400 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:30.068365 2562 patch_prober.go:28] interesting pod/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:43:30.068567 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:30.068422 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:43:31.864889 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.864856 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf"] Aug 04 15:43:31.865224 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.865216 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" Aug 04 15:43:31.865262 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.865226 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" Aug 04 15:43:31.865308 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.865297 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f556d5e0-c5bc-4431-8aac-e36b8b16a960" containerName="istio-proxy" Aug 04 15:43:31.868080 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.868064 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:31.871139 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.871111 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-018493d3\"" Aug 04 15:43:31.871718 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.871704 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-018493d3-dockercfg-lbwzb\"" Aug 04 15:43:31.886994 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:31.886962 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf"] Aug 04 15:43:32.036273 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.036238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js6wt\" (UniqueName: \"kubernetes.io/projected/b677bb47-41df-4523-9f05-88c84c3b6a23-kube-api-access-js6wt\") pod \"payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.036425 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.036296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b677bb47-41df-4523-9f05-88c84c3b6a23-plugins-config-volume\") pod \"payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.137170 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.137098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js6wt\" (UniqueName: \"kubernetes.io/projected/b677bb47-41df-4523-9f05-88c84c3b6a23-kube-api-access-js6wt\") pod \"payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.137311 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.137177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b677bb47-41df-4523-9f05-88c84c3b6a23-plugins-config-volume\") pod \"payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.137888 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.137863 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b677bb47-41df-4523-9f05-88c84c3b6a23-plugins-config-volume\") pod \"payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.145895 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.145866 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js6wt\" (UniqueName: \"kubernetes.io/projected/b677bb47-41df-4523-9f05-88c84c3b6a23-kube-api-access-js6wt\") pod \"payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.187058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.187035 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.202225 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.202203 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:32.328506 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.328473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf"] Aug 04 15:43:32.329489 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:43:32.329467 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb677bb47_41df_4523_9f05_88c84c3b6a23.slice/crio-8743b26fcaf071758e264eb0c1b7d3db1c474f59659da6968ac172c2644778ea WatchSource:0}: Error finding container 8743b26fcaf071758e264eb0c1b7d3db1c474f59659da6968ac172c2644778ea: Status 404 returned error can't find the container with id 8743b26fcaf071758e264eb0c1b7d3db1c474f59659da6968ac172c2644778ea Aug 04 15:43:32.338582 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338557 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-certs\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.338691 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338592 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd4ec94-319d-4dce-a481-92c410ce307b-istiod-ca-cert\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.338691 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338648 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-credential-socket\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.338806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338701 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c8z5\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-kube-api-access-8c8z5\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.338806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338729 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-data\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.338806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338772 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-token\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.338806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338796 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-envoy\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.339013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338826 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-socket\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.339013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338844 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:43:32.339013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.338850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-podinfo\") pod \"3cd4ec94-319d-4dce-a481-92c410ce307b\" (UID: \"3cd4ec94-319d-4dce-a481-92c410ce307b\") " Aug 04 15:43:32.339164 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339048 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:43:32.339164 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339055 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd4ec94-319d-4dce-a481-92c410ce307b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:43:32.339267 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339250 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.339321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339270 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.339321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339285 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd4ec94-319d-4dce-a481-92c410ce307b-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.339321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339284 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:43:32.339321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.339295 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:43:32.341030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.341010 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:43:32.341121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.341095 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:43:32.341599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.341574 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:43:32.341675 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.341594 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-kube-api-access-8c8z5" (OuterVolumeSpecName: "kube-api-access-8c8z5") pod "3cd4ec94-319d-4dce-a481-92c410ce307b" (UID: "3cd4ec94-319d-4dce-a481-92c410ce307b"). InnerVolumeSpecName "kube-api-access-8c8z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:43:32.439896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.439823 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.439896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.439853 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c8z5\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-kube-api-access-8c8z5\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.439896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.439868 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.439896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.439876 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.439896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.439884 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd4ec94-319d-4dce-a481-92c410ce307b-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.439896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.439893 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd4ec94-319d-4dce-a481-92c410ce307b-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:43:32.720178 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.720085 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerID="d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc" exitCode=0 Aug 04 15:43:32.720178 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.720143 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" Aug 04 15:43:32.720421 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.720172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" event={"ID":"3cd4ec94-319d-4dce-a481-92c410ce307b","Type":"ContainerDied","Data":"d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc"} Aug 04 15:43:32.720421 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.720236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv" event={"ID":"3cd4ec94-319d-4dce-a481-92c410ce307b","Type":"ContainerDied","Data":"451aeebe773bc06bea339743372c5f9bcb35907dd29590bbc48b5539ea5927aa"} Aug 04 15:43:32.720421 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.720267 2562 scope.go:117] "RemoveContainer" containerID="d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc" Aug 04 15:43:32.722111 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.722088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" event={"ID":"b677bb47-41df-4523-9f05-88c84c3b6a23","Type":"ContainerStarted","Data":"944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81"} Aug 04 15:43:32.722222 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.722137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" event={"ID":"b677bb47-41df-4523-9f05-88c84c3b6a23","Type":"ContainerStarted","Data":"8743b26fcaf071758e264eb0c1b7d3db1c474f59659da6968ac172c2644778ea"} Aug 04 15:43:32.722222 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.722190 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:32.730527 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.730461 2562 scope.go:117] "RemoveContainer" containerID="f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271" Aug 04 15:43:32.738650 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.738633 2562 scope.go:117] "RemoveContainer" containerID="d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc" Aug 04 15:43:32.738888 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:43:32.738871 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc\": container with ID starting with d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc not found: ID does not exist" containerID="d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc" Aug 04 15:43:32.738961 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.738896 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc"} err="failed to get container status \"d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc\": rpc error: code = NotFound desc = could not find container \"d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc\": container with ID starting with d17a981bf4642866d29dac27c11ec3632d5fe157262c7b5f00b6290e414da0bc not found: ID does not exist" Aug 04 15:43:32.738961 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.738913 2562 scope.go:117] "RemoveContainer" containerID="f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271" Aug 04 15:43:32.739142 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:43:32.739127 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271\": container with ID starting with f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271 not found: ID does not exist" containerID="f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271" Aug 04 15:43:32.739179 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.739145 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271"} err="failed to get container status \"f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271\": rpc error: code = NotFound desc = could not find container \"f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271\": container with ID starting with f54818c939bcf0d06f5191fd6b8757481409addd422829609b970e7c28198271 not found: ID does not exist" Aug 04 15:43:32.744647 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.744608 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" podStartSLOduration=1.744595511 podStartE2EDuration="1.744595511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:43:32.742289202 +0000 UTC m=+1942.512682437" watchObservedRunningTime="2026-08-04 15:43:32.744595511 +0000 UTC m=+1942.514988743" Aug 04 15:43:32.758492 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.758471 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv"] Aug 04 15:43:32.763564 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.763540 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-25b12afe-gw-openshift-default-899c4bdd-sv9pv"] Aug 04 15:43:32.783955 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:32.783928 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" path="/var/lib/kubelet/pods/3cd4ec94-319d-4dce-a481-92c410ce307b/volumes" Aug 04 15:43:43.731813 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:43.731784 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:43:44.699976 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.699938 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Aug 04 15:43:44.700191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.700010 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Aug 04 15:43:44.795231 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.795201 2562 generic.go:356] "Generic (PLEG): container finished" podID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerID="2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886" exitCode=0 Aug 04 15:43:44.795632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.795279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" event={"ID":"4da53ade-12ba-4145-99a7-8f2b8253e37b","Type":"ContainerDied","Data":"2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886"} Aug 04 15:43:44.795685 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.795669 2562 scope.go:117] "RemoveContainer" containerID="2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886" Aug 04 15:43:44.796646 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.796618 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:44.796773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.796681 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:44.796773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:44.796713 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:43:45.807400 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:45.807332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" event={"ID":"4da53ade-12ba-4145-99a7-8f2b8253e37b","Type":"ContainerStarted","Data":"bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3"} Aug 04 15:43:46.099095 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:46.098942 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:46.099288 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:46.099255 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Aug 04 15:43:46.099386 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:46.099323 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Aug 04 15:43:47.099276 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:47.099237 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Aug 04 15:43:47.099764 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:47.099316 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Aug 04 15:43:48.099061 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:48.099015 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Aug 04 15:43:48.099270 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:48.099093 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Aug 04 15:43:49.099270 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:49.099226 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Aug 04 15:43:49.099767 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:49.099301 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Aug 04 15:43:50.099527 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:50.099489 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Aug 04 15:43:50.100152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:50.100109 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Aug 04 15:43:51.102978 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:51.102950 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:51.103383 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:51.103277 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:43:51.103981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:43:51.103963 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:44:01.841455 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:01.841375 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf"] Aug 04 15:44:01.841891 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:01.841624 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" podUID="b677bb47-41df-4523-9f05-88c84c3b6a23" containerName="payload-processing" containerID="cri-o://944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81" gracePeriod=30 Aug 04 15:44:02.110679 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.110614 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:44:02.230555 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.230524 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js6wt\" (UniqueName: \"kubernetes.io/projected/b677bb47-41df-4523-9f05-88c84c3b6a23-kube-api-access-js6wt\") pod \"b677bb47-41df-4523-9f05-88c84c3b6a23\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " Aug 04 15:44:02.230750 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.230582 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b677bb47-41df-4523-9f05-88c84c3b6a23-plugins-config-volume\") pod \"b677bb47-41df-4523-9f05-88c84c3b6a23\" (UID: \"b677bb47-41df-4523-9f05-88c84c3b6a23\") " Aug 04 15:44:02.230967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.230942 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b677bb47-41df-4523-9f05-88c84c3b6a23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b677bb47-41df-4523-9f05-88c84c3b6a23" (UID: "b677bb47-41df-4523-9f05-88c84c3b6a23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:44:02.232796 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.232774 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b677bb47-41df-4523-9f05-88c84c3b6a23-kube-api-access-js6wt" (OuterVolumeSpecName: "kube-api-access-js6wt") pod "b677bb47-41df-4523-9f05-88c84c3b6a23" (UID: "b677bb47-41df-4523-9f05-88c84c3b6a23"). InnerVolumeSpecName "kube-api-access-js6wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:44:02.331873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.331844 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js6wt\" (UniqueName: \"kubernetes.io/projected/b677bb47-41df-4523-9f05-88c84c3b6a23-kube-api-access-js6wt\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:02.331873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.331871 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b677bb47-41df-4523-9f05-88c84c3b6a23-plugins-config-volume\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:02.904039 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.904001 2562 generic.go:356] "Generic (PLEG): container finished" podID="b677bb47-41df-4523-9f05-88c84c3b6a23" containerID="944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81" exitCode=0 Aug 04 15:44:02.904481 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.904051 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" Aug 04 15:44:02.904481 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.904067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" event={"ID":"b677bb47-41df-4523-9f05-88c84c3b6a23","Type":"ContainerDied","Data":"944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81"} Aug 04 15:44:02.904481 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.904116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf" event={"ID":"b677bb47-41df-4523-9f05-88c84c3b6a23","Type":"ContainerDied","Data":"8743b26fcaf071758e264eb0c1b7d3db1c474f59659da6968ac172c2644778ea"} Aug 04 15:44:02.904481 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.904138 2562 scope.go:117] "RemoveContainer" containerID="944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81" Aug 04 15:44:02.913560 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.913536 2562 scope.go:117] "RemoveContainer" containerID="944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81" Aug 04 15:44:02.913815 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:44:02.913794 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81\": container with ID starting with 944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81 not found: ID does not exist" containerID="944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81" Aug 04 15:44:02.913880 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.913824 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81"} err="failed to get container status \"944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81\": rpc error: code = NotFound desc = could not find container \"944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81\": container with ID starting with 944269a7a086f60f96bf7d544d589754a98f95ac6ca0237ef10f729a85adaa81 not found: ID does not exist" Aug 04 15:44:02.923457 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.923435 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf"] Aug 04 15:44:02.928135 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:02.928113 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-018493d3-76c957bf4d-mhhlf"] Aug 04 15:44:03.177403 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.177304 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28"] Aug 04 15:44:03.177565 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.177528 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" containerID="cri-o://bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3" gracePeriod=30 Aug 04 15:44:03.916817 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.916784 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6"] Aug 04 15:44:03.917250 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917232 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" Aug 04 15:44:03.917306 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917256 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" Aug 04 15:44:03.917306 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917287 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b677bb47-41df-4523-9f05-88c84c3b6a23" containerName="payload-processing" Aug 04 15:44:03.917306 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917297 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b677bb47-41df-4523-9f05-88c84c3b6a23" containerName="payload-processing" Aug 04 15:44:03.917432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917310 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" Aug 04 15:44:03.917432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917319 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" Aug 04 15:44:03.917432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917427 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" Aug 04 15:44:03.917548 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.917439 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b677bb47-41df-4523-9f05-88c84c3b6a23" containerName="payload-processing" Aug 04 15:44:03.920640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.920622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:03.924787 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.924771 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-cde38272-openshift-default-dockercfg-nb9tv\"" Aug 04 15:44:03.935447 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:03.935427 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6"] Aug 04 15:44:04.048517 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-certs\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-token\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istiod-ca-cert\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-podinfo\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-974t4\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-kube-api-access-974t4\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-credential-socket\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-data\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-socket\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.048847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.048803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-envoy\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149482 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-certs\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149644 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-token\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149644 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istiod-ca-cert\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149644 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-podinfo\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149644 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-974t4\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-kube-api-access-974t4\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-credential-socket\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-data\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-socket\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.149863 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-envoy\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.150072 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.149913 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-certs\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.150072 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.150012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-credential-socket\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.150178 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.150134 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-socket\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.150246 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.150175 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-data\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.150453 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.150432 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istiod-ca-cert\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.151980 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.151959 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-envoy\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.152191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.152171 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-podinfo\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.158247 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.158219 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-token\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.158339 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.158274 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-974t4\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-kube-api-access-974t4\") pod \"e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.230601 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.230519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:04.381704 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.381678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6"] Aug 04 15:44:04.382883 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:44:04.382854 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69ee7d8_c1c0_4005_a2f3_60fe776eb9c0.slice/crio-dacae27d9ebd00fb52fe9cddd4fa07784efb06b6c9d9e17c4644fd7113a98f7b WatchSource:0}: Error finding container dacae27d9ebd00fb52fe9cddd4fa07784efb06b6c9d9e17c4644fd7113a98f7b: Status 404 returned error can't find the container with id dacae27d9ebd00fb52fe9cddd4fa07784efb06b6c9d9e17c4644fd7113a98f7b Aug 04 15:44:04.385246 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.385210 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:44:04.385337 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.385272 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:44:04.385337 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.385303 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:44:04.785123 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.785092 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b677bb47-41df-4523-9f05-88c84c3b6a23" path="/var/lib/kubelet/pods/b677bb47-41df-4523-9f05-88c84c3b6a23/volumes" Aug 04 15:44:04.918632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.918601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" event={"ID":"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0","Type":"ContainerStarted","Data":"8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed"} Aug 04 15:44:04.918990 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.918674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" event={"ID":"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0","Type":"ContainerStarted","Data":"dacae27d9ebd00fb52fe9cddd4fa07784efb06b6c9d9e17c4644fd7113a98f7b"} Aug 04 15:44:04.942724 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:04.942677 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podStartSLOduration=1.942663016 podStartE2EDuration="1.942663016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:44:04.941454078 +0000 UTC m=+1974.711847315" watchObservedRunningTime="2026-08-04 15:44:04.942663016 +0000 UTC m=+1974.713056247" Aug 04 15:44:05.231416 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:05.231313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:05.236039 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:05.236016 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:05.923981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:05.923948 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:05.924873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:05.924854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:06.105738 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:06.105705 2562 patch_prober.go:28] interesting pod/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:44:06.105885 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:06.105761 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:44:08.431721 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.431699 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:44:08.592766 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592733 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-credential-socket\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.592766 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592770 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-envoy\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593017 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592791 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da53ade-12ba-4145-99a7-8f2b8253e37b-istiod-ca-cert\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593017 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592822 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j84lh\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-kube-api-access-j84lh\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593017 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592888 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-certs\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593017 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592924 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-data\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593017 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.592991 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-socket\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593277 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593012 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:08.593277 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593024 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-token\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593277 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593091 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-podinfo\") pod \"4da53ade-12ba-4145-99a7-8f2b8253e37b\" (UID: \"4da53ade-12ba-4145-99a7-8f2b8253e37b\") " Aug 04 15:44:08.593475 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593224 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4da53ade-12ba-4145-99a7-8f2b8253e37b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:44:08.593475 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593293 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:08.593475 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593272 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:08.593794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593492 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-data" (OuterVolumeSpecName: "istio-data") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:08.593794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593502 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.593794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593524 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4da53ade-12ba-4145-99a7-8f2b8253e37b-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.593794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593539 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.593794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.593552 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.595237 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.595211 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-kube-api-access-j84lh" (OuterVolumeSpecName: "kube-api-access-j84lh") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "kube-api-access-j84lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:44:08.595392 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.595281 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:44:08.595686 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.595662 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:08.595686 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.595664 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-token" (OuterVolumeSpecName: "istio-token") pod "4da53ade-12ba-4145-99a7-8f2b8253e37b" (UID: "4da53ade-12ba-4145-99a7-8f2b8253e37b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:44:08.694313 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.694279 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.694313 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.694306 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.694313 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.694315 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.694557 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.694323 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j84lh\" (UniqueName: \"kubernetes.io/projected/4da53ade-12ba-4145-99a7-8f2b8253e37b-kube-api-access-j84lh\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.694557 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.694332 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4da53ade-12ba-4145-99a7-8f2b8253e37b-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:08.944167 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.944076 2562 generic.go:356] "Generic (PLEG): container finished" podID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerID="bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3" exitCode=0 Aug 04 15:44:08.944167 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.944130 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" Aug 04 15:44:08.944391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.944167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" event={"ID":"4da53ade-12ba-4145-99a7-8f2b8253e37b","Type":"ContainerDied","Data":"bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3"} Aug 04 15:44:08.944391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.944222 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28" event={"ID":"4da53ade-12ba-4145-99a7-8f2b8253e37b","Type":"ContainerDied","Data":"8ce46902bb7eef03baf4360afa14693af909fbf58d6470ca6522a0515fce9764"} Aug 04 15:44:08.944391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.944246 2562 scope.go:117] "RemoveContainer" containerID="bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3" Aug 04 15:44:08.953384 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.953366 2562 scope.go:117] "RemoveContainer" containerID="2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886" Aug 04 15:44:08.961493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.961475 2562 scope.go:117] "RemoveContainer" containerID="bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3" Aug 04 15:44:08.961769 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:44:08.961744 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3\": container with ID starting with bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3 not found: ID does not exist" containerID="bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3" Aug 04 15:44:08.961833 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.961783 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3"} err="failed to get container status \"bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3\": rpc error: code = NotFound desc = could not find container \"bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3\": container with ID starting with bdc3a809125aab3da16c26b7d8624404521f162b85729972ebc8bf72e1b966a3 not found: ID does not exist" Aug 04 15:44:08.961833 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.961808 2562 scope.go:117] "RemoveContainer" containerID="2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886" Aug 04 15:44:08.962072 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:44:08.962056 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886\": container with ID starting with 2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886 not found: ID does not exist" containerID="2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886" Aug 04 15:44:08.962117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.962076 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886"} err="failed to get container status \"2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886\": rpc error: code = NotFound desc = could not find container \"2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886\": container with ID starting with 2317521a0889a9cab5db5a839465286eafdecd47333385ce28d478ab7dd0d886 not found: ID does not exist" Aug 04 15:44:08.966504 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.966484 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28"] Aug 04 15:44:08.974804 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:08.974784 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-018493d3-openshift-default-85c676bcbd-csf28"] Aug 04 15:44:10.784991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:10.784956 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" path="/var/lib/kubelet/pods/4da53ade-12ba-4145-99a7-8f2b8253e37b/volumes" Aug 04 15:44:19.002999 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:19.002923 2562 generic.go:356] "Generic (PLEG): container finished" podID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerID="8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed" exitCode=0 Aug 04 15:44:19.003386 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:19.002991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" event={"ID":"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0","Type":"ContainerDied","Data":"8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed"} Aug 04 15:44:19.003488 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:19.003463 2562 scope.go:117] "RemoveContainer" containerID="8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed" Aug 04 15:44:19.004428 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:19.004385 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:44:19.004495 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:19.004455 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:44:19.004495 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:19.004489 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:44:20.014851 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:20.014813 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" event={"ID":"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0","Type":"ContainerStarted","Data":"bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d"} Aug 04 15:44:20.231289 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:20.231249 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:20.232486 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:20.232460 2562 patch_prober.go:28] interesting pod/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Aug 04 15:44:20.232595 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:20.232510 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Aug 04 15:44:20.924278 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:20.924242 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:21.230985 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:21.230893 2562 patch_prober.go:28] interesting pod/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Aug 04 15:44:21.230985 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:21.230969 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Aug 04 15:44:22.231107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:22.231076 2562 patch_prober.go:28] interesting pod/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Aug 04 15:44:22.231512 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:22.231141 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Aug 04 15:44:23.231092 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:23.231048 2562 patch_prober.go:28] interesting pod/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Aug 04 15:44:23.231300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:23.231114 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Aug 04 15:44:24.230979 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:24.230940 2562 patch_prober.go:28] interesting pod/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Aug 04 15:44:24.231160 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:24.231012 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Aug 04 15:44:25.235903 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:25.235874 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:25.236967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:25.236951 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:38.461753 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:38.461723 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6"] Aug 04 15:44:38.462152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:38.461934 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" containerID="cri-o://bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d" gracePeriod=30 Aug 04 15:44:40.238317 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:40.238284 2562 patch_prober.go:28] interesting pod/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:44:40.238707 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:40.238362 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:44:43.715599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.715577 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:43.807583 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807555 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istiod-ca-cert\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807589 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-974t4\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-kube-api-access-974t4\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807611 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-token\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807646 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-envoy\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807692 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-socket\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807734 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807722 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-credential-socket\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807993 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807763 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-certs\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807993 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807836 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-data\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.807993 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.807868 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-podinfo\") pod \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\" (UID: \"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0\") " Aug 04 15:44:43.808165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808013 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:43.808165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808023 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:43.808165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808053 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:43.808326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808211 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:43.808326 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808245 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:44:43.808645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808501 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.808645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808524 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.808645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808537 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.808645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808551 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.808645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.808564 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.809972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.809947 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:44:43.810088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.809988 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-kube-api-access-974t4" (OuterVolumeSpecName: "kube-api-access-974t4") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "kube-api-access-974t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:44:43.810088 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.810052 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:44:43.810197 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.810184 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" (UID: "b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:44:43.909830 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.909805 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.909830 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.909826 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-974t4\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-kube-api-access-974t4\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.909830 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.909836 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:43.910020 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:43.909845 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:44:44.141308 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.141215 2562 generic.go:356] "Generic (PLEG): container finished" podID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerID="bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d" exitCode=0 Aug 04 15:44:44.141308 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.141267 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" Aug 04 15:44:44.141565 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.141302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" event={"ID":"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0","Type":"ContainerDied","Data":"bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d"} Aug 04 15:44:44.141565 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.141373 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6" event={"ID":"b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0","Type":"ContainerDied","Data":"dacae27d9ebd00fb52fe9cddd4fa07784efb06b6c9d9e17c4644fd7113a98f7b"} Aug 04 15:44:44.141565 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.141395 2562 scope.go:117] "RemoveContainer" containerID="bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d" Aug 04 15:44:44.151157 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.151142 2562 scope.go:117] "RemoveContainer" containerID="8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed" Aug 04 15:44:44.160108 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.160088 2562 scope.go:117] "RemoveContainer" containerID="bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d" Aug 04 15:44:44.160395 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:44:44.160367 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d\": container with ID starting with bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d not found: ID does not exist" containerID="bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d" Aug 04 15:44:44.160529 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.160406 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d"} err="failed to get container status \"bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d\": rpc error: code = NotFound desc = could not find container \"bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d\": container with ID starting with bc11608d938ccb28205bc2a00f73d11272b6d1f52bc376dd2f2fea335b0d387d not found: ID does not exist" Aug 04 15:44:44.160529 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.160432 2562 scope.go:117] "RemoveContainer" containerID="8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed" Aug 04 15:44:44.160687 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:44:44.160667 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed\": container with ID starting with 8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed not found: ID does not exist" containerID="8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed" Aug 04 15:44:44.160743 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.160696 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed"} err="failed to get container status \"8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed\": rpc error: code = NotFound desc = could not find container \"8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed\": container with ID starting with 8825de3ea0d46facd72b4b5e682063167cdb65126d4806ae95ba7755c505d9ed not found: ID does not exist" Aug 04 15:44:44.164230 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.164208 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6"] Aug 04 15:44:44.167438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.167418 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-cde38272-openshift-default-7c57c5b54d-sf4h6"] Aug 04 15:44:44.784527 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:44:44.784493 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" path="/var/lib/kubelet/pods/b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0/volumes" Aug 04 15:45:00.132703 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.132666 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99"] Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133021 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133032 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133043 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133049 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133055 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133061 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133069 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133075 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133130 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd4ec94-319d-4dce-a481-92c410ce307b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133141 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133147 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da53ade-12ba-4145-99a7-8f2b8253e37b" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133152 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" Aug 04 15:45:00.133148 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.133157 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69ee7d8-c1c0-4005-a2f3-60fe776eb9c0" containerName="istio-proxy" Aug 04 15:45:00.136034 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.136016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" Aug 04 15:45:00.138602 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.138578 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2g8l5\"" Aug 04 15:45:00.143784 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.143763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99"] Aug 04 15:45:00.146841 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.146820 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" Aug 04 15:45:00.278406 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:00.278382 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99"] Aug 04 15:45:00.280111 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:45:00.280078 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b9a938_b1bc_4e70_abb2_684dd7208fce.slice/crio-c446904ae94d078c92d5f7417d1a1760934cd03d6f48e209c93c296023b926a5 WatchSource:0}: Error finding container c446904ae94d078c92d5f7417d1a1760934cd03d6f48e209c93c296023b926a5: Status 404 returned error can't find the container with id c446904ae94d078c92d5f7417d1a1760934cd03d6f48e209c93c296023b926a5 Aug 04 15:45:01.234310 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:01.234277 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2b9a938-b1bc-4e70-abb2-684dd7208fce" containerID="8b567f990f07722803597bc6d996bdd3b5c5d485d79abb8f374fb8bd351a1bc7" exitCode=0 Aug 04 15:45:01.234659 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:01.234341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" event={"ID":"c2b9a938-b1bc-4e70-abb2-684dd7208fce","Type":"ContainerDied","Data":"8b567f990f07722803597bc6d996bdd3b5c5d485d79abb8f374fb8bd351a1bc7"} Aug 04 15:45:01.234659 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:01.234419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" event={"ID":"c2b9a938-b1bc-4e70-abb2-684dd7208fce","Type":"ContainerStarted","Data":"c446904ae94d078c92d5f7417d1a1760934cd03d6f48e209c93c296023b926a5"} Aug 04 15:45:02.376858 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:02.376836 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" Aug 04 15:45:03.247154 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:03.247072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" event={"ID":"c2b9a938-b1bc-4e70-abb2-684dd7208fce","Type":"ContainerDied","Data":"c446904ae94d078c92d5f7417d1a1760934cd03d6f48e209c93c296023b926a5"} Aug 04 15:45:03.247154 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:03.247119 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c446904ae94d078c92d5f7417d1a1760934cd03d6f48e209c93c296023b926a5" Aug 04 15:45:03.247154 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:45:03.247087 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-bsc99" Aug 04 15:46:37.754512 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.754476 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj"] Aug 04 15:46:37.754991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.754818 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b9a938-b1bc-4e70-abb2-684dd7208fce" containerName="cleanup" Aug 04 15:46:37.754991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.754829 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b9a938-b1bc-4e70-abb2-684dd7208fce" containerName="cleanup" Aug 04 15:46:37.754991 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.754900 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b9a938-b1bc-4e70-abb2-684dd7208fce" containerName="cleanup" Aug 04 15:46:37.756965 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.756948 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.759567 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.759543 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ff74c09a-openshift-default-dockercfg-c9rzl\"" Aug 04 15:46:37.784139 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.784106 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj"] Aug 04 15:46:37.877521 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-credential-socket\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877702 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-socket\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877702 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-certs\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877702 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-data\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877871 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-envoy\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877871 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgxk\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-kube-api-access-vqgxk\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877871 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-podinfo\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.877871 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istiod-ca-cert\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.878060 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.877958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-token\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979057 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-data\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-envoy\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgxk\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-kube-api-access-vqgxk\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-podinfo\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istiod-ca-cert\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-token\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979245 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-credential-socket\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979686 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-socket\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979686 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-certs\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979686 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-data\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979852 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979678 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-credential-socket\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979852 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979755 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-certs\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.979966 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.979846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-socket\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.980124 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.980098 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istiod-ca-cert\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.981504 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.981483 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-envoy\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.981702 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.981685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-podinfo\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.987285 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.987257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-token\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:37.987285 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:37.987267 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgxk\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-kube-api-access-vqgxk\") pod \"e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:38.066695 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.066664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:38.207849 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.207818 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj"] Aug 04 15:46:38.209429 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:46:38.209398 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f47a4a_e0d9_4fa0_8519_b3f68d721b82.slice/crio-6cc18c8392548dc7a3e8bd2d641d8860c3ef1a62047aceea3f700e63073d036d WatchSource:0}: Error finding container 6cc18c8392548dc7a3e8bd2d641d8860c3ef1a62047aceea3f700e63073d036d: Status 404 returned error can't find the container with id 6cc18c8392548dc7a3e8bd2d641d8860c3ef1a62047aceea3f700e63073d036d Aug 04 15:46:38.211545 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.211514 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:46:38.211630 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.211575 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:46:38.211630 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.211603 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:46:38.747390 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.747326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" event={"ID":"06f47a4a-e0d9-4fa0-8519-b3f68d721b82","Type":"ContainerStarted","Data":"104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b"} Aug 04 15:46:38.747561 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.747433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" event={"ID":"06f47a4a-e0d9-4fa0-8519-b3f68d721b82","Type":"ContainerStarted","Data":"6cc18c8392548dc7a3e8bd2d641d8860c3ef1a62047aceea3f700e63073d036d"} Aug 04 15:46:38.773542 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:38.773494 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podStartSLOduration=1.7734797979999999 podStartE2EDuration="1.773479798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:46:38.770911156 +0000 UTC m=+2128.541304389" watchObservedRunningTime="2026-08-04 15:46:38.773479798 +0000 UTC m=+2128.543873030" Aug 04 15:46:39.066769 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:39.066740 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:39.071802 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:39.071779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:39.753119 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:39.753088 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:39.754001 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:39.753981 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:54.755037 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.754997 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Aug 04 15:46:54.755546 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.755062 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Aug 04 15:46:54.854589 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.854557 2562 generic.go:356] "Generic (PLEG): container finished" podID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerID="104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b" exitCode=0 Aug 04 15:46:54.854763 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.854627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" event={"ID":"06f47a4a-e0d9-4fa0-8519-b3f68d721b82","Type":"ContainerDied","Data":"104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b"} Aug 04 15:46:54.855015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.854999 2562 scope.go:117] "RemoveContainer" containerID="104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b" Aug 04 15:46:54.855968 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.855941 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:46:54.856058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.856014 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:46:54.856058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:54.856046 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:46:55.863121 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:55.863086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" event={"ID":"06f47a4a-e0d9-4fa0-8519-b3f68d721b82","Type":"ContainerStarted","Data":"d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057"} Aug 04 15:46:56.067013 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:56.066978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:46:56.067235 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:56.067215 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Aug 04 15:46:56.067288 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:56.067269 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Aug 04 15:46:57.067072 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:57.067033 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Aug 04 15:46:57.067504 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:57.067090 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Aug 04 15:46:58.067269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:58.067230 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Aug 04 15:46:58.067679 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:58.067301 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Aug 04 15:46:59.067755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:59.067716 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Aug 04 15:46:59.068139 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:46:59.067785 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Aug 04 15:47:00.067438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:00.067403 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Aug 04 15:47:00.067628 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:00.067480 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Aug 04 15:47:01.071281 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:01.071210 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:47:01.071667 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:01.071601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:47:01.072329 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:01.072308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:47:30.748473 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:30.748442 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj"] Aug 04 15:47:30.749022 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:30.748663 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" containerID="cri-o://d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057" gracePeriod=30 Aug 04 15:47:31.074302 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:31.074273 2562 patch_prober.go:28] interesting pod/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:47:31.074485 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:31.074330 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:47:35.990998 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:35.990975 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:47:36.078122 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.078086 2562 generic.go:356] "Generic (PLEG): container finished" podID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerID="d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057" exitCode=0 Aug 04 15:47:36.078301 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.078142 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" Aug 04 15:47:36.078301 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.078172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" event={"ID":"06f47a4a-e0d9-4fa0-8519-b3f68d721b82","Type":"ContainerDied","Data":"d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057"} Aug 04 15:47:36.078301 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.078250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj" event={"ID":"06f47a4a-e0d9-4fa0-8519-b3f68d721b82","Type":"ContainerDied","Data":"6cc18c8392548dc7a3e8bd2d641d8860c3ef1a62047aceea3f700e63073d036d"} Aug 04 15:47:36.078301 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.078279 2562 scope.go:117] "RemoveContainer" containerID="d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057" Aug 04 15:47:36.087243 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.087229 2562 scope.go:117] "RemoveContainer" containerID="104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b" Aug 04 15:47:36.095109 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.095094 2562 scope.go:117] "RemoveContainer" containerID="d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057" Aug 04 15:47:36.095405 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:47:36.095383 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057\": container with ID starting with d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057 not found: ID does not exist" containerID="d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057" Aug 04 15:47:36.095478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.095417 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057"} err="failed to get container status \"d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057\": rpc error: code = NotFound desc = could not find container \"d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057\": container with ID starting with d3dce55dd589e28d2f6e69293925322ae02b435c13a625bc69c616b39298f057 not found: ID does not exist" Aug 04 15:47:36.095478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.095438 2562 scope.go:117] "RemoveContainer" containerID="104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b" Aug 04 15:47:36.095687 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:47:36.095672 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b\": container with ID starting with 104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b not found: ID does not exist" containerID="104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b" Aug 04 15:47:36.095729 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.095691 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b"} err="failed to get container status \"104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b\": rpc error: code = NotFound desc = could not find container \"104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b\": container with ID starting with 104158f3e1d629c7023ef84f1d3c3550751cf29b5d6c2095b94d96b0707db93b not found: ID does not exist" Aug 04 15:47:36.102886 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.102868 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-certs\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.102955 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.102898 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqgxk\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-kube-api-access-vqgxk\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.102955 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.102936 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-podinfo\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103064 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.102968 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-socket\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103064 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.102998 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-envoy\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103064 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istiod-ca-cert\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103057 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-credential-socket\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103106 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-data\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103157 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:47:36.103395 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103221 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-token\") pod \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\" (UID: \"06f47a4a-e0d9-4fa0-8519-b3f68d721b82\") " Aug 04 15:47:36.103395 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103247 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:47:36.103503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103408 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:47:36.103503 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103488 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-data" (OuterVolumeSpecName: "istio-data") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:47:36.103599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103513 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:47:36.103801 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103783 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.103853 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103808 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.103853 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103822 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.103853 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103835 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.103853 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.103849 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.105418 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.105395 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:47:36.105508 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.105418 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-token" (OuterVolumeSpecName: "istio-token") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:47:36.105653 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.105640 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-kube-api-access-vqgxk" (OuterVolumeSpecName: "kube-api-access-vqgxk") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "kube-api-access-vqgxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:47:36.105838 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.105816 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06f47a4a-e0d9-4fa0-8519-b3f68d721b82" (UID: "06f47a4a-e0d9-4fa0-8519-b3f68d721b82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:47:36.205038 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.205014 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqgxk\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-kube-api-access-vqgxk\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.205038 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.205035 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.205163 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.205045 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.205163 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.205053 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f47a4a-e0d9-4fa0-8519-b3f68d721b82-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:47:36.401690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.401654 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj"] Aug 04 15:47:36.405652 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.405626 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ff74c09a-openshift-default-7f6d9cfb96-sfjdj"] Aug 04 15:47:36.784106 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:47:36.784027 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" path="/var/lib/kubelet/pods/06f47a4a-e0d9-4fa0-8519-b3f68d721b82/volumes" Aug 04 15:49:46.936569 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.936536 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz"] Aug 04 15:49:46.937159 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.937060 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" Aug 04 15:49:46.937159 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.937080 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" Aug 04 15:49:46.937283 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.937183 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" Aug 04 15:49:46.937283 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.937197 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" Aug 04 15:49:46.940300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.940277 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:46.943231 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.943208 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e4d56b38-openshift-default-dockercfg-jfc7w\"" Aug 04 15:49:46.960217 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:46.960195 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz"] Aug 04 15:49:47.057210 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-podinfo\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-data\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a804636-d17c-46d0-a97c-b51181d53dc4-istiod-ca-cert\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-certs\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrv56\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-kube-api-access-mrv56\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-envoy\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-credential-socket\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-token\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.057706 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.057572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-socket\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.158921 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.158888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-data\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159084 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.158927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a804636-d17c-46d0-a97c-b51181d53dc4-istiod-ca-cert\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159084 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.158948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-certs\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159084 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.158973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrv56\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-kube-api-access-mrv56\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159084 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-envoy\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159084 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-credential-socket\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159336 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-token\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159336 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-socket\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159336 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-podinfo\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159336 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-data\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159569 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-certs\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-credential-socket\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159689 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-socket\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.159805 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.159786 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a804636-d17c-46d0-a97c-b51181d53dc4-istiod-ca-cert\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.161750 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.161723 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-envoy\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.161889 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.161874 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-podinfo\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.174971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.174943 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-token\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.175541 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.175520 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrv56\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-kube-api-access-mrv56\") pod \"e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.250445 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.250383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:47.414787 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.414755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz"] Aug 04 15:49:47.417958 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:49:47.417930 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a804636_d17c_46d0_a97c_b51181d53dc4.slice/crio-57c325df6f829b2604b0b38b55f5800dc0908c3a8054b9021df0da6840dbee9f WatchSource:0}: Error finding container 57c325df6f829b2604b0b38b55f5800dc0908c3a8054b9021df0da6840dbee9f: Status 404 returned error can't find the container with id 57c325df6f829b2604b0b38b55f5800dc0908c3a8054b9021df0da6840dbee9f Aug 04 15:49:47.420119 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.420087 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:49:47.420180 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.420154 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:49:47.420218 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.420183 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:49:47.756884 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.756851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" event={"ID":"2a804636-d17c-46d0-a97c-b51181d53dc4","Type":"ContainerStarted","Data":"6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482"} Aug 04 15:49:47.757037 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.756908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" event={"ID":"2a804636-d17c-46d0-a97c-b51181d53dc4","Type":"ContainerStarted","Data":"57c325df6f829b2604b0b38b55f5800dc0908c3a8054b9021df0da6840dbee9f"} Aug 04 15:49:47.779883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:47.779839 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podStartSLOduration=1.77982492 podStartE2EDuration="1.77982492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:49:47.777760998 +0000 UTC m=+2317.548154243" watchObservedRunningTime="2026-08-04 15:49:47.77982492 +0000 UTC m=+2317.550218155" Aug 04 15:49:48.251438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:48.251409 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:48.256068 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:48.256045 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:48.762804 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:48.762773 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:49:48.763647 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:49:48.763622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:50:03.764888 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.764852 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Aug 04 15:50:03.765311 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.764906 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Aug 04 15:50:03.849085 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.849053 2562 generic.go:356] "Generic (PLEG): container finished" podID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerID="6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482" exitCode=0 Aug 04 15:50:03.849258 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.849127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" event={"ID":"2a804636-d17c-46d0-a97c-b51181d53dc4","Type":"ContainerDied","Data":"6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482"} Aug 04 15:50:03.849651 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.849635 2562 scope.go:117] "RemoveContainer" containerID="6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482" Aug 04 15:50:03.850738 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.850709 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:50:03.850818 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.850775 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:50:03.850862 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:03.850824 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:50:04.856755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:04.856720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" event={"ID":"2a804636-d17c-46d0-a97c-b51181d53dc4","Type":"ContainerStarted","Data":"fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f"} Aug 04 15:50:05.251009 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:05.250919 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:50:05.251165 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:05.251145 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Aug 04 15:50:05.251207 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:05.251193 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Aug 04 15:50:06.251167 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:06.251131 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Aug 04 15:50:06.251599 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:06.251187 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Aug 04 15:50:07.251218 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:07.251179 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Aug 04 15:50:07.251639 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:07.251236 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Aug 04 15:50:08.251421 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:08.251383 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Aug 04 15:50:08.251771 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:08.251446 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Aug 04 15:50:09.251249 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:09.251212 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Aug 04 15:50:09.251440 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:09.251275 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Aug 04 15:50:10.255360 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:10.255326 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:50:10.255716 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:10.255617 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:50:10.256206 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:10.256187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:50:54.228742 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.228714 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz"] Aug 04 15:50:54.229255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.229067 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" Aug 04 15:50:54.229255 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.229079 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f47a4a-e0d9-4fa0-8519-b3f68d721b82" containerName="istio-proxy" Aug 04 15:50:54.231383 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.231328 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:54.234051 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.234029 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 04 15:50:54.234051 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.234047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2g8l5\"" Aug 04 15:50:54.239873 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.239849 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz"] Aug 04 15:50:54.261091 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.261064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb642bbf-a722-4176-af86-65d5eb176688-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz\" (UID: \"cb642bbf-a722-4176-af86-65d5eb176688\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:54.361587 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.361563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb642bbf-a722-4176-af86-65d5eb176688-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz\" (UID: \"cb642bbf-a722-4176-af86-65d5eb176688\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:54.362174 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.362148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb642bbf-a722-4176-af86-65d5eb176688-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz\" (UID: \"cb642bbf-a722-4176-af86-65d5eb176688\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:54.543910 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.543873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:54.674746 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:54.674718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz"] Aug 04 15:50:54.676791 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:50:54.676763 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb642bbf_a722_4176_af86_65d5eb176688.slice/crio-e2c0d8c422d2d1ee6e4eda8a92c055da5acf9f663fdc146ea7611f5fbe3ea265 WatchSource:0}: Error finding container e2c0d8c422d2d1ee6e4eda8a92c055da5acf9f663fdc146ea7611f5fbe3ea265: Status 404 returned error can't find the container with id e2c0d8c422d2d1ee6e4eda8a92c055da5acf9f663fdc146ea7611f5fbe3ea265 Aug 04 15:50:55.133086 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:55.133053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" event={"ID":"cb642bbf-a722-4176-af86-65d5eb176688","Type":"ContainerStarted","Data":"5c915712a527d2851729ad3861b6faa30f2b31c7e1b47c89c156089a38439ada"} Aug 04 15:50:55.133269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:55.133109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" event={"ID":"cb642bbf-a722-4176-af86-65d5eb176688","Type":"ContainerStarted","Data":"e2c0d8c422d2d1ee6e4eda8a92c055da5acf9f663fdc146ea7611f5fbe3ea265"} Aug 04 15:50:55.150579 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:55.150533 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" podStartSLOduration=1.150518914 podStartE2EDuration="1.150518914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:50:55.149748344 +0000 UTC m=+2384.920141576" watchObservedRunningTime="2026-08-04 15:50:55.150518914 +0000 UTC m=+2384.920912185" Aug 04 15:50:56.139520 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:56.139484 2562 generic.go:356] "Generic (PLEG): container finished" podID="cb642bbf-a722-4176-af86-65d5eb176688" containerID="5c915712a527d2851729ad3861b6faa30f2b31c7e1b47c89c156089a38439ada" exitCode=0 Aug 04 15:50:56.139924 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:56.139578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" event={"ID":"cb642bbf-a722-4176-af86-65d5eb176688","Type":"ContainerDied","Data":"5c915712a527d2851729ad3861b6faa30f2b31c7e1b47c89c156089a38439ada"} Aug 04 15:50:57.277673 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:57.277650 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:57.389333 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:57.389300 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb642bbf-a722-4176-af86-65d5eb176688-maas-api-service-ca\") pod \"cb642bbf-a722-4176-af86-65d5eb176688\" (UID: \"cb642bbf-a722-4176-af86-65d5eb176688\") " Aug 04 15:50:57.389632 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:57.389611 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb642bbf-a722-4176-af86-65d5eb176688-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb642bbf-a722-4176-af86-65d5eb176688" (UID: "cb642bbf-a722-4176-af86-65d5eb176688"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:50:57.490808 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:57.490721 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb642bbf-a722-4176-af86-65d5eb176688-maas-api-service-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:50:58.154419 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:58.154388 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" Aug 04 15:50:58.154617 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:58.154423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz" event={"ID":"cb642bbf-a722-4176-af86-65d5eb176688","Type":"ContainerDied","Data":"e2c0d8c422d2d1ee6e4eda8a92c055da5acf9f663fdc146ea7611f5fbe3ea265"} Aug 04 15:50:58.154617 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:50:58.154471 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2c0d8c422d2d1ee6e4eda8a92c055da5acf9f663fdc146ea7611f5fbe3ea265" Aug 04 15:51:09.986201 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:51:09.986166 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz"] Aug 04 15:51:09.995505 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:51:09.995480 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4d56b38-btwjz"] Aug 04 15:51:10.783817 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:51:10.783783 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb642bbf-a722-4176-af86-65d5eb176688" path="/var/lib/kubelet/pods/cb642bbf-a722-4176-af86-65d5eb176688/volumes" Aug 04 15:52:25.155847 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:25.155812 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz"] Aug 04 15:52:25.156421 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:25.156077 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" containerID="cri-o://fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f" gracePeriod=30 Aug 04 15:52:25.259956 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:25.259919 2562 patch_prober.go:28] interesting pod/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:52:25.260251 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:25.260213 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:52:30.396128 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.396096 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:52:30.436910 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.436835 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-token\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.436910 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.436882 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrv56\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-kube-api-access-mrv56\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.436910 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.436910 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-envoy\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.436958 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-socket\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437012 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-certs\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437050 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-data\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437084 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a804636-d17c-46d0-a97c-b51181d53dc4-istiod-ca-cert\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437137 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-podinfo\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437166 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437163 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-credential-socket\") pod \"2a804636-d17c-46d0-a97c-b51181d53dc4\" (UID: \"2a804636-d17c-46d0-a97c-b51181d53dc4\") " Aug 04 15:52:30.437509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437272 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:52:30.437509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437309 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:52:30.437509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437364 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:52:30.437765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437539 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.437765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437558 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.437765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437571 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.437765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437668 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a804636-d17c-46d0-a97c-b51181d53dc4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:52:30.437765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.437745 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:52:30.439290 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.439260 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:52:30.439634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.439612 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-kube-api-access-mrv56" (OuterVolumeSpecName: "kube-api-access-mrv56") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "kube-api-access-mrv56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:52:30.439941 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.439922 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:52:30.439941 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.439926 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a804636-d17c-46d0-a97c-b51181d53dc4" (UID: "2a804636-d17c-46d0-a97c-b51181d53dc4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:52:30.538713 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.538667 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.538713 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.538709 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.538713 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.538720 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.538713 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.538728 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrv56\" (UniqueName: \"kubernetes.io/projected/2a804636-d17c-46d0-a97c-b51181d53dc4-kube-api-access-mrv56\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.538987 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.538737 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a804636-d17c-46d0-a97c-b51181d53dc4-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.538987 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.538746 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a804636-d17c-46d0-a97c-b51181d53dc4-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:52:30.638373 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.638321 2562 generic.go:356] "Generic (PLEG): container finished" podID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerID="fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f" exitCode=0 Aug 04 15:52:30.638538 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.638384 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" Aug 04 15:52:30.638538 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.638410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" event={"ID":"2a804636-d17c-46d0-a97c-b51181d53dc4","Type":"ContainerDied","Data":"fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f"} Aug 04 15:52:30.638538 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.638493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz" event={"ID":"2a804636-d17c-46d0-a97c-b51181d53dc4","Type":"ContainerDied","Data":"57c325df6f829b2604b0b38b55f5800dc0908c3a8054b9021df0da6840dbee9f"} Aug 04 15:52:30.638538 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.638517 2562 scope.go:117] "RemoveContainer" containerID="fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f" Aug 04 15:52:30.648209 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.648193 2562 scope.go:117] "RemoveContainer" containerID="6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482" Aug 04 15:52:30.656281 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.656266 2562 scope.go:117] "RemoveContainer" containerID="fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f" Aug 04 15:52:30.656556 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:52:30.656537 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f\": container with ID starting with fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f not found: ID does not exist" containerID="fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f" Aug 04 15:52:30.656616 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.656563 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f"} err="failed to get container status \"fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f\": rpc error: code = NotFound desc = could not find container \"fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f\": container with ID starting with fa7efff5eef45e6d505e105da12e861f7fc11dc41e9f3a8539f581eae943750f not found: ID does not exist" Aug 04 15:52:30.656616 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.656580 2562 scope.go:117] "RemoveContainer" containerID="6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482" Aug 04 15:52:30.656813 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:52:30.656798 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482\": container with ID starting with 6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482 not found: ID does not exist" containerID="6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482" Aug 04 15:52:30.656860 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.656816 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482"} err="failed to get container status \"6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482\": rpc error: code = NotFound desc = could not find container \"6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482\": container with ID starting with 6759028d304a6d49969889c04a11bcc15338ef4e3fcc3aef1b5ab67590c93482 not found: ID does not exist" Aug 04 15:52:30.661594 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.661574 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz"] Aug 04 15:52:30.665392 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.665370 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e4d56b38-openshift-default-7556d9fdb8-dmsqz"] Aug 04 15:52:30.785102 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:52:30.785075 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" path="/var/lib/kubelet/pods/2a804636-d17c-46d0-a97c-b51181d53dc4/volumes" Aug 04 15:53:32.218478 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218443 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685"] Aug 04 15:53:32.218917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218824 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" Aug 04 15:53:32.218917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218835 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" Aug 04 15:53:32.218917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218844 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb642bbf-a722-4176-af86-65d5eb176688" containerName="revoke-keys" Aug 04 15:53:32.218917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218850 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb642bbf-a722-4176-af86-65d5eb176688" containerName="revoke-keys" Aug 04 15:53:32.219049 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218919 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb642bbf-a722-4176-af86-65d5eb176688" containerName="revoke-keys" Aug 04 15:53:32.219049 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.218929 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" Aug 04 15:53:32.221947 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.221930 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.224914 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.224895 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-21cd04-openshift-default-dockercfg-8vnl2\"" Aug 04 15:53:32.234335 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.234307 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685"] Aug 04 15:53:32.288686 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-podinfo\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.288883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss869\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-kube-api-access-ss869\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.288883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-socket\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.288883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-token\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.289073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-envoy\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.289073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-credential-socket\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.289073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.288968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istiod-ca-cert\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.289073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.289011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-data\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.289238 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.289078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-certs\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-envoy\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-credential-socket\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390320 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istiod-ca-cert\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390320 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-data\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390320 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-certs\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390320 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-podinfo\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390320 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss869\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-kube-api-access-ss869\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-socket\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-token\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390499 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-credential-socket\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.390861 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.390833 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istiod-ca-cert\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.391198 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.391172 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-data\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.391198 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.391192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-socket\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.391313 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.391179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-certs\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.392636 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.392610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-envoy\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.392823 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.392805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-podinfo\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.399614 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.399593 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss869\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-kube-api-access-ss869\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.399917 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.399896 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-token\") pod \"e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.533381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.533265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:32.702117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.702090 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685"] Aug 04 15:53:32.703361 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:53:32.703316 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc3ea95_c995_4373_a78c_8b54d8b0a1ab.slice/crio-443bb13c47b92a73a30337d593fe63ae4bd9f998c21a3f5dd50e210d56c5f407 WatchSource:0}: Error finding container 443bb13c47b92a73a30337d593fe63ae4bd9f998c21a3f5dd50e210d56c5f407: Status 404 returned error can't find the container with id 443bb13c47b92a73a30337d593fe63ae4bd9f998c21a3f5dd50e210d56c5f407 Aug 04 15:53:32.705662 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.705621 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:53:32.705949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.705708 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:53:32.705949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.705771 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:53:32.989597 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.989558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" event={"ID":"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab","Type":"ContainerStarted","Data":"62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c"} Aug 04 15:53:32.989775 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:32.989620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" event={"ID":"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab","Type":"ContainerStarted","Data":"443bb13c47b92a73a30337d593fe63ae4bd9f998c21a3f5dd50e210d56c5f407"} Aug 04 15:53:33.009730 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:33.009656 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podStartSLOduration=1.009636902 podStartE2EDuration="1.009636902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:53:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:53:33.008938088 +0000 UTC m=+2542.779331336" watchObservedRunningTime="2026-08-04 15:53:33.009636902 +0000 UTC m=+2542.780030133" Aug 04 15:53:33.533874 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:33.533845 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:33.535107 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:33.535084 2562 patch_prober.go:28] interesting pod/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Aug 04 15:53:33.535175 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:33.535130 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Aug 04 15:53:34.538224 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:34.538186 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:35.001554 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:35.001474 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:35.002458 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:35.002437 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:49.085931 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:49.085894 2562 generic.go:356] "Generic (PLEG): container finished" podID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerID="62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c" exitCode=0 Aug 04 15:53:49.086416 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:49.085970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" event={"ID":"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab","Type":"ContainerDied","Data":"62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c"} Aug 04 15:53:49.086416 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:49.086389 2562 scope.go:117] "RemoveContainer" containerID="62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c" Aug 04 15:53:49.087412 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:49.087381 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:53:49.087517 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:49.087466 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:53:49.087581 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:49.087517 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:53:50.001996 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:50.001958 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:50.097257 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:50.097221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" event={"ID":"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab","Type":"ContainerStarted","Data":"a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e"} Aug 04 15:53:50.533868 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:50.533830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:50.535173 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:50.535148 2562 patch_prober.go:28] interesting pod/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Aug 04 15:53:50.535269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:50.535202 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Aug 04 15:53:51.533765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:51.533723 2562 patch_prober.go:28] interesting pod/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Aug 04 15:53:51.534182 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:51.533783 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Aug 04 15:53:52.534067 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:52.534028 2562 patch_prober.go:28] interesting pod/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Aug 04 15:53:52.534525 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:52.534099 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Aug 04 15:53:53.533673 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:53.533638 2562 patch_prober.go:28] interesting pod/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Aug 04 15:53:53.533842 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:53.533690 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Aug 04 15:53:54.534259 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:54.534225 2562 patch_prober.go:28] interesting pod/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Aug 04 15:53:54.534671 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:54.534281 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Aug 04 15:53:55.537690 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:55.537659 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:55.538074 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:55.537970 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:53:55.538732 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:53:55.538715 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:54:00.796652 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.796624 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6"] Aug 04 15:54:00.797073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.796954 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" Aug 04 15:54:00.797073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.796965 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" Aug 04 15:54:00.797073 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.797021 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a804636-d17c-46d0-a97c-b51181d53dc4" containerName="istio-proxy" Aug 04 15:54:00.799973 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.799955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.803797 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.803772 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9d3b05-openshift-default-dockercfg-lmmtm\"" Aug 04 15:54:00.816682 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.816656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6"] Aug 04 15:54:00.850179 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-credential-socket\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850380 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-envoy\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850380 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-socket\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850526 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-data\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850526 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-token\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850526 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qtz8\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-kube-api-access-6qtz8\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850662 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-certs\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850662 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41acb9a-81b4-46d4-bc33-2f9058836f80-istiod-ca-cert\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.850741 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.850658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-podinfo\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951446 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qtz8\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-kube-api-access-6qtz8\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951446 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-certs\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41acb9a-81b4-46d4-bc33-2f9058836f80-istiod-ca-cert\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-podinfo\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-credential-socket\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951696 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-envoy\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951916 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-socket\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951916 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-data\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951916 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-token\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.951916 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951892 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-certs\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.952097 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.951912 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-credential-socket\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.952155 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.952133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-socket\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.952209 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.952158 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-data\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.952287 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.952270 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41acb9a-81b4-46d4-bc33-2f9058836f80-istiod-ca-cert\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.954532 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.954508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-envoy\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.954712 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.954693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-podinfo\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.960797 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.960768 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-token\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:00.961068 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:00.961046 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qtz8\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-kube-api-access-6qtz8\") pod \"e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:01.110627 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:01.110538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:01.258530 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:01.258503 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6"] Aug 04 15:54:01.260726 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:54:01.260698 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41acb9a_81b4_46d4_bc33_2f9058836f80.slice/crio-cd3676d006dd4a29b6d99ea9a3f43f41ba7769a0880dca649eb5443c0a761a96 WatchSource:0}: Error finding container cd3676d006dd4a29b6d99ea9a3f43f41ba7769a0880dca649eb5443c0a761a96: Status 404 returned error can't find the container with id cd3676d006dd4a29b6d99ea9a3f43f41ba7769a0880dca649eb5443c0a761a96 Aug 04 15:54:01.262891 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:01.262858 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:54:01.262970 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:01.262929 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:54:01.262970 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:01.262956 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:54:02.170286 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:02.170250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" event={"ID":"d41acb9a-81b4-46d4-bc33-2f9058836f80","Type":"ContainerStarted","Data":"c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f"} Aug 04 15:54:02.170717 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:02.170304 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" event={"ID":"d41acb9a-81b4-46d4-bc33-2f9058836f80","Type":"ContainerStarted","Data":"cd3676d006dd4a29b6d99ea9a3f43f41ba7769a0880dca649eb5443c0a761a96"} Aug 04 15:54:02.192635 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:02.192587 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podStartSLOduration=2.192571157 podStartE2EDuration="2.192571157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:02.191569548 +0000 UTC m=+2571.961962780" watchObservedRunningTime="2026-08-04 15:54:02.192571157 +0000 UTC m=+2571.962964389" Aug 04 15:54:03.110953 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:03.110919 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:03.115877 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:03.115853 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:03.176212 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:03.176184 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:54:03.177207 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:54:03.177192 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:55:10.544926 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:10.544894 2562 generic.go:356] "Generic (PLEG): container finished" podID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerID="c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f" exitCode=0 Aug 04 15:55:10.545358 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:10.544964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" event={"ID":"d41acb9a-81b4-46d4-bc33-2f9058836f80","Type":"ContainerDied","Data":"c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f"} Aug 04 15:55:10.545358 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:10.545331 2562 scope.go:117] "RemoveContainer" containerID="c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f" Aug 04 15:55:10.546289 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:10.546261 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:55:10.546398 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:10.546325 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:55:10.546398 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:10.546379 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:55:11.552806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:11.552771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" event={"ID":"d41acb9a-81b4-46d4-bc33-2f9058836f80","Type":"ContainerStarted","Data":"cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a"} Aug 04 15:55:12.111854 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:12.111811 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:55:12.112167 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:12.111874 2562 patch_prober.go:28] interesting pod/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Aug 04 15:55:12.112398 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:12.112333 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Aug 04 15:55:13.111412 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:13.111375 2562 patch_prober.go:28] interesting pod/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Aug 04 15:55:13.111993 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:13.111963 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Aug 04 15:55:14.111054 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:14.111017 2562 patch_prober.go:28] interesting pod/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Aug 04 15:55:14.111381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:14.111333 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Aug 04 15:55:15.111030 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:15.110984 2562 patch_prober.go:28] interesting pod/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Aug 04 15:55:15.111538 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:15.111056 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Aug 04 15:55:16.111715 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:16.111678 2562 patch_prober.go:28] interesting pod/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Aug 04 15:55:16.112315 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:16.112281 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Aug 04 15:55:17.114947 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:17.114917 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:55:17.115317 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:17.115191 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:55:17.115854 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:17.115836 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:55:57.274717 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:57.274686 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685"] Aug 04 15:55:57.275219 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:55:57.274908 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" containerID="cri-o://a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e" gracePeriod=30 Aug 04 15:56:02.523933 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.523908 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:56:02.571432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571405 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-podinfo\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571462 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss869\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-kube-api-access-ss869\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571479 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-token\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571495 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-certs\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571608 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571530 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-credential-socket\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571812 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571660 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-envoy\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571812 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-data\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571812 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571794 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istiod-ca-cert\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.571812 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571796 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:02.572046 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571824 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-socket\") pod \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\" (UID: \"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab\") " Aug 04 15:56:02.572046 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.571825 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:02.572152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.572124 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:02.572152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.572134 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:02.572152 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.572141 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:56:02.572493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.572182 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.572493 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.572200 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.573845 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.573817 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:56:02.573950 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.573847 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:56:02.574188 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.574171 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-kube-api-access-ss869" (OuterVolumeSpecName: "kube-api-access-ss869") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "kube-api-access-ss869". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:56:02.574498 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.574472 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" (UID: "ddc3ea95-c995-4373-a78c-8b54d8b0a1ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:02.673043 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673018 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.673043 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673039 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.673043 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673047 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.673228 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673056 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss869\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-kube-api-access-ss869\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.673228 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673064 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.673228 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673072 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.673228 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.673080 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:02.842341 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.842266 2562 generic.go:356] "Generic (PLEG): container finished" podID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerID="a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e" exitCode=0 Aug 04 15:56:02.842341 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.842315 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" Aug 04 15:56:02.842571 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.842363 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" event={"ID":"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab","Type":"ContainerDied","Data":"a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e"} Aug 04 15:56:02.842571 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.842425 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685" event={"ID":"ddc3ea95-c995-4373-a78c-8b54d8b0a1ab","Type":"ContainerDied","Data":"443bb13c47b92a73a30337d593fe63ae4bd9f998c21a3f5dd50e210d56c5f407"} Aug 04 15:56:02.842571 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.842457 2562 scope.go:117] "RemoveContainer" containerID="a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e" Aug 04 15:56:02.851969 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.851952 2562 scope.go:117] "RemoveContainer" containerID="62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c" Aug 04 15:56:02.860537 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.860513 2562 scope.go:117] "RemoveContainer" containerID="a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e" Aug 04 15:56:02.860803 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:56:02.860786 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e\": container with ID starting with a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e not found: ID does not exist" containerID="a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e" Aug 04 15:56:02.860870 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.860811 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e"} err="failed to get container status \"a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e\": rpc error: code = NotFound desc = could not find container \"a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e\": container with ID starting with a2e28e9500ec1b9c4d45b9fad58c5954b506b63cab131dda1f8ce8db5c78bd6e not found: ID does not exist" Aug 04 15:56:02.860870 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.860828 2562 scope.go:117] "RemoveContainer" containerID="62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c" Aug 04 15:56:02.861061 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:56:02.861042 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c\": container with ID starting with 62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c not found: ID does not exist" containerID="62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c" Aug 04 15:56:02.861109 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.861069 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c"} err="failed to get container status \"62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c\": rpc error: code = NotFound desc = could not find container \"62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c\": container with ID starting with 62eca72889eed07fb44206597f219f43e57f799a21cb4a508374d2d874ef876c not found: ID does not exist" Aug 04 15:56:02.862208 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.862190 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685"] Aug 04 15:56:02.866663 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:02.866641 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-21cd04-openshift-default-57fdd94b4b-ds685"] Aug 04 15:56:04.784409 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:04.784376 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" path="/var/lib/kubelet/pods/ddc3ea95-c995-4373-a78c-8b54d8b0a1ab/volumes" Aug 04 15:56:14.887967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:14.887929 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6"] Aug 04 15:56:14.888408 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:14.888159 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" containerID="cri-o://cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a" gracePeriod=30 Aug 04 15:56:15.801850 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.801811 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk"] Aug 04 15:56:15.802296 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.802277 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" Aug 04 15:56:15.802376 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.802297 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" Aug 04 15:56:15.802425 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.802384 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" Aug 04 15:56:15.806894 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.806877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.811775 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.811756 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ddf7a7-openshift-default-dockercfg-zvx8w\"" Aug 04 15:56:15.820300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.820271 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk"] Aug 04 15:56:15.891448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-socket\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.891972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-certs\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.891972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-envoy\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.891972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747t4\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-kube-api-access-747t4\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.891972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8242530a-b41a-4cb9-adac-5a87bfa57518-istiod-ca-cert\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.891972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-podinfo\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.891972 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-credential-socket\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.892204 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.891964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-data\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.892204 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.892050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-token\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993425 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-certs\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993624 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-envoy\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993624 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747t4\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-kube-api-access-747t4\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993624 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8242530a-b41a-4cb9-adac-5a87bfa57518-istiod-ca-cert\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993624 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-podinfo\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993866 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-credential-socket\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993866 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-data\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993866 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-token\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993866 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-socket\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.993866 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.993810 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-certs\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.994169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.994064 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-socket\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.994169 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.994149 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-data\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.994284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.994206 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-credential-socket\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.994284 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.994227 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8242530a-b41a-4cb9-adac-5a87bfa57518-istiod-ca-cert\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.996079 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.996057 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-envoy\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:15.996236 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:15.996220 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-podinfo\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:16.003817 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.003790 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-token\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:16.003951 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.003868 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747t4\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-kube-api-access-747t4\") pod \"e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:16.116990 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.116897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:16.259498 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.259473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk"] Aug 04 15:56:16.261231 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:56:16.261198 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8242530a_b41a_4cb9_adac_5a87bfa57518.slice/crio-f589b40760d0043f582605226847ca41606bfb85a289ea51acc0e75b06f7e2a0 WatchSource:0}: Error finding container f589b40760d0043f582605226847ca41606bfb85a289ea51acc0e75b06f7e2a0: Status 404 returned error can't find the container with id f589b40760d0043f582605226847ca41606bfb85a289ea51acc0e75b06f7e2a0 Aug 04 15:56:16.263507 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.263473 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:16.263600 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.263542 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:16.263600 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.263570 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:16.920100 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.920054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" event={"ID":"8242530a-b41a-4cb9-adac-5a87bfa57518","Type":"ContainerStarted","Data":"880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe"} Aug 04 15:56:16.920518 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.920115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" event={"ID":"8242530a-b41a-4cb9-adac-5a87bfa57518","Type":"ContainerStarted","Data":"f589b40760d0043f582605226847ca41606bfb85a289ea51acc0e75b06f7e2a0"} Aug 04 15:56:16.949007 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:16.948956 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podStartSLOduration=1.9489419190000001 podStartE2EDuration="1.948941919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:56:16.946522644 +0000 UTC m=+2706.716915875" watchObservedRunningTime="2026-08-04 15:56:16.948941919 +0000 UTC m=+2706.719335151" Aug 04 15:56:17.117100 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:17.117070 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:17.118151 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:17.118123 2562 patch_prober.go:28] interesting pod/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:56:17.118269 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:17.118183 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:56:17.121483 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:17.121464 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:17.925378 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:17.925336 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:17.926321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:17.926300 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:20.154697 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.154634 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:56:20.236389 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236332 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qtz8\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-kube-api-access-6qtz8\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236420 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-envoy\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236444 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-token\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236563 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236557 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41acb9a-81b4-46d4-bc33-2f9058836f80-istiod-ca-cert\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236737 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236605 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-socket\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236737 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236635 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-credential-socket\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236737 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236686 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-podinfo\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236737 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-certs\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.236946 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236868 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:20.236946 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236886 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:20.237056 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.236983 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d41acb9a-81b4-46d4-bc33-2f9058836f80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:56:20.237120 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237062 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-data\") pod \"d41acb9a-81b4-46d4-bc33-2f9058836f80\" (UID: \"d41acb9a-81b4-46d4-bc33-2f9058836f80\") " Aug 04 15:56:20.237427 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237393 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:20.237536 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237517 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.237603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237538 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.237603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237553 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.237603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237568 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41acb9a-81b4-46d4-bc33-2f9058836f80-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.237603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.237571 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-data" (OuterVolumeSpecName: "istio-data") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:20.238784 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.238762 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:56:20.238878 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.238817 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-token" (OuterVolumeSpecName: "istio-token") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:56:20.239218 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.239193 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-kube-api-access-6qtz8" (OuterVolumeSpecName: "kube-api-access-6qtz8") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "kube-api-access-6qtz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:56:20.239218 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.239207 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d41acb9a-81b4-46d4-bc33-2f9058836f80" (UID: "d41acb9a-81b4-46d4-bc33-2f9058836f80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:56:20.338516 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.338487 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.338516 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.338512 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.338516 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.338521 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qtz8\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-kube-api-access-6qtz8\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.338763 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.338530 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.338763 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.338538 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41acb9a-81b4-46d4-bc33-2f9058836f80-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:56:20.942498 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.942466 2562 generic.go:356] "Generic (PLEG): container finished" podID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerID="cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a" exitCode=0 Aug 04 15:56:20.942676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.942533 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" Aug 04 15:56:20.942676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.942542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" event={"ID":"d41acb9a-81b4-46d4-bc33-2f9058836f80","Type":"ContainerDied","Data":"cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a"} Aug 04 15:56:20.942676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.942596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6" event={"ID":"d41acb9a-81b4-46d4-bc33-2f9058836f80","Type":"ContainerDied","Data":"cd3676d006dd4a29b6d99ea9a3f43f41ba7769a0880dca649eb5443c0a761a96"} Aug 04 15:56:20.942676 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.942610 2562 scope.go:117] "RemoveContainer" containerID="cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a" Aug 04 15:56:20.952275 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.952245 2562 scope.go:117] "RemoveContainer" containerID="c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f" Aug 04 15:56:20.960516 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.960495 2562 scope.go:117] "RemoveContainer" containerID="cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a" Aug 04 15:56:20.960786 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:56:20.960767 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a\": container with ID starting with cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a not found: ID does not exist" containerID="cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a" Aug 04 15:56:20.960838 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.960794 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a"} err="failed to get container status \"cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a\": rpc error: code = NotFound desc = could not find container \"cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a\": container with ID starting with cb2f851b82cb06067c25b3a7e6ef3ce8c2b4db811d1bd5ccc06e4bff993c5b7a not found: ID does not exist" Aug 04 15:56:20.960838 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.960812 2562 scope.go:117] "RemoveContainer" containerID="c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f" Aug 04 15:56:20.961062 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:56:20.961045 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f\": container with ID starting with c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f not found: ID does not exist" containerID="c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f" Aug 04 15:56:20.961114 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.961070 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f"} err="failed to get container status \"c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f\": rpc error: code = NotFound desc = could not find container \"c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f\": container with ID starting with c5a936d286f29404c87f41222719f6003b5880b9afab86f9093dfb790cc00b9f not found: ID does not exist" Aug 04 15:56:20.962015 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.961998 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6"] Aug 04 15:56:20.967728 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:20.967705 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9d3b05-openshift-default-6759d5948b-rrfx6"] Aug 04 15:56:22.784087 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:22.784054 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" path="/var/lib/kubelet/pods/d41acb9a-81b4-46d4-bc33-2f9058836f80/volumes" Aug 04 15:56:32.926774 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:32.926692 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Aug 04 15:56:32.926774 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:32.926755 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Aug 04 15:56:33.011250 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:33.011166 2562 generic.go:356] "Generic (PLEG): container finished" podID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerID="880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe" exitCode=0 Aug 04 15:56:33.011250 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:33.011212 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" event={"ID":"8242530a-b41a-4cb9-adac-5a87bfa57518","Type":"ContainerDied","Data":"880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe"} Aug 04 15:56:33.011636 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:33.011619 2562 scope.go:117] "RemoveContainer" containerID="880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe" Aug 04 15:56:33.012685 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:33.012652 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:33.012753 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:33.012738 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:33.012791 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:33.012778 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:34.019396 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:34.019362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" event={"ID":"8242530a-b41a-4cb9-adac-5a87bfa57518","Type":"ContainerStarted","Data":"0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc"} Aug 04 15:56:34.117425 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:34.117387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:34.117633 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:34.117609 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Aug 04 15:56:34.117683 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:34.117663 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Aug 04 15:56:35.117300 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:35.117268 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Aug 04 15:56:35.117773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:35.117322 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Aug 04 15:56:36.117392 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:36.117325 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Aug 04 15:56:36.117794 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:36.117423 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Aug 04 15:56:37.117545 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:37.117513 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Aug 04 15:56:37.117914 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:37.117575 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Aug 04 15:56:38.117911 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:38.117876 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Aug 04 15:56:38.118305 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:38.117930 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Aug 04 15:56:39.121161 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:39.121131 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:39.121674 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:39.121523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:39.122120 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:39.122101 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:56:44.785235 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785203 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v"] Aug 04 15:56:44.785742 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785724 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" Aug 04 15:56:44.785832 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785746 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" Aug 04 15:56:44.785832 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785760 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" Aug 04 15:56:44.785832 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785767 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" Aug 04 15:56:44.785980 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785880 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" Aug 04 15:56:44.785980 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.785896 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc3ea95-c995-4373-a78c-8b54d8b0a1ab" containerName="istio-proxy" Aug 04 15:56:44.788307 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.788287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.791580 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.791560 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-063515-openshift-default-dockercfg-m2xcg\"" Aug 04 15:56:44.802791 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.802768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v"] Aug 04 15:56:44.876050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.875855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-token\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.875925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-podinfo\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.875976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82fdm\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-kube-api-access-82fdm\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876050 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.876013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-envoy\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.876080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-socket\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.876131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-credential-socket\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.876163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5587b435-b1ff-4a74-9dca-fbc3455c2490-istiod-ca-cert\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.876198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-data\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.876448 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.876250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-certs\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-socket\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-credential-socket\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977603 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5587b435-b1ff-4a74-9dca-fbc3455c2490-istiod-ca-cert\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977722 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-data\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977722 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-certs\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977722 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-token\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977887 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-podinfo\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977887 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977792 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-credential-socket\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977887 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82fdm\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-kube-api-access-82fdm\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977887 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977845 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-socket\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.977887 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-envoy\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.978153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.977941 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-data\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.978153 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.978116 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-certs\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.978325 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.978305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5587b435-b1ff-4a74-9dca-fbc3455c2490-istiod-ca-cert\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.980232 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.980209 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-envoy\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.980487 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.980466 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-podinfo\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.986948 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.986922 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82fdm\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-kube-api-access-82fdm\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:44.987133 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:44.987117 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-token\") pod \"e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:45.098751 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:45.098666 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:45.241062 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:45.241034 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v"] Aug 04 15:56:45.241728 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:56:45.241702 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5587b435_b1ff_4a74_9dca_fbc3455c2490.slice/crio-c532368963fbdb7e99775fbe38e29e84a0844c46ad80c9705aed80c5b977f3ad WatchSource:0}: Error finding container c532368963fbdb7e99775fbe38e29e84a0844c46ad80c9705aed80c5b977f3ad: Status 404 returned error can't find the container with id c532368963fbdb7e99775fbe38e29e84a0844c46ad80c9705aed80c5b977f3ad Aug 04 15:56:45.244056 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:45.244013 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:45.244142 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:45.244103 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:45.244181 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:45.244144 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:56:46.085958 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:46.085916 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" event={"ID":"5587b435-b1ff-4a74-9dca-fbc3455c2490","Type":"ContainerStarted","Data":"3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0"} Aug 04 15:56:46.086463 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:46.086017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" event={"ID":"5587b435-b1ff-4a74-9dca-fbc3455c2490","Type":"ContainerStarted","Data":"c532368963fbdb7e99775fbe38e29e84a0844c46ad80c9705aed80c5b977f3ad"} Aug 04 15:56:46.098883 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:46.098851 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:46.103479 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:46.103456 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:46.109778 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:46.109735 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podStartSLOduration=2.109720993 podStartE2EDuration="2.109720993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:56:46.108241435 +0000 UTC m=+2735.878634666" watchObservedRunningTime="2026-08-04 15:56:46.109720993 +0000 UTC m=+2735.880114225" Aug 04 15:56:47.091618 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:47.091583 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:56:47.092761 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:56:47.092738 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:57:02.746648 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:02.746615 2562 patch_prober.go:28] interesting pod/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:45468->10.134.0.57:15021: read: connection reset by peer" start-of-body= Aug 04 15:57:02.746995 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:02.746684 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:45468->10.134.0.57:15021: read: connection reset by peer" Aug 04 15:57:03.183625 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:03.183591 2562 generic.go:356] "Generic (PLEG): container finished" podID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerID="3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0" exitCode=0 Aug 04 15:57:03.183806 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:03.183651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" event={"ID":"5587b435-b1ff-4a74-9dca-fbc3455c2490","Type":"ContainerDied","Data":"3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0"} Aug 04 15:57:03.184078 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:03.184060 2562 scope.go:117] "RemoveContainer" containerID="3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0" Aug 04 15:57:03.185117 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:03.185087 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:57:03.185173 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:03.185156 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:57:03.185217 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:03.185188 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:57:04.192417 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:04.192376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" event={"ID":"5587b435-b1ff-4a74-9dca-fbc3455c2490","Type":"ContainerStarted","Data":"ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d"} Aug 04 15:57:05.099381 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:05.099323 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:57:05.099758 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:05.099664 2562 patch_prober.go:28] interesting pod/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Aug 04 15:57:05.099946 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:05.099920 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Aug 04 15:57:06.099640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:06.099600 2562 patch_prober.go:28] interesting pod/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Aug 04 15:57:06.100143 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:06.099668 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Aug 04 15:57:07.099601 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:07.099080 2562 patch_prober.go:28] interesting pod/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Aug 04 15:57:07.099601 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:07.099167 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Aug 04 15:57:08.099896 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:08.099843 2562 patch_prober.go:28] interesting pod/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Aug 04 15:57:08.100432 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:08.099920 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Aug 04 15:57:09.099473 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:09.099419 2562 patch_prober.go:28] interesting pod/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Aug 04 15:57:09.099654 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:09.099508 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Aug 04 15:57:10.102568 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:10.102536 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:57:10.103021 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:10.102806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:57:10.103591 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:10.103576 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:57:11.023921 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:11.023888 2562 scope.go:117] "RemoveContainer" containerID="5c915712a527d2851729ad3861b6faa30f2b31c7e1b47c89c156089a38439ada" Aug 04 15:57:38.751565 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:38.751475 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk"] Aug 04 15:57:38.752116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:38.751800 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" containerID="cri-o://0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc" gracePeriod=30 Aug 04 15:57:39.124411 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:39.124378 2562 patch_prober.go:28] interesting pod/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 15:57:39.124591 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:39.124445 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 15:57:44.010133 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.010106 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:57:44.135851 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135817 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-data\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.135851 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135851 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-token\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135874 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-podinfo\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135893 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-socket\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135930 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8242530a-b41a-4cb9-adac-5a87bfa57518-istiod-ca-cert\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135956 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-envoy\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.135993 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-747t4\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-kube-api-access-747t4\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136024 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-certs\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136116 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136076 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-credential-socket\") pod \"8242530a-b41a-4cb9-adac-5a87bfa57518\" (UID: \"8242530a-b41a-4cb9-adac-5a87bfa57518\") " Aug 04 15:57:44.136533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136166 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-data" (OuterVolumeSpecName: "istio-data") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:57:44.136533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136249 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:57:44.136533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136426 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:57:44.136533 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136453 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:57:44.136688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136571 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.136688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136584 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.136688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136594 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.136688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136604 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.136688 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.136658 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8242530a-b41a-4cb9-adac-5a87bfa57518-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:57:44.138399 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.138369 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-kube-api-access-747t4" (OuterVolumeSpecName: "kube-api-access-747t4") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "kube-api-access-747t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:57:44.138674 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.138650 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:57:44.138674 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.138659 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-token" (OuterVolumeSpecName: "istio-token") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:57:44.138809 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.138706 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8242530a-b41a-4cb9-adac-5a87bfa57518" (UID: "8242530a-b41a-4cb9-adac-5a87bfa57518"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:57:44.237159 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.237130 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.237159 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.237154 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.237159 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.237163 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8242530a-b41a-4cb9-adac-5a87bfa57518-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.237391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.237171 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8242530a-b41a-4cb9-adac-5a87bfa57518-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.237391 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.237180 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-747t4\" (UniqueName: \"kubernetes.io/projected/8242530a-b41a-4cb9-adac-5a87bfa57518-kube-api-access-747t4\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:57:44.426904 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.426827 2562 generic.go:356] "Generic (PLEG): container finished" podID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerID="0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc" exitCode=0 Aug 04 15:57:44.426904 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.426887 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" Aug 04 15:57:44.427081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.426902 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" event={"ID":"8242530a-b41a-4cb9-adac-5a87bfa57518","Type":"ContainerDied","Data":"0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc"} Aug 04 15:57:44.427081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.426954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk" event={"ID":"8242530a-b41a-4cb9-adac-5a87bfa57518","Type":"ContainerDied","Data":"f589b40760d0043f582605226847ca41606bfb85a289ea51acc0e75b06f7e2a0"} Aug 04 15:57:44.427081 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.426977 2562 scope.go:117] "RemoveContainer" containerID="0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc" Aug 04 15:57:44.436858 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.436839 2562 scope.go:117] "RemoveContainer" containerID="880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe" Aug 04 15:57:44.445112 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.445092 2562 scope.go:117] "RemoveContainer" containerID="0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc" Aug 04 15:57:44.445387 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:57:44.445363 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc\": container with ID starting with 0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc not found: ID does not exist" containerID="0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc" Aug 04 15:57:44.445451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.445396 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc"} err="failed to get container status \"0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc\": rpc error: code = NotFound desc = could not find container \"0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc\": container with ID starting with 0f622855b5f680b899026ddb6be4e71e1acb8514fcc4f0da8e3f5e5e2bf9adcc not found: ID does not exist" Aug 04 15:57:44.445451 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.445415 2562 scope.go:117] "RemoveContainer" containerID="880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe" Aug 04 15:57:44.445714 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:57:44.445693 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe\": container with ID starting with 880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe not found: ID does not exist" containerID="880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe" Aug 04 15:57:44.445814 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.445717 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe"} err="failed to get container status \"880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe\": rpc error: code = NotFound desc = could not find container \"880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe\": container with ID starting with 880f89fd32eff8b80db9986d52fbceea26c2e846125cd4df9cd6371a144e71fe not found: ID does not exist" Aug 04 15:57:44.451234 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.451211 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk"] Aug 04 15:57:44.457578 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.457549 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ddf7a7-openshift-default-796b9d8b54-zzmxk"] Aug 04 15:57:44.785780 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:57:44.785756 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" path="/var/lib/kubelet/pods/8242530a-b41a-4cb9-adac-5a87bfa57518/volumes" Aug 04 15:58:02.281338 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:02.281301 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v"] Aug 04 15:58:02.281741 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:02.281648 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" containerID="cri-o://ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d" gracePeriod=30 Aug 04 15:58:03.218375 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218330 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn"] Aug 04 15:58:03.218729 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218716 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" Aug 04 15:58:03.218773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218732 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" Aug 04 15:58:03.218773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218741 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" Aug 04 15:58:03.218773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218747 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" Aug 04 15:58:03.218773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218758 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" Aug 04 15:58:03.218773 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218764 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" Aug 04 15:58:03.218930 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218820 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41acb9a-81b4-46d4-bc33-2f9058836f80" containerName="istio-proxy" Aug 04 15:58:03.218930 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.218829 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" Aug 04 15:58:03.221472 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.221455 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.224297 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.224239 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-67a15f-openshift-default-dockercfg-cthf6\"" Aug 04 15:58:03.241429 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.241402 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn"] Aug 04 15:58:03.302528 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.302493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-data\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303085 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-certs\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303191 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/631b310c-8ae1-4c62-994e-eafaae26d626-istio-podinfo\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303258 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-envoy\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303258 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlfs9\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-kube-api-access-dlfs9\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303258 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-credential-socket\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303440 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/631b310c-8ae1-4c62-994e-eafaae26d626-istiod-ca-cert\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303440 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-istio-token\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.303539 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.303461 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-socket\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-envoy\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404397 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlfs9\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-kube-api-access-dlfs9\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-credential-socket\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/631b310c-8ae1-4c62-994e-eafaae26d626-istiod-ca-cert\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-istio-token\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-socket\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-data\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-certs\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404634 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/631b310c-8ae1-4c62-994e-eafaae26d626-istio-podinfo\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.404997 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.404869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-credential-socket\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.405114 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.405086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-certs\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.405114 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.405102 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-data\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.405321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.405157 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-socket\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.405321 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.405179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/631b310c-8ae1-4c62-994e-eafaae26d626-istiod-ca-cert\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.406844 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.406815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-envoy\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.407114 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.407096 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/631b310c-8ae1-4c62-994e-eafaae26d626-istio-podinfo\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.413625 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.413603 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-istio-token\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.414424 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.414402 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlfs9\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-kube-api-access-dlfs9\") pod \"e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.532051 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.531953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:03.677674 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.677647 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn"] Aug 04 15:58:03.678645 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:58:03.678620 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631b310c_8ae1_4c62_994e_eafaae26d626.slice/crio-326c69bce3eb88757275dcb14736be119f2773046f2753da863d925d06fc974c WatchSource:0}: Error finding container 326c69bce3eb88757275dcb14736be119f2773046f2753da863d925d06fc974c: Status 404 returned error can't find the container with id 326c69bce3eb88757275dcb14736be119f2773046f2753da863d925d06fc974c Aug 04 15:58:03.681101 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.681067 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:03.681189 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.681128 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:03.681189 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:03.681158 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:04.537557 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:04.537520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" event={"ID":"631b310c-8ae1-4c62-994e-eafaae26d626","Type":"ContainerStarted","Data":"dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98"} Aug 04 15:58:04.537935 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:04.537581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" event={"ID":"631b310c-8ae1-4c62-994e-eafaae26d626","Type":"ContainerStarted","Data":"326c69bce3eb88757275dcb14736be119f2773046f2753da863d925d06fc974c"} Aug 04 15:58:04.562957 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:04.562910 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podStartSLOduration=1.562894609 podStartE2EDuration="1.562894609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:58:04.56066238 +0000 UTC m=+2814.331055612" watchObservedRunningTime="2026-08-04 15:58:04.562894609 +0000 UTC m=+2814.333287842" Aug 04 15:58:05.533336 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:05.533297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:05.538623 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:05.538598 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:05.549870 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:05.549842 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:05.550555 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:05.550539 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:07.531260 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.531232 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:58:07.564075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.564000 2562 generic.go:356] "Generic (PLEG): container finished" podID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerID="ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d" exitCode=0 Aug 04 15:58:07.564075 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.564062 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" Aug 04 15:58:07.564263 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.564092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" event={"ID":"5587b435-b1ff-4a74-9dca-fbc3455c2490","Type":"ContainerDied","Data":"ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d"} Aug 04 15:58:07.564263 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.564156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v" event={"ID":"5587b435-b1ff-4a74-9dca-fbc3455c2490","Type":"ContainerDied","Data":"c532368963fbdb7e99775fbe38e29e84a0844c46ad80c9705aed80c5b977f3ad"} Aug 04 15:58:07.564263 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.564190 2562 scope.go:117] "RemoveContainer" containerID="ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d" Aug 04 15:58:07.575509 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.575488 2562 scope.go:117] "RemoveContainer" containerID="3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0" Aug 04 15:58:07.584400 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.584380 2562 scope.go:117] "RemoveContainer" containerID="ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d" Aug 04 15:58:07.584652 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:58:07.584632 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d\": container with ID starting with ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d not found: ID does not exist" containerID="ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d" Aug 04 15:58:07.584732 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.584661 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d"} err="failed to get container status \"ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d\": rpc error: code = NotFound desc = could not find container \"ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d\": container with ID starting with ef6935a0d38effe16744863b3fe448aa179fa2182880732787b608d5b7d0824d not found: ID does not exist" Aug 04 15:58:07.584732 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.584682 2562 scope.go:117] "RemoveContainer" containerID="3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0" Aug 04 15:58:07.584916 ip-10-0-135-95 kubenswrapper[2562]: E0804 15:58:07.584897 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0\": container with ID starting with 3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0 not found: ID does not exist" containerID="3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0" Aug 04 15:58:07.584981 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.584921 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0"} err="failed to get container status \"3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0\": rpc error: code = NotFound desc = could not find container \"3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0\": container with ID starting with 3a93936374df8dd007b106b1dacdb28f7134b67757050e0b3263a48a4dd59ca0 not found: ID does not exist" Aug 04 15:58:07.644438 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644417 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-credential-socket\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644536 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644448 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-certs\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644536 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644519 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-data\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644538 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-token\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644643 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644558 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5587b435-b1ff-4a74-9dca-fbc3455c2490-istiod-ca-cert\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644674 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82fdm\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-kube-api-access-82fdm\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644693 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:58:07.644744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644708 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-podinfo\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644744 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644735 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-envoy\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644760 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-socket\") pod \"5587b435-b1ff-4a74-9dca-fbc3455c2490\" (UID: \"5587b435-b1ff-4a74-9dca-fbc3455c2490\") " Aug 04 15:58:07.644949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644799 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:58:07.644949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644808 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-data" (OuterVolumeSpecName: "istio-data") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:58:07.644949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.644890 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5587b435-b1ff-4a74-9dca-fbc3455c2490-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 15:58:07.645160 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.645086 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:58:07.645484 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.645401 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.645677 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.645642 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5587b435-b1ff-4a74-9dca-fbc3455c2490-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.645778 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.645679 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.645778 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.645693 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.645778 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.645706 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.646815 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.646778 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-token" (OuterVolumeSpecName: "istio-token") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:58:07.646953 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.646935 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 15:58:07.647382 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.647327 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 15:58:07.647382 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.647338 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-kube-api-access-82fdm" (OuterVolumeSpecName: "kube-api-access-82fdm") pod "5587b435-b1ff-4a74-9dca-fbc3455c2490" (UID: "5587b435-b1ff-4a74-9dca-fbc3455c2490"). InnerVolumeSpecName "kube-api-access-82fdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 15:58:07.747079 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.747051 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.747079 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.747076 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82fdm\" (UniqueName: \"kubernetes.io/projected/5587b435-b1ff-4a74-9dca-fbc3455c2490-kube-api-access-82fdm\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.747079 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.747086 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.747378 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.747094 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5587b435-b1ff-4a74-9dca-fbc3455c2490-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 15:58:07.917439 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.917411 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v"] Aug 04 15:58:07.953722 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:07.953689 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-063515-openshift-default-5dcdcf8898-6ks4v"] Aug 04 15:58:08.784591 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:08.784547 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" path="/var/lib/kubelet/pods/5587b435-b1ff-4a74-9dca-fbc3455c2490/volumes" Aug 04 15:58:20.551146 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.551113 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Aug 04 15:58:20.551582 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.551191 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Aug 04 15:58:20.648660 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.648627 2562 generic.go:356] "Generic (PLEG): container finished" podID="631b310c-8ae1-4c62-994e-eafaae26d626" containerID="dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98" exitCode=0 Aug 04 15:58:20.648814 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.648703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" event={"ID":"631b310c-8ae1-4c62-994e-eafaae26d626","Type":"ContainerDied","Data":"dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98"} Aug 04 15:58:20.649113 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.649097 2562 scope.go:117] "RemoveContainer" containerID="dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98" Aug 04 15:58:20.650137 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.650098 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:20.650225 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.650168 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:20.650225 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:20.650197 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:21.655441 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:21.655406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" event={"ID":"631b310c-8ae1-4c62-994e-eafaae26d626","Type":"ContainerStarted","Data":"c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa"} Aug 04 15:58:22.532694 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:22.532653 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:22.532903 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:22.532880 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Aug 04 15:58:22.532949 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:22.532931 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Aug 04 15:58:23.533339 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:23.533303 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Aug 04 15:58:23.533759 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:23.533384 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Aug 04 15:58:24.533254 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:24.533218 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Aug 04 15:58:24.533467 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:24.533286 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Aug 04 15:58:25.533430 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:25.533389 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Aug 04 15:58:25.533639 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:25.533453 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Aug 04 15:58:26.532745 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:26.532705 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Aug 04 15:58:26.532931 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:26.532772 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Aug 04 15:58:27.537467 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:27.537439 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:27.537850 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:27.537826 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:27.538526 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:27.538507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 15:58:32.121324 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121294 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt"] Aug 04 15:58:32.121716 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121701 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" Aug 04 15:58:32.121716 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121717 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" Aug 04 15:58:32.121802 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121741 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" Aug 04 15:58:32.121802 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121746 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" Aug 04 15:58:32.121802 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121802 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8242530a-b41a-4cb9-adac-5a87bfa57518" containerName="istio-proxy" Aug 04 15:58:32.121910 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121813 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" Aug 04 15:58:32.121910 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.121819 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5587b435-b1ff-4a74-9dca-fbc3455c2490" containerName="istio-proxy" Aug 04 15:58:32.123967 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.123949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.126508 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.126489 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4d9499-openshift-default-dockercfg-5nj9f\"" Aug 04 15:58:32.143685 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.143658 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt"] Aug 04 15:58:32.276755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.276716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-certs\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.276755 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.276759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9hxr\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-kube-api-access-b9hxr\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.276971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.276786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-token\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.276971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.276899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-credential-socket\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.276971 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.276948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-envoy\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.277129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.277003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istiod-ca-cert\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.277129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.277039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-podinfo\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.277129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.277059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-data\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.277129 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.277127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-socket\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378135 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-envoy\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378135 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istiod-ca-cert\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378135 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-podinfo\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-data\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-socket\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-certs\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9hxr\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-kube-api-access-b9hxr\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-token\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378414 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-credential-socket\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378715 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-credential-socket\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378715 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378660 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-data\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.378901 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.378880 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istiod-ca-cert\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.379099 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.379078 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-socket\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.379205 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.379181 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-certs\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.380640 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.380620 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-envoy\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.381058 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.381035 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-podinfo\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.387791 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.387770 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9hxr\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-kube-api-access-b9hxr\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.388069 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.388050 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-token\") pod \"e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.434105 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.434081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:32.581849 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.581823 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt"] Aug 04 15:58:32.582610 ip-10-0-135-95 kubenswrapper[2562]: W0804 15:58:32.582578 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e48a3b3_d96f_4f90_9b8a_466bcec876d0.slice/crio-cf330df92c450060ff1222b51fab8ae85917083e482f02655c5b2271177a5c4c WatchSource:0}: Error finding container cf330df92c450060ff1222b51fab8ae85917083e482f02655c5b2271177a5c4c: Status 404 returned error can't find the container with id cf330df92c450060ff1222b51fab8ae85917083e482f02655c5b2271177a5c4c Aug 04 15:58:32.584906 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.584873 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:32.585001 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.584942 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:32.585001 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.584969 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:32.715694 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.715655 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" event={"ID":"5e48a3b3-d96f-4f90-9b8a-466bcec876d0","Type":"ContainerStarted","Data":"f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c"} Aug 04 15:58:32.715891 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.715722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" event={"ID":"5e48a3b3-d96f-4f90-9b8a-466bcec876d0","Type":"ContainerStarted","Data":"cf330df92c450060ff1222b51fab8ae85917083e482f02655c5b2271177a5c4c"} Aug 04 15:58:32.740023 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:32.739965 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podStartSLOduration=0.73994958 podStartE2EDuration="739.94958ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:58:32.737714369 +0000 UTC m=+2842.508107601" watchObservedRunningTime="2026-08-04 15:58:32.73994958 +0000 UTC m=+2842.510342812" Aug 04 15:58:33.434783 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:33.434752 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:33.440084 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:33.440064 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:33.721335 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:33.721260 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:33.722250 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:33.722231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:48.788707 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:48.788572 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:59204->10.134.0.59:15021: read: connection reset by peer" start-of-body= Aug 04 15:58:48.788707 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:48.788643 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:59204->10.134.0.59:15021: read: connection reset by peer" Aug 04 15:58:49.811868 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:49.811834 2562 generic.go:356] "Generic (PLEG): container finished" podID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerID="f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c" exitCode=0 Aug 04 15:58:49.812312 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:49.811884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" event={"ID":"5e48a3b3-d96f-4f90-9b8a-466bcec876d0","Type":"ContainerDied","Data":"f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c"} Aug 04 15:58:49.812312 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:49.812263 2562 scope.go:117] "RemoveContainer" containerID="f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c" Aug 04 15:58:49.813376 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:49.813323 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:49.813476 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:49.813424 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:49.813476 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:49.813463 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 15:58:50.819913 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:50.819876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" event={"ID":"5e48a3b3-d96f-4f90-9b8a-466bcec876d0","Type":"ContainerStarted","Data":"4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8"} Aug 04 15:58:51.434940 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:51.434901 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:51.435211 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:51.435190 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Aug 04 15:58:51.435258 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:51.435236 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Aug 04 15:58:52.435241 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:52.435203 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Aug 04 15:58:52.435729 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:52.435262 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Aug 04 15:58:53.434461 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:53.434424 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Aug 04 15:58:53.434645 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:53.434480 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Aug 04 15:58:54.435187 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:54.435149 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Aug 04 15:58:54.435617 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:54.435206 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Aug 04 15:58:55.435386 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:55.435330 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Aug 04 15:58:55.435765 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:55.435415 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Aug 04 15:58:56.437975 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:56.437945 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:56.438449 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:56.438360 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 15:58:56.438955 ip-10-0-135-95 kubenswrapper[2562]: I0804 15:58:56.438938 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 16:00:00.140133 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.140091 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9"] Aug 04 16:00:00.143439 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.143410 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" Aug 04 16:00:00.147441 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.147410 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2g8l5\"" Aug 04 16:00:00.149230 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.149204 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp"] Aug 04 16:00:00.152611 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.152324 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" Aug 04 16:00:00.156869 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.156846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" Aug 04 16:00:00.162276 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.160067 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9"] Aug 04 16:00:00.163040 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.163014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp"] Aug 04 16:00:00.168857 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.168837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" Aug 04 16:00:00.305100 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.305071 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9"] Aug 04 16:00:00.306996 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:00:00.306961 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a4c177_93bc_473a_9641_ca1b84ca6a04.slice/crio-1e6ec34acbd728deef6842918b4222a052940db5f45bf166f130fb7e5311e739 WatchSource:0}: Error finding container 1e6ec34acbd728deef6842918b4222a052940db5f45bf166f130fb7e5311e739: Status 404 returned error can't find the container with id 1e6ec34acbd728deef6842918b4222a052940db5f45bf166f130fb7e5311e739 Aug 04 16:00:00.543289 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:00.543256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp"] Aug 04 16:00:00.589401 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:00:00.589367 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3630ea_ea96_42fb_86c4_30d43c77a55e.slice/crio-c5de352c703e388bcaaf52dc7d627eca0dfb9b60f0d0c7eaad477b1aa1551ccc WatchSource:0}: Error finding container c5de352c703e388bcaaf52dc7d627eca0dfb9b60f0d0c7eaad477b1aa1551ccc: Status 404 returned error can't find the container with id c5de352c703e388bcaaf52dc7d627eca0dfb9b60f0d0c7eaad477b1aa1551ccc Aug 04 16:00:01.203084 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:01.203056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" event={"ID":"de3630ea-ea96-42fb-86c4-30d43c77a55e","Type":"ContainerStarted","Data":"635679fdaf524c2d7a86cdae992023fc05cd51525a0d9f05578ec9a9d2df346d"} Aug 04 16:00:01.203422 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:01.203127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" event={"ID":"de3630ea-ea96-42fb-86c4-30d43c77a55e","Type":"ContainerStarted","Data":"c5de352c703e388bcaaf52dc7d627eca0dfb9b60f0d0c7eaad477b1aa1551ccc"} Aug 04 16:00:01.204545 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:01.204521 2562 generic.go:356] "Generic (PLEG): container finished" podID="01a4c177-93bc-473a-9641-ca1b84ca6a04" containerID="fa889f5be0cf51e739360eb8b5cd976580fa579331db91cc9ede0302e773237f" exitCode=0 Aug 04 16:00:01.204653 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:01.204594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" event={"ID":"01a4c177-93bc-473a-9641-ca1b84ca6a04","Type":"ContainerDied","Data":"fa889f5be0cf51e739360eb8b5cd976580fa579331db91cc9ede0302e773237f"} Aug 04 16:00:01.204653 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:01.204632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" event={"ID":"01a4c177-93bc-473a-9641-ca1b84ca6a04","Type":"ContainerStarted","Data":"1e6ec34acbd728deef6842918b4222a052940db5f45bf166f130fb7e5311e739"} Aug 04 16:00:01.225718 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:01.225672 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" podStartSLOduration=1.225658752 podStartE2EDuration="1.225658752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:00:01.225017461 +0000 UTC m=+2930.995410693" watchObservedRunningTime="2026-08-04 16:00:01.225658752 +0000 UTC m=+2930.996051984" Aug 04 16:00:02.212082 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:02.212037 2562 generic.go:356] "Generic (PLEG): container finished" podID="de3630ea-ea96-42fb-86c4-30d43c77a55e" containerID="635679fdaf524c2d7a86cdae992023fc05cd51525a0d9f05578ec9a9d2df346d" exitCode=0 Aug 04 16:00:02.212526 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:02.212109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" event={"ID":"de3630ea-ea96-42fb-86c4-30d43c77a55e","Type":"ContainerDied","Data":"635679fdaf524c2d7a86cdae992023fc05cd51525a0d9f05578ec9a9d2df346d"} Aug 04 16:00:02.343821 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:02.343792 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" Aug 04 16:00:03.219107 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:03.219018 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" Aug 04 16:00:03.219107 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:03.219017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9" event={"ID":"01a4c177-93bc-473a-9641-ca1b84ca6a04","Type":"ContainerDied","Data":"1e6ec34acbd728deef6842918b4222a052940db5f45bf166f130fb7e5311e739"} Aug 04 16:00:03.219549 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:03.219141 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e6ec34acbd728deef6842918b4222a052940db5f45bf166f130fb7e5311e739" Aug 04 16:00:03.355918 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:03.355895 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" Aug 04 16:00:04.225737 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:04.225700 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" event={"ID":"de3630ea-ea96-42fb-86c4-30d43c77a55e","Type":"ContainerDied","Data":"c5de352c703e388bcaaf52dc7d627eca0dfb9b60f0d0c7eaad477b1aa1551ccc"} Aug 04 16:00:04.226102 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:04.225750 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5de352c703e388bcaaf52dc7d627eca0dfb9b60f0d0c7eaad477b1aa1551ccc" Aug 04 16:00:04.226102 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:00:04.225709 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-jk2qp" Aug 04 16:09:25.856958 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.856923 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks"] Aug 04 16:09:25.859037 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.857295 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a4c177-93bc-473a-9641-ca1b84ca6a04" containerName="cleanup" Aug 04 16:09:25.859037 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.857306 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a4c177-93bc-473a-9641-ca1b84ca6a04" containerName="cleanup" Aug 04 16:09:25.859037 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.857313 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3630ea-ea96-42fb-86c4-30d43c77a55e" containerName="cleanup" Aug 04 16:09:25.859037 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.857319 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3630ea-ea96-42fb-86c4-30d43c77a55e" containerName="cleanup" Aug 04 16:09:25.859037 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.857388 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3630ea-ea96-42fb-86c4-30d43c77a55e" containerName="cleanup" Aug 04 16:09:25.859037 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.857399 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a4c177-93bc-473a-9641-ca1b84ca6a04" containerName="cleanup" Aug 04 16:09:25.860117 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.860101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.866330 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.866309 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8ff9cf-openshift-default-dockercfg-nc8nh\"" Aug 04 16:09:25.880197 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.880171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks"] Aug 04 16:09:25.887544 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-envoy\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887544 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a88cf480-fd87-4e6e-aa7b-34b271052f97-istiod-ca-cert\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887747 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-socket\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887747 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-token\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887747 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-certs\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887747 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-podinfo\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887981 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-data\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887981 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-credential-socket\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.887981 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.887886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm6bs\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-kube-api-access-cm6bs\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.988994 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.988944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-token\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989170 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-certs\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989170 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-podinfo\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989170 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-data\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989170 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-credential-socket\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989386 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm6bs\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-kube-api-access-cm6bs\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989386 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-envoy\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989386 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a88cf480-fd87-4e6e-aa7b-34b271052f97-istiod-ca-cert\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989386 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-socket\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989599 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989515 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-certs\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989648 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989613 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-credential-socket\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989711 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989660 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-socket\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.989760 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.989714 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-data\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.990025 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.990008 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a88cf480-fd87-4e6e-aa7b-34b271052f97-istiod-ca-cert\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.991658 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.991635 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-envoy\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.991818 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.991800 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-podinfo\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.998130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.998100 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-token\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:25.998312 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:25.998290 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm6bs\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-kube-api-access-cm6bs\") pod \"e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:26.170260 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:26.170182 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:26.333255 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:26.333221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks"] Aug 04 16:09:26.334652 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:09:26.334627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88cf480_fd87_4e6e_aa7b_34b271052f97.slice/crio-8cf49854db00bd4119c032dd525e0fe087cd64f29ac7d1669e5575657fff131b WatchSource:0}: Error finding container 8cf49854db00bd4119c032dd525e0fe087cd64f29ac7d1669e5575657fff131b: Status 404 returned error can't find the container with id 8cf49854db00bd4119c032dd525e0fe087cd64f29ac7d1669e5575657fff131b Aug 04 16:09:26.336960 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:26.336922 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:26.337039 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:26.337012 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:26.337077 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:26.337061 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:27.295653 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:27.295615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" event={"ID":"a88cf480-fd87-4e6e-aa7b-34b271052f97","Type":"ContainerStarted","Data":"c43674da5bb9b0486eb3eb8db0bc1725496c6b145a0cee7430fcd7130465a094"} Aug 04 16:09:27.296054 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:27.295678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" event={"ID":"a88cf480-fd87-4e6e-aa7b-34b271052f97","Type":"ContainerStarted","Data":"8cf49854db00bd4119c032dd525e0fe087cd64f29ac7d1669e5575657fff131b"} Aug 04 16:09:27.318437 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:27.318391 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podStartSLOduration=2.318372603 podStartE2EDuration="2.318372603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:27.317906585 +0000 UTC m=+3497.088299841" watchObservedRunningTime="2026-08-04 16:09:27.318372603 +0000 UTC m=+3497.088765837" Aug 04 16:09:28.170506 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:28.170470 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:28.175378 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:28.175335 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:28.301626 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:28.301590 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:28.302460 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:28.302435 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:44.010039 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.010010 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": read tcp 10.134.0.2:44194->10.134.0.62:15021: read: connection reset by peer" start-of-body= Aug 04 16:09:44.010580 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.010070 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": read tcp 10.134.0.2:44194->10.134.0.62:15021: read: connection reset by peer" Aug 04 16:09:44.399142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.399111 2562 generic.go:356] "Generic (PLEG): container finished" podID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerID="c43674da5bb9b0486eb3eb8db0bc1725496c6b145a0cee7430fcd7130465a094" exitCode=0 Aug 04 16:09:44.399306 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.399177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" event={"ID":"a88cf480-fd87-4e6e-aa7b-34b271052f97","Type":"ContainerDied","Data":"c43674da5bb9b0486eb3eb8db0bc1725496c6b145a0cee7430fcd7130465a094"} Aug 04 16:09:44.399590 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.399577 2562 scope.go:117] "RemoveContainer" containerID="c43674da5bb9b0486eb3eb8db0bc1725496c6b145a0cee7430fcd7130465a094" Aug 04 16:09:44.400673 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.400640 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:44.400748 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.400714 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:44.400785 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:44.400746 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:45.410625 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:45.410581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" event={"ID":"a88cf480-fd87-4e6e-aa7b-34b271052f97","Type":"ContainerStarted","Data":"66d87b4f5e87f4414c88e3625bc7074688c0dc68fdd77174551d14888b81dd80"} Aug 04 16:09:46.170957 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:46.170924 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:46.171135 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:46.171083 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Aug 04 16:09:46.171181 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:46.171126 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Aug 04 16:09:47.170632 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:47.170596 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Aug 04 16:09:47.171032 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:47.170662 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Aug 04 16:09:48.170793 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:48.170754 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Aug 04 16:09:48.171181 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:48.170813 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Aug 04 16:09:49.170509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:49.170475 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Aug 04 16:09:49.170683 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:49.170528 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Aug 04 16:09:50.171153 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:50.171115 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Aug 04 16:09:50.171569 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:50.171169 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Aug 04 16:09:51.175086 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:51.175054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:51.175477 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:51.175314 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:51.176082 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:51.176062 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:09:55.374250 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.374217 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z"] Aug 04 16:09:55.377191 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.377168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.379942 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.379923 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2b50f0-openshift-default-dockercfg-brjd2\"" Aug 04 16:09:55.395629 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.395602 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z"] Aug 04 16:09:55.480957 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.480916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-envoy\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481425 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kf22\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-kube-api-access-8kf22\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481542 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-token\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481542 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-credential-socket\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481654 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-data\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481654 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-podinfo\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481764 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921d75f8-e87c-417e-b6d3-f848b740b7ad-istiod-ca-cert\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481819 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-socket\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.481819 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.481795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-certs\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583271 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-envoy\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kf22\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-kube-api-access-8kf22\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-token\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-credential-socket\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-data\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-podinfo\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921d75f8-e87c-417e-b6d3-f848b740b7ad-istiod-ca-cert\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583508 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-socket\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583887 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-certs\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583887 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583814 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-credential-socket\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.583887 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-data\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.584062 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.583987 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-certs\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.584062 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.584032 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-socket\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.584233 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.584215 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921d75f8-e87c-417e-b6d3-f848b740b7ad-istiod-ca-cert\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.585759 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.585742 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-envoy\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.586135 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.586114 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-podinfo\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.592555 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.592531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-token\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.592655 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.592609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kf22\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-kube-api-access-8kf22\") pod \"e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.687975 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.687918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:55.837493 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.837465 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z"] Aug 04 16:09:55.839066 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:09:55.839038 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921d75f8_e87c_417e_b6d3_f848b740b7ad.slice/crio-0c04f1030f0919d6214e6de406410b086807fd3b27c17fb25cddbff33799e64c WatchSource:0}: Error finding container 0c04f1030f0919d6214e6de406410b086807fd3b27c17fb25cddbff33799e64c: Status 404 returned error can't find the container with id 0c04f1030f0919d6214e6de406410b086807fd3b27c17fb25cddbff33799e64c Aug 04 16:09:55.841615 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.841583 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:55.841711 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.841645 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:55.841711 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:55.841674 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:09:56.478076 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:56.478039 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" event={"ID":"921d75f8-e87c-417e-b6d3-f848b740b7ad","Type":"ContainerStarted","Data":"37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e"} Aug 04 16:09:56.478466 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:56.478101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" event={"ID":"921d75f8-e87c-417e-b6d3-f848b740b7ad","Type":"ContainerStarted","Data":"0c04f1030f0919d6214e6de406410b086807fd3b27c17fb25cddbff33799e64c"} Aug 04 16:09:56.513155 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:56.513102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podStartSLOduration=1.513085646 podStartE2EDuration="1.513085646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:56.509338641 +0000 UTC m=+3526.279731872" watchObservedRunningTime="2026-08-04 16:09:56.513085646 +0000 UTC m=+3526.283478878" Aug 04 16:09:56.688831 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:56.688795 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:56.693949 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:56.693924 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:57.483421 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:57.483386 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:09:57.484464 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:09:57.484441 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:10:12.892153 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:12.892110 2562 patch_prober.go:28] interesting pod/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": read tcp 10.134.0.2:59856->10.134.0.63:15021: read: connection reset by peer" start-of-body= Aug 04 16:10:12.892691 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:12.892188 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": read tcp 10.134.0.2:59856->10.134.0.63:15021: read: connection reset by peer" Aug 04 16:10:13.574567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:13.574537 2562 generic.go:356] "Generic (PLEG): container finished" podID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerID="37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e" exitCode=0 Aug 04 16:10:13.574739 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:13.574610 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" event={"ID":"921d75f8-e87c-417e-b6d3-f848b740b7ad","Type":"ContainerDied","Data":"37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e"} Aug 04 16:10:13.574994 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:13.574980 2562 scope.go:117] "RemoveContainer" containerID="37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e" Aug 04 16:10:13.576029 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:13.575992 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:10:13.576107 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:13.576093 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:10:13.576145 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:13.576134 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:10:14.582598 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:14.582560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" event={"ID":"921d75f8-e87c-417e-b6d3-f848b740b7ad","Type":"ContainerStarted","Data":"1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29"} Aug 04 16:10:14.688997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:14.688957 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:10:14.689193 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:14.689072 2562 patch_prober.go:28] interesting pod/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Aug 04 16:10:14.689193 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:14.689115 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Aug 04 16:10:15.689084 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:15.689048 2562 patch_prober.go:28] interesting pod/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Aug 04 16:10:15.689595 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:15.689108 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Aug 04 16:10:16.688776 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:16.688736 2562 patch_prober.go:28] interesting pod/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Aug 04 16:10:16.689706 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:16.689666 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Aug 04 16:10:17.689135 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:17.689094 2562 patch_prober.go:28] interesting pod/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Aug 04 16:10:17.689378 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:17.689178 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Aug 04 16:10:18.688624 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:18.688590 2562 patch_prober.go:28] interesting pod/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Aug 04 16:10:18.689190 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:18.689158 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Aug 04 16:10:19.691802 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:19.691766 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:10:19.692185 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:19.692150 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:10:19.692866 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:10:19.692847 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:11:27.394196 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.394165 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z"] Aug 04 16:11:27.397114 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.397097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.399937 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.399913 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8528c9-openshift-default-dockercfg-p5nr9\"" Aug 04 16:11:27.410471 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.410442 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z"] Aug 04 16:11:27.456117 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-socket\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456252 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-podinfo\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456252 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-credential-socket\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456252 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-data\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456454 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqrl\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-kube-api-access-ngqrl\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456454 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456454 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-envoy\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456584 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-token\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.456584 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.456557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-certs\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.557848 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-token\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.557848 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-certs\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-socket\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-podinfo\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-credential-socket\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-data\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqrl\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-kube-api-access-ngqrl\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.557992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558103 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.558040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-envoy\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558496 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.558252 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-certs\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558496 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.558273 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-socket\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558577 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.558558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-data\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558632 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.558595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-credential-socket\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.558762 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.558738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.560579 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.560554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-envoy\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.560685 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.560593 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-podinfo\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.566305 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.566280 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-token\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.566561 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.566542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqrl\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-kube-api-access-ngqrl\") pod \"e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.707721 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.707659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:27.849190 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.849158 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z"] Aug 04 16:11:27.851066 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:11:27.851034 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02e4d65_2ad9_4785_8b42_cbfd5da11b66.slice/crio-73ac9dd68aeb58014dbb9575c91d32070ba4fc904e02fb151c9e947f30b9761c WatchSource:0}: Error finding container 73ac9dd68aeb58014dbb9575c91d32070ba4fc904e02fb151c9e947f30b9761c: Status 404 returned error can't find the container with id 73ac9dd68aeb58014dbb9575c91d32070ba4fc904e02fb151c9e947f30b9761c Aug 04 16:11:27.853423 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.853387 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:11:27.853528 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.853465 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:11:27.853528 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:27.853513 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:11:28.002955 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:28.002858 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" event={"ID":"e02e4d65-2ad9-4785-8b42-cbfd5da11b66","Type":"ContainerStarted","Data":"af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8"} Aug 04 16:11:28.002955 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:28.002917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" event={"ID":"e02e4d65-2ad9-4785-8b42-cbfd5da11b66","Type":"ContainerStarted","Data":"73ac9dd68aeb58014dbb9575c91d32070ba4fc904e02fb151c9e947f30b9761c"} Aug 04 16:11:28.024499 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:28.024435 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podStartSLOduration=1.024419465 podStartE2EDuration="1.024419465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:28.023062086 +0000 UTC m=+3617.793455312" watchObservedRunningTime="2026-08-04 16:11:28.024419465 +0000 UTC m=+3617.794812701" Aug 04 16:11:28.708607 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:28.708571 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:28.713058 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:28.713033 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:29.009087 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:29.009007 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:29.010067 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:29.010049 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:44.532310 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:44.532274 2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:48032->10.134.0.64:15021: read: connection reset by peer" start-of-body= Aug 04 16:11:44.532845 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:44.532380 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:48032->10.134.0.64:15021: read: connection reset by peer" Aug 04 16:11:45.105062 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:45.105031 2562 generic.go:356] "Generic (PLEG): container finished" podID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerID="af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8" exitCode=0 Aug 04 16:11:45.105226 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:45.105106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" event={"ID":"e02e4d65-2ad9-4785-8b42-cbfd5da11b66","Type":"ContainerDied","Data":"af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8"} Aug 04 16:11:45.105577 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:45.105561 2562 scope.go:117] "RemoveContainer" containerID="af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8" Aug 04 16:11:45.106750 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:45.106723 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:11:45.106811 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:45.106791 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:11:45.106846 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:45.106823 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Aug 04 16:11:46.116059 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:46.116025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" event={"ID":"e02e4d65-2ad9-4785-8b42-cbfd5da11b66","Type":"ContainerStarted","Data":"2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7"} Aug 04 16:11:46.708105 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:46.708063 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:46.708308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:46.708228 2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Aug 04 16:11:46.708308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:46.708281 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Aug 04 16:11:47.708853 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:47.708804 2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Aug 04 16:11:47.709394 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:47.708880 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Aug 04 16:11:48.708803 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:48.708766 2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Aug 04 16:11:48.709117 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:48.709090 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Aug 04 16:11:49.708632 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:49.708186 2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Aug 04 16:11:49.708632 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:49.708246 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Aug 04 16:11:50.708745 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:50.708706 2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Aug 04 16:11:50.709338 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:50.709307 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Aug 04 16:11:51.712183 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:51.712154 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:51.712558 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:51.712387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:11:51.713027 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:11:51.713011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:12:08.551470 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:08.551428 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z"] Aug 04 16:12:08.551857 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:08.551700 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" containerID="cri-o://2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7" gracePeriod=30 Aug 04 16:12:13.801680 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.801656 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:12:13.912943 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.912871 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-credential-socket\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.912943 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.912906 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-socket\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.912962 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-envoy\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913030 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngqrl\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-kube-api-access-ngqrl\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913063 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-certs\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913109 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-token\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913110 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:12:13.913142 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913138 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istiod-ca-cert\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913168 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-data\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913203 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-podinfo\") pod \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\" (UID: \"e02e4d65-2ad9-4785-8b42-cbfd5da11b66\") " Aug 04 16:12:13.913509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913278 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:12:13.913509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913372 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:12:13.913509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913483 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-data" (OuterVolumeSpecName: "istio-data") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:12:13.913934 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913568 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 16:12:13.913934 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913645 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:13.913934 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913666 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:13.913934 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913682 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:13.913934 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.913696 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:13.915450 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.915421 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 16:12:13.915580 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.915450 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:12:13.915580 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.915469 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-token" (OuterVolumeSpecName: "istio-token") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:12:13.915580 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:13.915528 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-kube-api-access-ngqrl" (OuterVolumeSpecName: "kube-api-access-ngqrl") pod "e02e4d65-2ad9-4785-8b42-cbfd5da11b66" (UID: "e02e4d65-2ad9-4785-8b42-cbfd5da11b66"). InnerVolumeSpecName "kube-api-access-ngqrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:12:14.015210 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.015180 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:14.015210 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.015206 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:14.015210 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.015216 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:14.015462 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.015225 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:14.015462 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.015233 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngqrl\" (UniqueName: \"kubernetes.io/projected/e02e4d65-2ad9-4785-8b42-cbfd5da11b66-kube-api-access-ngqrl\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:12:14.280328 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.280245 2562 generic.go:356] "Generic (PLEG): container finished" podID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerID="2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7" exitCode=0 Aug 04 16:12:14.280328 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.280286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" event={"ID":"e02e4d65-2ad9-4785-8b42-cbfd5da11b66","Type":"ContainerDied","Data":"2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7"} Aug 04 16:12:14.280328 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.280291 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" Aug 04 16:12:14.280614 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.280332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z" event={"ID":"e02e4d65-2ad9-4785-8b42-cbfd5da11b66","Type":"ContainerDied","Data":"73ac9dd68aeb58014dbb9575c91d32070ba4fc904e02fb151c9e947f30b9761c"} Aug 04 16:12:14.280614 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.280375 2562 scope.go:117] "RemoveContainer" containerID="2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7" Aug 04 16:12:14.291190 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.291172 2562 scope.go:117] "RemoveContainer" containerID="af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8" Aug 04 16:12:14.299789 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.299767 2562 scope.go:117] "RemoveContainer" containerID="2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7" Aug 04 16:12:14.300047 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:12:14.300027 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7\": container with ID starting with 2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7 not found: ID does not exist" containerID="2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7" Aug 04 16:12:14.300093 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.300057 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7"} err="failed to get container status \"2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7\": rpc error: code = NotFound desc = could not find container \"2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7\": container with ID starting with 2016152e69cf1e1adb9c601084069237b4bdbd2ded39f00cd35dfdc3f9a615f7 not found: ID does not exist" Aug 04 16:12:14.300093 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.300076 2562 scope.go:117] "RemoveContainer" containerID="af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8" Aug 04 16:12:14.300362 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:12:14.300330 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8\": container with ID starting with af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8 not found: ID does not exist" containerID="af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8" Aug 04 16:12:14.300414 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.300373 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8"} err="failed to get container status \"af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8\": rpc error: code = NotFound desc = could not find container \"af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8\": container with ID starting with af4c81b666f0435663d7641b4baddfb207ab609047dd3521ba87bbcb30b0a3e8 not found: ID does not exist" Aug 04 16:12:14.303887 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.303858 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z"] Aug 04 16:12:14.308079 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.308058 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8528c9-openshift-default-8587f86c74-4pw5z"] Aug 04 16:12:14.784616 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:12:14.784576 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" path="/var/lib/kubelet/pods/e02e4d65-2ad9-4785-8b42-cbfd5da11b66/volumes" Aug 04 16:13:17.431600 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:17.431568 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks"] Aug 04 16:13:17.432036 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:17.431782 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" containerID="cri-o://66d87b4f5e87f4414c88e3625bc7074688c0dc68fdd77174551d14888b81dd80" gracePeriod=30 Aug 04 16:13:21.177574 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:21.177530 2562 patch_prober.go:28] interesting pod/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 16:13:21.177980 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:21.177597 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 16:13:22.662972 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.662942 2562 generic.go:356] "Generic (PLEG): container finished" podID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerID="66d87b4f5e87f4414c88e3625bc7074688c0dc68fdd77174551d14888b81dd80" exitCode=0 Aug 04 16:13:22.663374 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.663017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" event={"ID":"a88cf480-fd87-4e6e-aa7b-34b271052f97","Type":"ContainerDied","Data":"66d87b4f5e87f4414c88e3625bc7074688c0dc68fdd77174551d14888b81dd80"} Aug 04 16:13:22.663374 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.663083 2562 scope.go:117] "RemoveContainer" containerID="c43674da5bb9b0486eb3eb8db0bc1725496c6b145a0cee7430fcd7130465a094" Aug 04 16:13:22.686015 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.685996 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:13:22.783100 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783028 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-data\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783100 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783062 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a88cf480-fd87-4e6e-aa7b-34b271052f97-istiod-ca-cert\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783331 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783126 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-socket\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783331 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783152 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-certs\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783331 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783173 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-credential-socket\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783331 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783203 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-token\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783331 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783285 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm6bs\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-kube-api-access-cm6bs\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783339 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-envoy\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783334 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-data" (OuterVolumeSpecName: "istio-data") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783380 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-podinfo\") pod \"a88cf480-fd87-4e6e-aa7b-34b271052f97\" (UID: \"a88cf480-fd87-4e6e-aa7b-34b271052f97\") " Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783504 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783538 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783562 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:22.783620 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783595 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a88cf480-fd87-4e6e-aa7b-34b271052f97-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 16:13:22.783965 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783795 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.783965 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783816 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.783965 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783831 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.783965 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783846 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.783965 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.783859 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a88cf480-fd87-4e6e-aa7b-34b271052f97-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.785742 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.785711 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:22.786175 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.786154 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 16:13:22.786232 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.786170 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-kube-api-access-cm6bs" (OuterVolumeSpecName: "kube-api-access-cm6bs") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "kube-api-access-cm6bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:13:22.786332 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.786310 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-token" (OuterVolumeSpecName: "istio-token") pod "a88cf480-fd87-4e6e-aa7b-34b271052f97" (UID: "a88cf480-fd87-4e6e-aa7b-34b271052f97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:13:22.884377 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.884309 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm6bs\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-kube-api-access-cm6bs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.884377 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.884363 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.884377 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.884373 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:22.884377 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:22.884381 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a88cf480-fd87-4e6e-aa7b-34b271052f97-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:23.669711 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:23.669672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" event={"ID":"a88cf480-fd87-4e6e-aa7b-34b271052f97","Type":"ContainerDied","Data":"8cf49854db00bd4119c032dd525e0fe087cd64f29ac7d1669e5575657fff131b"} Aug 04 16:13:23.670156 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:23.669730 2562 scope.go:117] "RemoveContainer" containerID="66d87b4f5e87f4414c88e3625bc7074688c0dc68fdd77174551d14888b81dd80" Aug 04 16:13:23.670156 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:23.669690 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks" Aug 04 16:13:23.706932 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:23.706901 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks"] Aug 04 16:13:23.713115 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:23.713093 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8ff9cf-openshift-default-756d54ffb6-xckks"] Aug 04 16:13:24.790484 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:24.790445 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" path="/var/lib/kubelet/pods/a88cf480-fd87-4e6e-aa7b-34b271052f97/volumes" Aug 04 16:13:35.434220 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:35.434180 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z"] Aug 04 16:13:35.434666 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:35.434398 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" containerID="cri-o://1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29" gracePeriod=30 Aug 04 16:13:40.678002 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.677977 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:13:40.753306 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753220 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-data\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753306 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753282 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921d75f8-e87c-417e-b6d3-f848b740b7ad-istiod-ca-cert\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753576 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753318 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kf22\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-kube-api-access-8kf22\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753576 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753374 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-socket\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753576 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753522 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-podinfo\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753543 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753616 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-envoy\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753645 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753656 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-certs\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753695 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-token\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-credential-socket\") pod \"921d75f8-e87c-417e-b6d3-f848b740b7ad\" (UID: \"921d75f8-e87c-417e-b6d3-f848b740b7ad\") " Aug 04 16:13:40.753740 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753718 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/921d75f8-e87c-417e-b6d3-f848b740b7ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 16:13:40.754098 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.753907 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:40.754098 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.754083 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:40.754190 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.754122 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.754190 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.754142 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.754265 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.754171 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921d75f8-e87c-417e-b6d3-f848b740b7ad-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.754339 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.754274 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.755813 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.755783 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:40.755923 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.755868 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 16:13:40.756211 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.756196 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:13:40.756265 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.756213 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-kube-api-access-8kf22" (OuterVolumeSpecName: "kube-api-access-8kf22") pod "921d75f8-e87c-417e-b6d3-f848b740b7ad" (UID: "921d75f8-e87c-417e-b6d3-f848b740b7ad"). InnerVolumeSpecName "kube-api-access-8kf22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:13:40.765511 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.765484 2562 generic.go:356] "Generic (PLEG): container finished" podID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerID="1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29" exitCode=0 Aug 04 16:13:40.765619 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.765536 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" Aug 04 16:13:40.765619 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.765568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" event={"ID":"921d75f8-e87c-417e-b6d3-f848b740b7ad","Type":"ContainerDied","Data":"1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29"} Aug 04 16:13:40.765705 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.765647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z" event={"ID":"921d75f8-e87c-417e-b6d3-f848b740b7ad","Type":"ContainerDied","Data":"0c04f1030f0919d6214e6de406410b086807fd3b27c17fb25cddbff33799e64c"} Aug 04 16:13:40.765705 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.765670 2562 scope.go:117] "RemoveContainer" containerID="1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29" Aug 04 16:13:40.777122 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.777105 2562 scope.go:117] "RemoveContainer" containerID="37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e" Aug 04 16:13:40.786061 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.786047 2562 scope.go:117] "RemoveContainer" containerID="1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29" Aug 04 16:13:40.786301 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:13:40.786283 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29\": container with ID starting with 1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29 not found: ID does not exist" containerID="1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29" Aug 04 16:13:40.786420 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.786310 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29"} err="failed to get container status \"1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29\": rpc error: code = NotFound desc = could not find container \"1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29\": container with ID starting with 1a260f3679f1a960edd3b15abc396ca8e1c36a9b20be63c341b273c3676dba29 not found: ID does not exist" Aug 04 16:13:40.786420 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.786327 2562 scope.go:117] "RemoveContainer" containerID="37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e" Aug 04 16:13:40.786555 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:13:40.786541 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e\": container with ID starting with 37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e not found: ID does not exist" containerID="37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e" Aug 04 16:13:40.786593 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.786560 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e"} err="failed to get container status \"37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e\": rpc error: code = NotFound desc = could not find container \"37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e\": container with ID starting with 37917e04f571072b00f25666dd2de2bd454f0a06b19d91b245ec8a8cedfb240e not found: ID does not exist" Aug 04 16:13:40.791942 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.791918 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z"] Aug 04 16:13:40.795633 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.795606 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2b50f0-openshift-default-565d987658-n6z9z"] Aug 04 16:13:40.855541 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.855506 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kf22\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-kube-api-access-8kf22\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.855541 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.855539 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.855770 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.855554 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.855770 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.855567 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921d75f8-e87c-417e-b6d3-f848b740b7ad-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:40.855770 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:40.855581 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921d75f8-e87c-417e-b6d3-f848b740b7ad-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:42.784008 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:42.783967 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" path="/var/lib/kubelet/pods/921d75f8-e87c-417e-b6d3-f848b740b7ad/volumes" Aug 04 16:13:46.514809 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:46.514778 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9"] Aug 04 16:13:46.517957 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:46.517936 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-67a15f-29764320-dsrz9"] Aug 04 16:13:46.787396 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:46.787340 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a4c177-93bc-473a-9641-ca1b84ca6a04" path="/var/lib/kubelet/pods/01a4c177-93bc-473a-9641-ca1b84ca6a04/volumes" Aug 04 16:13:54.426685 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:54.426652 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn"] Aug 04 16:13:54.427085 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:54.426864 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" containerID="cri-o://c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa" gracePeriod=30 Aug 04 16:13:57.540176 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:57.540142 2562 patch_prober.go:28] interesting pod/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 16:13:57.540567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:57.540202 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 16:13:59.678047 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.678021 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 16:13:59.839954 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.839908 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-socket\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.839975 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/631b310c-8ae1-4c62-994e-eafaae26d626-istiod-ca-cert\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840002 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlfs9\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-kube-api-access-dlfs9\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840037 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/631b310c-8ae1-4c62-994e-eafaae26d626-istio-podinfo\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840062 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-credential-socket\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840096 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-data\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840125 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-certs\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840158 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840153 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-envoy\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840178 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-istio-token\") pod \"631b310c-8ae1-4c62-994e-eafaae26d626\" (UID: \"631b310c-8ae1-4c62-994e-eafaae26d626\") " Aug 04 16:13:59.840567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840413 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:59.840567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840511 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:59.840567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840524 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-data" (OuterVolumeSpecName: "istio-data") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:59.840567 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840544 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/631b310c-8ae1-4c62-994e-eafaae26d626-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 16:13:59.840787 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840589 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:59.840787 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.840596 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.842603 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.842578 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:13:59.842685 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.842620 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-istio-token" (OuterVolumeSpecName: "istio-token") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:13:59.842781 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.842762 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/631b310c-8ae1-4c62-994e-eafaae26d626-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 16:13:59.842867 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.842848 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-kube-api-access-dlfs9" (OuterVolumeSpecName: "kube-api-access-dlfs9") pod "631b310c-8ae1-4c62-994e-eafaae26d626" (UID: "631b310c-8ae1-4c62-994e-eafaae26d626"). InnerVolumeSpecName "kube-api-access-dlfs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:13:59.878079 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.878048 2562 generic.go:356] "Generic (PLEG): container finished" podID="631b310c-8ae1-4c62-994e-eafaae26d626" containerID="c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa" exitCode=0 Aug 04 16:13:59.878195 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.878099 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" Aug 04 16:13:59.878195 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.878127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" event={"ID":"631b310c-8ae1-4c62-994e-eafaae26d626","Type":"ContainerDied","Data":"c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa"} Aug 04 16:13:59.878195 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.878187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn" event={"ID":"631b310c-8ae1-4c62-994e-eafaae26d626","Type":"ContainerDied","Data":"326c69bce3eb88757275dcb14736be119f2773046f2753da863d925d06fc974c"} Aug 04 16:13:59.878325 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.878217 2562 scope.go:117] "RemoveContainer" containerID="c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa" Aug 04 16:13:59.888171 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.888151 2562 scope.go:117] "RemoveContainer" containerID="dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98" Aug 04 16:13:59.896139 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.896119 2562 scope.go:117] "RemoveContainer" containerID="c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa" Aug 04 16:13:59.896375 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:13:59.896357 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa\": container with ID starting with c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa not found: ID does not exist" containerID="c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa" Aug 04 16:13:59.896431 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.896383 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa"} err="failed to get container status \"c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa\": rpc error: code = NotFound desc = could not find container \"c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa\": container with ID starting with c9496c6daf316929a581d7da556e77b806eb172e194cced4aa7608ea21bf9cfa not found: ID does not exist" Aug 04 16:13:59.896431 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.896399 2562 scope.go:117] "RemoveContainer" containerID="dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98" Aug 04 16:13:59.896622 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:13:59.896607 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98\": container with ID starting with dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98 not found: ID does not exist" containerID="dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98" Aug 04 16:13:59.896668 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.896624 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98"} err="failed to get container status \"dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98\": rpc error: code = NotFound desc = could not find container \"dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98\": container with ID starting with dfe1a374273f076e5ed61c5b039bcf1d48ac11214134bcecbd1a945c63effd98 not found: ID does not exist" Aug 04 16:13:59.906657 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.906630 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn"] Aug 04 16:13:59.914083 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.914060 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-67a15f-openshift-default-946bd8cc6-p65jn"] Aug 04 16:13:59.941522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941498 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941518 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941645 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941526 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/631b310c-8ae1-4c62-994e-eafaae26d626-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941645 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941536 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlfs9\" (UniqueName: \"kubernetes.io/projected/631b310c-8ae1-4c62-994e-eafaae26d626-kube-api-access-dlfs9\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941645 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941545 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/631b310c-8ae1-4c62-994e-eafaae26d626-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941645 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941553 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941645 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941560 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:13:59.941645 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:13:59.941568 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/631b310c-8ae1-4c62-994e-eafaae26d626-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:00.784226 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:00.784193 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" path="/var/lib/kubelet/pods/631b310c-8ae1-4c62-994e-eafaae26d626/volumes" Aug 04 16:14:10.922160 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:10.922128 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt"] Aug 04 16:14:10.922622 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:10.922318 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" containerID="cri-o://4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8" gracePeriod=30 Aug 04 16:14:11.201007 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:11.200924 2562 scope.go:117] "RemoveContainer" containerID="fa889f5be0cf51e739360eb8b5cd976580fa579331db91cc9ede0302e773237f" Aug 04 16:14:11.441005 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:11.440973 2562 patch_prober.go:28] interesting pod/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 16:14:11.441166 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:11.441031 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 16:14:16.188486 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.188454 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 16:14:16.291209 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291185 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-credential-socket\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291395 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291232 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-data\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291395 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291292 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-token\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291398 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-certs\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291434 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9hxr\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-kube-api-access-b9hxr\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291459 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-envoy\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291465 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:14:16.291522 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291498 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-socket\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291781 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291523 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istiod-ca-cert\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291781 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291553 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-podinfo\") pod \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\" (UID: \"5e48a3b3-d96f-4f90-9b8a-466bcec876d0\") " Aug 04 16:14:16.291781 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291598 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:14:16.291781 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291703 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:14:16.291998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291807 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:14:16.291998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291940 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.291998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291940 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 16:14:16.291998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291957 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-workload-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.291998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291976 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-credential-socket\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.291998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.291984 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-data\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.293723 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.293697 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:14:16.293841 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.293768 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 04 16:14:16.294146 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.294116 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 16:14:16.294146 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.294127 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-kube-api-access-b9hxr" (OuterVolumeSpecName: "kube-api-access-b9hxr") pod "5e48a3b3-d96f-4f90-9b8a-466bcec876d0" (UID: "5e48a3b3-d96f-4f90-9b8a-466bcec876d0"). InnerVolumeSpecName "kube-api-access-b9hxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 16:14:16.392714 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.392691 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9hxr\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-kube-api-access-b9hxr\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.392714 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.392713 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-envoy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.392858 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.392722 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istiod-ca-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.392858 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.392730 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-podinfo\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.392858 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.392738 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e48a3b3-d96f-4f90-9b8a-466bcec876d0-istio-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\"" Aug 04 16:14:16.970582 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.970548 2562 generic.go:356] "Generic (PLEG): container finished" podID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerID="4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8" exitCode=0 Aug 04 16:14:16.970748 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.970602 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" Aug 04 16:14:16.970748 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.970629 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" event={"ID":"5e48a3b3-d96f-4f90-9b8a-466bcec876d0","Type":"ContainerDied","Data":"4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8"} Aug 04 16:14:16.970748 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.970704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt" event={"ID":"5e48a3b3-d96f-4f90-9b8a-466bcec876d0","Type":"ContainerDied","Data":"cf330df92c450060ff1222b51fab8ae85917083e482f02655c5b2271177a5c4c"} Aug 04 16:14:16.970748 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.970726 2562 scope.go:117] "RemoveContainer" containerID="4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8" Aug 04 16:14:16.979871 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.979853 2562 scope.go:117] "RemoveContainer" containerID="f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c" Aug 04 16:14:16.987551 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.987529 2562 scope.go:117] "RemoveContainer" containerID="4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8" Aug 04 16:14:16.987818 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:14:16.987798 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8\": container with ID starting with 4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8 not found: ID does not exist" containerID="4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8" Aug 04 16:14:16.987888 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.987826 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8"} err="failed to get container status \"4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8\": rpc error: code = NotFound desc = could not find container \"4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8\": container with ID starting with 4412abdbb7e66c0d8f3b90e20f7c301ae00265357853d7d0122e5c326c930cd8 not found: ID does not exist" Aug 04 16:14:16.987888 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.987844 2562 scope.go:117] "RemoveContainer" containerID="f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c" Aug 04 16:14:16.988109 ip-10-0-135-95 kubenswrapper[2562]: E0804 16:14:16.988092 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c\": container with ID starting with f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c not found: ID does not exist" containerID="f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c" Aug 04 16:14:16.988152 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.988115 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c"} err="failed to get container status \"f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c\": rpc error: code = NotFound desc = could not find container \"f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c\": container with ID starting with f269cd4dd358edb68ba12072a44ffc1df85703fccbd377c96bb73aa70f05fd7c not found: ID does not exist" Aug 04 16:14:16.994272 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.994244 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt"] Aug 04 16:14:16.998818 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:16.998798 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4d9499-openshift-default-5f568d6df6-n2dmt"] Aug 04 16:14:18.380616 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:18.380596 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77c9c696b6-sgmrq_122b47bc-a5b7-4bfe-87e4-ccb58b729689/copy-manifests/0.log" Aug 04 16:14:18.401625 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:18.401586 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77c9c696b6-sgmrq_122b47bc-a5b7-4bfe-87e4-ccb58b729689/manager/0.log" Aug 04 16:14:18.784263 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:18.784185 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" path="/var/lib/kubelet/pods/5e48a3b3-d96f-4f90-9b8a-466bcec876d0/volumes" Aug 04 16:14:18.906769 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:18.906746 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764290-cgw9r_83cded8b-3637-4b37-a826-9340d7c78d33/cleanup/0.log" Aug 04 16:14:19.024137 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:19.024114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764305-bsc99_c2b9a938-b1bc-4e70-abb2-684dd7208fce/cleanup/0.log" Aug 04 16:14:19.135245 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:19.135215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764320-jk2qp_de3630ea-ea96-42fb-86c4-30d43c77a55e/cleanup/0.log" Aug 04 16:14:21.238501 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:21.238473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p_6f00bee8-00b5-4839-80b7-f497b2e48126/istio-proxy/0.log" Aug 04 16:14:21.356636 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:21.356606 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-px6pq_29a68da1-e28e-4750-9cd8-db25b4309c0a/discovery/0.log" Aug 04 16:14:21.701361 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:21.701322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/1.log" Aug 04 16:14:21.815400 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:21.815375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ggb99_2b6b50c6-d5ad-4b0d-a01a-a2322800b42b/payload-pre-processing/0.log" Aug 04 16:14:22.552361 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:22.552331 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qhgzl_c1464832-6b2c-431f-853c-13877923ad7a/main/0.log" Aug 04 16:14:22.669041 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:22.669014 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rqqkv_32738002-7694-41ea-b0d3-ea07f1feb6ac/main/0.log" Aug 04 16:14:22.910537 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:22.910451 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zw28t_1a371947-2ce6-42c5-a2af-97b76a28591e/main/0.log" Aug 04 16:14:34.483319 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:34.483289 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d2wwg_f2a7e6a6-125d-4cf4-845e-fddab92d25c8/global-pull-secret-syncer/0.log" Aug 04 16:14:34.738298 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:34.738227 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5p55r_574ac05a-6ef1-4ee6-896d-681609138916/konnectivity-agent/0.log" Aug 04 16:14:34.851824 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:34.851795 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-95.ec2.internal_ea84f11ede18b206ea05dd1ebd48a2be/haproxy/0.log" Aug 04 16:14:41.725414 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:41.725323 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6cb97bdb56-kzxgj_d9b99a65-e40f-40e0-b845-a21ffc4f7071/metrics-server/0.log" Aug 04 16:14:41.778341 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:41.778312 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-xhxd2_b1dbc5eb-2007-4625-8531-3969cc5ac1d9/monitoring-plugin/0.log" Aug 04 16:14:41.996752 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:41.996683 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p56ws_5b3988bf-b8c9-4599-86a5-7c37e9cb07fc/node-exporter/0.log" Aug 04 16:14:42.032241 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.032217 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p56ws_5b3988bf-b8c9-4599-86a5-7c37e9cb07fc/kube-rbac-proxy/0.log" Aug 04 16:14:42.055901 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.055878 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p56ws_5b3988bf-b8c9-4599-86a5-7c37e9cb07fc/init-textfile/0.log" Aug 04 16:14:42.218306 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.218266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-kv6kz_6329feea-4194-48ba-8140-405b95da2e8c/kube-rbac-proxy-main/0.log" Aug 04 16:14:42.243653 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.243629 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-kv6kz_6329feea-4194-48ba-8140-405b95da2e8c/kube-rbac-proxy-self/0.log" Aug 04 16:14:42.270882 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.270818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-kv6kz_6329feea-4194-48ba-8140-405b95da2e8c/openshift-state-metrics/0.log" Aug 04 16:14:42.546157 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.546126 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-fx49f_2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b/prometheus-operator/0.log" Aug 04 16:14:42.567814 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.567787 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-fx49f_2b8deb11-0cdc-48bd-9de2-0683f6c1ee2b/kube-rbac-proxy/0.log" Aug 04 16:14:42.599150 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.599123 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-dv59g_919f9e8d-ea86-4bb6-800f-9c3edb6e12e5/prometheus-operator-admission-webhook/0.log" Aug 04 16:14:42.640093 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.640059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76c5965d48-sh4jn_c8e42645-a82d-49be-a350-9701d87e934e/telemeter-client/0.log" Aug 04 16:14:42.665488 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.665464 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76c5965d48-sh4jn_c8e42645-a82d-49be-a350-9701d87e934e/reload/0.log" Aug 04 16:14:42.691027 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.690996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76c5965d48-sh4jn_c8e42645-a82d-49be-a350-9701d87e934e/kube-rbac-proxy/0.log" Aug 04 16:14:42.740947 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.740925 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f7ddcb789-bdqk9_1fe736d3-1a4a-481e-bf9a-130dd2e0c636/thanos-query/0.log" Aug 04 16:14:42.768074 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.768055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f7ddcb789-bdqk9_1fe736d3-1a4a-481e-bf9a-130dd2e0c636/kube-rbac-proxy-web/0.log" Aug 04 16:14:42.798387 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.798294 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f7ddcb789-bdqk9_1fe736d3-1a4a-481e-bf9a-130dd2e0c636/kube-rbac-proxy/0.log" Aug 04 16:14:42.822784 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.822764 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f7ddcb789-bdqk9_1fe736d3-1a4a-481e-bf9a-130dd2e0c636/prom-label-proxy/0.log" Aug 04 16:14:42.849969 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.849948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f7ddcb789-bdqk9_1fe736d3-1a4a-481e-bf9a-130dd2e0c636/kube-rbac-proxy-rules/0.log" Aug 04 16:14:42.874010 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:42.873983 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f7ddcb789-bdqk9_1fe736d3-1a4a-481e-bf9a-130dd2e0c636/kube-rbac-proxy-metrics/0.log" Aug 04 16:14:44.507257 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507221 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc"] Aug 04 16:14:44.507641 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507606 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" Aug 04 16:14:44.507641 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507618 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" Aug 04 16:14:44.507641 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507634 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" Aug 04 16:14:44.507641 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507640 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507650 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507659 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507669 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507674 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507680 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507685 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507693 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507698 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507707 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507712 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507770 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" Aug 04 16:14:44.507772 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507777 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507783 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507789 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507794 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="921d75f8-e87c-417e-b6d3-f848b740b7ad" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507799 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507808 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507818 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507825 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" Aug 04 16:14:44.508130 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.507831 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a88cf480-fd87-4e6e-aa7b-34b271052f97" containerName="istio-proxy" Aug 04 16:14:44.510981 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.510964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.513613 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.513593 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qtx9z\"/\"openshift-service-ca.crt\"" Aug 04 16:14:44.513704 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.513645 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qtx9z\"/\"kube-root-ca.crt\"" Aug 04 16:14:44.513764 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.513728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qtx9z\"/\"default-dockercfg-65jnv\"" Aug 04 16:14:44.522680 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.522659 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc"] Aug 04 16:14:44.641509 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.641470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-podres\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.641700 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.641533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-sys\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.641700 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.641583 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-lib-modules\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.641700 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.641652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48h5l\" (UniqueName: \"kubernetes.io/projected/362bb23f-d350-4b60-8331-f632d7a3735a-kube-api-access-48h5l\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.641700 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.641690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-proc\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742787 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-sys\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742787 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-lib-modules\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h5l\" (UniqueName: \"kubernetes.io/projected/362bb23f-d350-4b60-8331-f632d7a3735a-kube-api-access-48h5l\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-proc\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-sys\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-podres\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742955 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-proc\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742958 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-lib-modules\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.742997 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.742988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/362bb23f-d350-4b60-8331-f632d7a3735a-podres\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.752882 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.752851 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48h5l\" (UniqueName: \"kubernetes.io/projected/362bb23f-d350-4b60-8331-f632d7a3735a-kube-api-access-48h5l\") pod \"perf-node-gather-daemonset-grdhc\" (UID: \"362bb23f-d350-4b60-8331-f632d7a3735a\") " pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.821401 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.821374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:44.954063 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:44.954012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc"] Aug 04 16:14:44.955895 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:14:44.955866 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod362bb23f_d350_4b60_8331_f632d7a3735a.slice/crio-6b0d87cdf69009b1afa9e9b1129952fa6e476593960bf98ef27fe624fa4cc3a8 WatchSource:0}: Error finding container 6b0d87cdf69009b1afa9e9b1129952fa6e476593960bf98ef27fe624fa4cc3a8: Status 404 returned error can't find the container with id 6b0d87cdf69009b1afa9e9b1129952fa6e476593960bf98ef27fe624fa4cc3a8 Aug 04 16:14:45.121998 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:45.121959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" event={"ID":"362bb23f-d350-4b60-8331-f632d7a3735a","Type":"ContainerStarted","Data":"f5b8a6ab36f83a229e9880d7eee4d952d8521fac2c6920e6de7d234465f041ee"} Aug 04 16:14:45.122120 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:45.122023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" event={"ID":"362bb23f-d350-4b60-8331-f632d7a3735a","Type":"ContainerStarted","Data":"6b0d87cdf69009b1afa9e9b1129952fa6e476593960bf98ef27fe624fa4cc3a8"} Aug 04 16:14:45.122198 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:45.122180 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:45.141780 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:45.141734 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" podStartSLOduration=1.141720182 podStartE2EDuration="1.141720182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:14:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:14:45.139789754 +0000 UTC m=+3814.910182987" watchObservedRunningTime="2026-08-04 16:14:45.141720182 +0000 UTC m=+3814.912113442" Aug 04 16:14:45.535811 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:45.535785 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-gcw4w_d085ffeb-e0a8-4896-abfc-0fe296713557/download-server/0.log" Aug 04 16:14:47.583939 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:47.583908 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7ttv_855caa8a-096d-4b49-bcc9-f8fe63c61be7/dns/0.log" Aug 04 16:14:47.613149 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:47.613124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7ttv_855caa8a-096d-4b49-bcc9-f8fe63c61be7/kube-rbac-proxy/0.log" Aug 04 16:14:47.641592 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:47.641565 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7krts_3efdd025-7d22-4539-a223-d79bc17fb7d0/dns-node-resolver/0.log" Aug 04 16:14:48.399987 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:48.399956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxc2n_eddffcd5-7dce-4f24-8997-4c1ffb818b10/node-ca/0.log" Aug 04 16:14:49.441093 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:49.441047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p_6f00bee8-00b5-4839-80b7-f497b2e48126/istio-proxy/0.log" Aug 04 16:14:49.615084 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:49.615050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-px6pq_29a68da1-e28e-4750-9cd8-db25b4309c0a/discovery/0.log" Aug 04 16:14:49.712633 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:49.712554 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/0.log" Aug 04 16:14:49.718830 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:49.718808 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/1.log" Aug 04 16:14:49.760370 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:49.760313 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ggb99_2b6b50c6-d5ad-4b0d-a01a-a2322800b42b/payload-pre-processing/0.log" Aug 04 16:14:50.833734 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:50.833708 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xjjkp_d968be83-78d8-45bd-883b-e4a294569318/serve-healthcheck-canary/0.log" Aug 04 16:14:51.137857 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:51.137769 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qtx9z/perf-node-gather-daemonset-grdhc" Aug 04 16:14:51.413360 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:51.413271 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47hzx_2a2282f8-5f77-47cc-a6c1-9dcd94f1840d/kube-rbac-proxy/0.log" Aug 04 16:14:51.438155 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:51.438129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47hzx_2a2282f8-5f77-47cc-a6c1-9dcd94f1840d/exporter/0.log" Aug 04 16:14:51.463916 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:51.463890 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47hzx_2a2282f8-5f77-47cc-a6c1-9dcd94f1840d/extractor/0.log" Aug 04 16:14:55.287813 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.287788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77c9c696b6-sgmrq_122b47bc-a5b7-4bfe-87e4-ccb58b729689/manager/0.log" Aug 04 16:14:55.325889 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.325863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77c9c696b6-sgmrq_122b47bc-a5b7-4bfe-87e4-ccb58b729689/copy-manifests/0.log" Aug 04 16:14:55.533251 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.533197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p_6f00bee8-00b5-4839-80b7-f497b2e48126/istio-proxy/0.log" Aug 04 16:14:55.696844 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.696774 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-px6pq_29a68da1-e28e-4750-9cd8-db25b4309c0a/discovery/0.log" Aug 04 16:14:55.760538 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.760511 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/0.log" Aug 04 16:14:55.766702 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.766682 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/1.log" Aug 04 16:14:55.788738 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:55.788718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ggb99_2b6b50c6-d5ad-4b0d-a01a-a2322800b42b/payload-pre-processing/0.log" Aug 04 16:14:56.673770 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:56.673742 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59d7b7db79-vdjmw_9b1f9d5e-91de-4fb9-9ea2-fe0a5d46925c/manager/0.log" Aug 04 16:14:56.746883 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:56.746857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8rmp6_7885623f-422d-481b-b2c3-464ea17acf1f/openshift-lws-operator/0.log" Aug 04 16:14:57.379990 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:57.379962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctxz6p_6f00bee8-00b5-4839-80b7-f497b2e48126/istio-proxy/0.log" Aug 04 16:14:57.554436 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:57.554408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-px6pq_29a68da1-e28e-4750-9cd8-db25b4309c0a/discovery/0.log" Aug 04 16:14:57.613866 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:57.613838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/0.log" Aug 04 16:14:57.620429 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:57.620409 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-fxmtc_e6830c55-7bba-4292-957d-e1c8122e3059/istio-proxy/1.log" Aug 04 16:14:57.652824 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:14:57.652764 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ggb99_2b6b50c6-d5ad-4b0d-a01a-a2322800b42b/payload-pre-processing/0.log" Aug 04 16:15:00.155916 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.155881 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8"] Aug 04 16:15:00.156308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.156261 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" Aug 04 16:15:00.156308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.156273 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e48a3b3-d96f-4f90-9b8a-466bcec876d0" containerName="istio-proxy" Aug 04 16:15:00.156308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.156290 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" Aug 04 16:15:00.156308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.156295 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02e4d65-2ad9-4785-8b42-cbfd5da11b66" containerName="istio-proxy" Aug 04 16:15:00.156308 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.156308 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" Aug 04 16:15:00.156507 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.156314 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="631b310c-8ae1-4c62-994e-eafaae26d626" containerName="istio-proxy" Aug 04 16:15:00.165164 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.165138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8" Aug 04 16:15:00.168826 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.168801 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8"] Aug 04 16:15:00.170443 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.170421 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2g8l5\"" Aug 04 16:15:00.176816 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.176798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8" Aug 04 16:15:00.322480 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:00.322452 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8"] Aug 04 16:15:00.323528 ip-10-0-135-95 kubenswrapper[2562]: W0804 16:15:00.323504 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1d2528_8b75_403a_9965_a96aaac0f8ee.slice/crio-0ef96dba34d3bb24abb6cd79c22ee1fef893871fef9d052e0b3ee506f7d24651 WatchSource:0}: Error finding container 0ef96dba34d3bb24abb6cd79c22ee1fef893871fef9d052e0b3ee506f7d24651: Status 404 returned error can't find the container with id 0ef96dba34d3bb24abb6cd79c22ee1fef893871fef9d052e0b3ee506f7d24651 Aug 04 16:15:01.213291 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:01.213264 2562 generic.go:356] "Generic (PLEG): container finished" podID="5d1d2528-8b75-403a-9965-a96aaac0f8ee" containerID="25072c3ad074fa76ac71f4d725d60985bd2eb115e6c76e46447f8700bab4fe19" exitCode=0 Aug 04 16:15:01.213618 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:01.213340 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8" event={"ID":"5d1d2528-8b75-403a-9965-a96aaac0f8ee","Type":"ContainerDied","Data":"25072c3ad074fa76ac71f4d725d60985bd2eb115e6c76e46447f8700bab4fe19"} Aug 04 16:15:01.213618 ip-10-0-135-95 kubenswrapper[2562]: I0804 16:15:01.213417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-2b5n8" event={"ID":"5d1d2528-8b75-403a-9965-a96aaac0f8ee","Type":"ContainerStarted","Data":"0ef96dba34d3bb24abb6cd79c22ee1fef893871fef9d052e0b3ee506f7d24651"}