Jul 24 22:46:12.299209 ip-10-0-132-39 systemd[1]: Starting Kubernetes Kubelet... Jul 24 22:46:12.677991 ip-10-0-132-39 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 22:46:12.677991 ip-10-0-132-39 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 22:46:12.677991 ip-10-0-132-39 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 22:46:12.677991 ip-10-0-132-39 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 22:46:12.677991 ip-10-0-132-39 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 22:46:12.678649 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.677981 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 22:46:12.683277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683262 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 22:46:12.683277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683276 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683279 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683283 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683286 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683289 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683292 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683295 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683301 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683305 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683308 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683311 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683314 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683317 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683320 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683322 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683325 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683328 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683330 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683333 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 22:46:12.683342 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683335 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683338 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683340 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683343 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683347 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683350 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683353 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683356 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683358 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683361 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683364 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683367 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683370 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683373 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683375 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683378 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683381 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683383 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683386 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 22:46:12.683798 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683388 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683391 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683393 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683396 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683398 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683402 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683405 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683407 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683410 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683412 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683415 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683417 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683420 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683423 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683425 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683429 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683432 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683435 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683437 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683440 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 22:46:12.684274 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683444 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683448 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683451 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683454 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683457 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683459 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683462 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683465 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683467 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683471 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683474 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683476 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683480 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683482 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683485 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683488 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683490 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683493 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683495 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 22:46:12.684784 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683498 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683502 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683506 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683509 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683512 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683515 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683518 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683520 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683524 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683526 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683529 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683532 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683535 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683537 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683540 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683542 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683545 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683548 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683550 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 22:46:12.685255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683553 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.683556 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684272 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684278 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684282 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684284 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684287 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684291 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684294 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684297 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684299 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684302 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684304 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684308 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684310 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684313 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684316 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684319 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684321 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684324 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 22:46:12.685754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684326 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684330 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684333 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684336 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684338 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684341 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684343 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684346 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684349 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684351 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684353 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684356 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684359 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684361 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684364 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684367 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684369 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684372 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684375 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684378 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 24 22:46:12.686272 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684381 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684384 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684386 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684389 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684393 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684398 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684401 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684404 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684407 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684410 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684413 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684417 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684420 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684422 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684425 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684428 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684431 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684433 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684436 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 22:46:12.686793 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684439 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684441 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684444 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684446 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684449 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684451 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684454 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684457 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684459 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684461 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684464 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684467 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684470 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684472 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684476 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684479 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684481 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684484 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684486 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684489 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 22:46:12.687269 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684491 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684494 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684497 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684499 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684501 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684504 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684507 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684510 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684512 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684515 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684517 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684520 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684523 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684527 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684530 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684533 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684535 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684538 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684541 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684544 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 22:46:12.687763 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684546 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684549 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684943 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684949 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684954 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684958 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684961 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684964 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684967 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684970 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684973 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684976 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684979 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684981 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684984 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684987 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684989 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684992 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684995 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.684997 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 22:46:12.688278 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685000 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685003 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685005 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685008 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685011 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685014 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685016 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685019 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685022 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685024 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685027 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685029 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685032 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685034 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685037 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685040 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685042 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685044 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685047 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 22:46:12.688752 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685050 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685053 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685056 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685058 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685061 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685063 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685065 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685068 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685070 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685073 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685075 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685078 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685081 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685083 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685086 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685088 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685091 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685093 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685095 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 22:46:12.689217 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685100 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685103 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685106 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685108 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685110 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685113 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685115 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685118 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685120 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685123 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685125 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685128 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685130 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685133 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685136 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685138 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685142 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685145 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685148 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 22:46:12.689684 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685151 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685153 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685157 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685160 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685163 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685166 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685169 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685172 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685174 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685177 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685182 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685185 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685188 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685191 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685194 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685196 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685198 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685201 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685203 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685206 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 22:46:12.690150 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685208 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685211 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685213 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685215 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685288 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685299 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685305 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685310 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685314 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685318 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685322 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685326 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685329 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685332 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685336 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685339 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685342 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685345 2585 flags.go:64] FLAG: --cgroup-root="" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685348 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685351 2585 flags.go:64] FLAG: --client-ca-file="" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685354 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685357 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685362 2585 flags.go:64] FLAG: --cluster-domain="" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685365 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 22:46:12.690621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685368 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685371 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685375 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685378 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685381 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685384 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685388 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685390 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685393 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685396 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685399 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685402 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685407 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685410 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685413 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685415 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685418 2585 flags.go:64] FLAG: --enable-server="true" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685422 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685426 2585 flags.go:64] FLAG: --event-burst="100" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685429 2585 flags.go:64] FLAG: --event-qps="50" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685431 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685434 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685437 2585 flags.go:64] FLAG: --eviction-hard="" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685441 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 22:46:12.691221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685444 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685447 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685449 2585 flags.go:64] FLAG: --eviction-soft="" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685452 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685455 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685458 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685463 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685466 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685469 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685471 2585 flags.go:64] FLAG: --feature-gates="" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685475 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685477 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685480 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685483 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685486 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685489 2585 flags.go:64] FLAG: --help="false" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685492 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-132-39.ec2.internal" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685495 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685498 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685501 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685506 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685509 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685512 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 22:46:12.691794 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685515 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685518 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685521 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685525 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685528 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685531 2585 flags.go:64] FLAG: --kube-reserved="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685534 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685536 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685539 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685542 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685545 2585 flags.go:64] FLAG: --lock-file="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685547 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685550 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685553 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685559 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685563 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685566 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685569 2585 flags.go:64] FLAG: --logging-format="text" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685571 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685575 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685577 2585 flags.go:64] FLAG: --manifest-url="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685581 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685585 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685588 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685593 2585 flags.go:64] FLAG: --max-pods="110" Jul 24 22:46:12.692439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685596 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685599 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685602 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685604 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685608 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685611 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685614 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685621 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685624 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685627 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685630 2585 flags.go:64] FLAG: --pod-cidr="" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685635 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685641 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685644 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685648 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685650 2585 flags.go:64] FLAG: --port="10250" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685653 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685656 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-084162316e17c4639" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685659 2585 flags.go:64] FLAG: --qos-reserved="" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685662 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685665 2585 flags.go:64] FLAG: --register-node="true" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685668 2585 flags.go:64] FLAG: --register-with-taints="" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685673 2585 flags.go:64] FLAG: --registry-burst="10" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685676 2585 flags.go:64] FLAG: --registry-qps="5" Jul 24 22:46:12.693054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685678 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685681 2585 flags.go:64] FLAG: --reserved-memory="" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685685 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685687 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685691 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685694 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685696 2585 flags.go:64] FLAG: --runonce="false" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685699 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685702 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685705 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685708 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685710 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685714 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685718 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685721 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685724 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685727 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685730 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685732 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685736 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685739 2585 flags.go:64] FLAG: --system-cgroups="" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685742 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685747 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685750 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685752 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 22:46:12.693655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685757 2585 flags.go:64] FLAG: --tls-min-version="" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685760 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685762 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685765 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685768 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685773 2585 flags.go:64] FLAG: --v="2" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685776 2585 flags.go:64] FLAG: --version="false" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685783 2585 flags.go:64] FLAG: --vmodule="" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685786 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.685789 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685901 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685905 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685908 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685911 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685914 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685917 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685919 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685922 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685925 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685940 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685946 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 22:46:12.694258 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685948 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685951 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685954 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685957 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685960 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685963 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685965 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685968 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685971 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685974 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685978 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685981 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685984 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685987 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685989 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685992 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685996 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.685999 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686001 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686004 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 22:46:12.694759 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686006 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686010 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686013 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686016 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686019 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686022 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686025 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686028 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686031 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686034 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686036 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686040 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686043 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686046 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686049 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686052 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686055 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686058 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686061 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 22:46:12.695255 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686063 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686066 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686069 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686071 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686074 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686076 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686079 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686082 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686084 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686088 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686091 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686093 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686096 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686098 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686101 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686103 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686106 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686108 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686111 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686114 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 22:46:12.695754 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686116 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686119 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686122 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686124 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686128 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686131 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686133 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686136 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686140 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686143 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686146 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686149 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686151 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686154 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686157 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686160 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686162 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686165 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686167 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686170 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 22:46:12.696277 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686172 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686176 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686178 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686181 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686183 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686186 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686189 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686191 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.686194 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.686200 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.692517 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.692531 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.692546 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.692552 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692607 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 22:46:12.696820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692612 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692615 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692618 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692621 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692624 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692627 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692629 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692633 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692636 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692640 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692643 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692645 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692648 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692652 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692656 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692659 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692662 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692665 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692668 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 24 22:46:12.697218 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692671 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692674 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692676 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692680 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692684 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692687 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692689 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692692 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692695 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692699 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692701 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692704 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692707 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692709 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692712 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692715 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692717 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692720 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692723 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 22:46:12.697677 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692725 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692728 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692730 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692733 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692735 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692737 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692740 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692742 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692745 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692748 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692750 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692753 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692756 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692759 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692762 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692764 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692767 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692770 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692772 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692775 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 22:46:12.698148 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692778 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692781 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692784 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692790 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692793 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692795 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692798 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692801 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692803 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692806 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692808 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692811 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692814 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692816 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692819 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692821 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692824 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692827 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692829 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692832 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 22:46:12.698653 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692834 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692837 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692839 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692842 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692845 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692848 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692850 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692853 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692856 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692858 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692861 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692864 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692867 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692869 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692872 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692875 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692878 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692880 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692883 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 22:46:12.699132 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.692886 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.692891 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693023 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693029 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693032 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693035 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693037 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693040 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693043 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693045 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693048 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693050 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693053 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693056 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693059 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 22:46:12.699589 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693061 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693064 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693067 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693070 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693073 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693075 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693078 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693080 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693083 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693085 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693088 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693090 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693093 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693095 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693098 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693102 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693104 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693107 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693109 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693111 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 22:46:12.700106 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693114 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693116 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693119 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693121 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693124 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693127 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693129 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693132 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693134 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693137 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693139 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693141 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693144 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693149 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693152 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693156 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693160 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693163 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693166 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 22:46:12.700820 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693168 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693171 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693174 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693177 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693180 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693183 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693186 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693188 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693191 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693194 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693197 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693199 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693202 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693205 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693207 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693209 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693212 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693214 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693217 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693220 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 22:46:12.701425 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693222 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693225 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693227 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693230 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693232 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693235 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693238 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693240 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693243 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693245 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693248 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693250 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693253 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693255 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693257 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693260 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693262 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693265 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693268 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693270 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 22:46:12.702207 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693273 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693275 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693278 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693281 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693283 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693286 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:12.693288 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.693293 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.693392 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.696842 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.698197 2585 server.go:1019] "Starting client certificate rotation" Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.698295 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.698329 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 22:46:12.702692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.700350 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 22:46:12.706269 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.706248 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 22:46:12.715450 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.715430 2585 log.go:25] "Validated CRI v1 runtime API" Jul 24 22:46:12.717318 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.717303 2585 log.go:25] "Validated CRI v1 image API" Jul 24 22:46:12.718741 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.718722 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 22:46:12.720941 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.720910 2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bf635d48-f988-4aea-8127-d4fe8f93de12:/dev/nvme0n1p3 c39b2ef3-41b1-4a9d-80a3-ec02106e65c9:/dev/nvme0n1p4] Jul 24 22:46:12.720985 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.720943 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 22:46:12.723717 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.723700 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 22:46:12.725996 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.725877 2585 manager.go:216] Machine: {Timestamp:2026-07-24 22:46:12.724631093 +0000 UTC m=+0.312684537 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092813 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22dda331c841ef54ab9d1f04c67c4b SystemUUID:ec22dda3-31c8-41ef-54ab-9d1f04c67c4b BootID:3ff64374-fe93-418f-b5d4-73961d2843be Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:43:3b:a2:e0:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:43:3b:a2:e0:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:c4:41:e5:b5:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 22:46:12.725996 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.725991 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 22:46:12.726109 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.726097 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 22:46:12.729325 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.729297 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 22:46:12.729453 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.729328 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 22:46:12.730109 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.730099 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 22:46:12.730144 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.730110 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 22:46:12.730144 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.730118 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 22:46:12.730912 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.730902 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 22:46:12.731746 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.731736 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 22:46:12.733461 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733450 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 24 22:46:12.733564 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733555 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 22:46:12.733599 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733585 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 24 22:46:12.733599 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733594 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 22:46:12.733652 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733611 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 22:46:12.733652 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733620 2585 kubelet.go:398] "Adding apiserver pod source" Jul 24 22:46:12.733652 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.733628 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 22:46:12.734058 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.734011 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 22:46:12.734097 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.734088 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 22:46:12.736237 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.736221 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 22:46:12.741184 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.741167 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 22:46:12.741261 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.741206 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 22:46:12.742748 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742734 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 22:46:12.742835 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742754 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 22:46:12.742835 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742809 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 22:46:12.742835 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742819 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 22:46:12.742835 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742833 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742844 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742862 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742872 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742883 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742891 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742917 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742941 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742974 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 22:46:12.743044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.742983 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 22:46:12.743748 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.743710 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 22:46:12.743833 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.743767 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 22:46:12.746772 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.746751 2585 server.go:1268] "Started kubelet" Jul 24 22:46:12.746950 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.746881 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 22:46:12.747045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.746966 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 22:46:12.747499 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.747447 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 22:46:12.747766 ip-10-0-132-39 systemd[1]: Started Kubernetes Kubelet. Jul 24 22:46:12.748983 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.748959 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 22:46:12.749062 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.748959 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7jwhn" Jul 24 22:46:12.749798 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.749471 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 24 22:46:12.751978 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.751952 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 22:46:12.753024 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.753008 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 22:46:12.753888 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.753026 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-39.ec2.internal.18c55b437d60f480 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-39.ec2.internal,UID:ip-10-0-132-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-39.ec2.internal,},FirstTimestamp:2026-07-24 22:46:12.746712192 +0000 UTC m=+0.334765683,LastTimestamp:2026-07-24 22:46:12.746712192 +0000 UTC m=+0.334765683,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-39.ec2.internal,}" Jul 24 22:46:12.757250 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757228 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 22:46:12.757250 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757236 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 22:46:12.757400 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.757322 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:12.757814 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757765 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 22:46:12.757814 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757783 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 22:46:12.757965 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757922 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 24 22:46:12.757965 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757959 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 24 22:46:12.758071 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.757983 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 22:46:12.758347 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758326 2585 factory.go:55] Registering systemd factory Jul 24 22:46:12.758347 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758347 2585 factory.go:223] Registration of the systemd container factory successfully Jul 24 22:46:12.758564 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758548 2585 factory.go:153] Registering CRI-O factory Jul 24 22:46:12.758564 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758564 2585 factory.go:223] Registration of the crio container factory successfully Jul 24 22:46:12.758663 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758614 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 22:46:12.758663 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758640 2585 factory.go:103] Registering Raw factory Jul 24 22:46:12.758663 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.758655 2585 manager.go:1196] Started watching for new ooms in manager Jul 24 22:46:12.759151 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.759092 2585 manager.go:349] Starting recovery of all containers Jul 24 22:46:12.759303 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.759284 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7jwhn" Jul 24 22:46:12.762024 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.762003 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 22:46:12.762349 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.762328 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 22:46:12.769420 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.769392 2585 manager.go:354] Recovery completed Jul 24 22:46:12.774553 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.774537 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:12.776947 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.776914 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:12.777018 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.776959 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:12.777018 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.776970 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:12.777511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.777497 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 22:46:12.777511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.777510 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 22:46:12.777617 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.777524 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 24 22:46:12.777617 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.777552 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:12.778231 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.778214 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:12.778302 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.778239 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:12.778302 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.778250 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:12.858196 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.858171 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:12.920652 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.920616 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 22:46:12.921817 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.921790 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 22:46:12.921923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.921828 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 22:46:12.921923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.921850 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 22:46:12.921923 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.921884 2585 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 24 22:46:12.923678 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.923662 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 22:46:12.925060 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.925040 2585 policy_none.go:49] "None policy: Start" Jul 24 22:46:12.925060 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.925062 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 22:46:12.925181 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.925078 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 22:46:12.926987 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.926974 2585 policy_none.go:47] "Start" Jul 24 22:46:12.958830 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.958666 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:12.967820 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.967803 2585 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-39.ec2.internal\" not found" node="ip-10-0-132-39.ec2.internal" Jul 24 22:46:12.972521 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972509 2585 manager.go:337] "Starting Device Plugin manager" Jul 24 22:46:12.972579 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.972537 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 22:46:12.972579 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972548 2585 server.go:87] "Starting device plugin registration server" Jul 24 22:46:12.972800 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972787 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 22:46:12.972856 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972804 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 22:46:12.972898 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972878 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 22:46:12.972989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972977 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 22:46:12.973040 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:12.972990 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 22:46:12.973557 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.973533 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 22:46:12.973631 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:12.973593 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.022940 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.022915 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal"] Jul 24 22:46:13.023030 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.023019 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:13.024634 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.024618 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:13.024726 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.024651 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:13.024726 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.024665 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:13.026869 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.026854 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:13.027002 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.026975 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.027049 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027017 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:13.027899 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027884 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:13.027899 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027903 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:13.028092 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027922 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:13.028092 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027907 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:13.028092 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027950 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:13.028092 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.027963 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:13.029876 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.029860 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.029961 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.029883 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:13.030810 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.030794 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:13.030889 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.030823 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:13.030889 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.030837 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:13.059184 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.059160 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4036643f3e6cef3ea45959f2a8054c05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal\" (UID: \"4036643f3e6cef3ea45959f2a8054c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.059301 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.059199 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4036643f3e6cef3ea45959f2a8054c05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal\" (UID: \"4036643f3e6cef3ea45959f2a8054c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.059301 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.059216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3e94d89104b64808722a056b82536ee-config\") pod \"kube-apiserver-proxy-ip-10-0-132-39.ec2.internal\" (UID: \"c3e94d89104b64808722a056b82536ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.062653 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.062635 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-39.ec2.internal\" not found" node="ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.066888 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.066873 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-39.ec2.internal\" not found" node="ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.073347 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.073336 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 22:46:13.074487 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.074473 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientMemory" Jul 24 22:46:13.074548 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.074499 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 22:46:13.074548 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.074509 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeHasSufficientPID" Jul 24 22:46:13.074610 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.074549 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.081520 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.081507 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.081571 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.081526 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-39.ec2.internal\": node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.095165 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.095144 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.159357 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.159335 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4036643f3e6cef3ea45959f2a8054c05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal\" (UID: \"4036643f3e6cef3ea45959f2a8054c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.159438 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.159362 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4036643f3e6cef3ea45959f2a8054c05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal\" (UID: \"4036643f3e6cef3ea45959f2a8054c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.159438 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.159382 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3e94d89104b64808722a056b82536ee-config\") pod \"kube-apiserver-proxy-ip-10-0-132-39.ec2.internal\" (UID: \"c3e94d89104b64808722a056b82536ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.159438 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.159423 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3e94d89104b64808722a056b82536ee-config\") pod \"kube-apiserver-proxy-ip-10-0-132-39.ec2.internal\" (UID: \"c3e94d89104b64808722a056b82536ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.159546 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.159447 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4036643f3e6cef3ea45959f2a8054c05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal\" (UID: \"4036643f3e6cef3ea45959f2a8054c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.159546 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.159478 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4036643f3e6cef3ea45959f2a8054c05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal\" (UID: \"4036643f3e6cef3ea45959f2a8054c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.195471 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.195439 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.296195 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.296138 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.365640 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.365612 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.370294 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.370165 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" Jul 24 22:46:13.396610 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.396589 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.497174 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.497128 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.597655 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.597583 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.698151 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.698114 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:13.698151 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.698123 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 22:46:13.698649 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.698290 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 22:46:13.763897 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.763856 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 22:41:13 +0000 UTC" deadline="2028-01-09 03:14:56.798656738 +0000 UTC" Jul 24 22:46:13.763897 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:13.763881 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12796h28m43.034778239s" Jul 24 22:46:13.799054 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:13.799035 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:15.006669 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.006603 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 22:46:15.023669 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.023644 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:15.041070 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:15.041028 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e94d89104b64808722a056b82536ee.slice/crio-de4ef3015deee7a63aea34a967bcc252fe1a5eb79c00717b71f9ea9644304b60 WatchSource:0}: Error finding container de4ef3015deee7a63aea34a967bcc252fe1a5eb79c00717b71f9ea9644304b60: Status 404 returned error can't find the container with id de4ef3015deee7a63aea34a967bcc252fe1a5eb79c00717b71f9ea9644304b60 Jul 24 22:46:15.041297 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:15.041272 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4036643f3e6cef3ea45959f2a8054c05.slice/crio-66a74b48ca9cef7e152363ae2b485e4712cab5f36ba8b5ab5c96c5932b1ea99e WatchSource:0}: Error finding container 66a74b48ca9cef7e152363ae2b485e4712cab5f36ba8b5ab5c96c5932b1ea99e: Status 404 returned error can't find the container with id 66a74b48ca9cef7e152363ae2b485e4712cab5f36ba8b5ab5c96c5932b1ea99e Jul 24 22:46:15.045590 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.045575 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 22:46:15.049468 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.049421 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" event={"ID":"c3e94d89104b64808722a056b82536ee","Type":"ContainerStarted","Data":"de4ef3015deee7a63aea34a967bcc252fe1a5eb79c00717b71f9ea9644304b60"} Jul 24 22:46:15.050500 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.050481 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" event={"ID":"4036643f3e6cef3ea45959f2a8054c05","Type":"ContainerStarted","Data":"66a74b48ca9cef7e152363ae2b485e4712cab5f36ba8b5ab5c96c5932b1ea99e"} Jul 24 22:46:15.124585 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.124547 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-39.ec2.internal\" not found" Jul 24 22:46:15.144406 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.144384 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 22:46:15.181692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.181668 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" Jul 24 22:46:15.193268 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.193249 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 22:46:15.195180 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.195167 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" Jul 24 22:46:15.201654 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.201639 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 22:46:15.248017 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.247994 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 22:46:15.858353 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.858326 2585 apiserver.go:52] "Watching apiserver" Jul 24 22:46:15.867301 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.867125 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 22:46:15.867524 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.867504 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-s482f","kube-system/global-pull-secret-syncer-k5k5b","kube-system/konnectivity-agent-d22vc","openshift-cluster-node-tuning-operator/tuned-668w8","openshift-multus/multus-additional-cni-plugins-rcdd2","openshift-multus/network-metrics-daemon-qjswr","openshift-ovn-kubernetes/ovnkube-node-t7mvk","kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6","openshift-dns/node-resolver-85lrd","openshift-image-registry/node-ca-bxr24","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal","openshift-multus/multus-6krhr","openshift-network-diagnostics/network-check-target-w8lhp"] Jul 24 22:46:15.870225 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.870199 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.872453 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.872424 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.872577 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.872560 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 22:46:15.872727 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.872707 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 22:46:15.873044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.873026 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.873193 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.873175 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.873255 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.873211 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 22:46:15.873355 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.873331 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 22:46:15.874022 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.874001 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s6llp\"" Jul 24 22:46:15.874598 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.874579 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:15.874867 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.874847 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.875200 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.875181 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.875492 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.875478 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lgl47\"" Jul 24 22:46:15.875582 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.875492 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 22:46:15.875582 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.875544 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 22:46:15.876684 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.876662 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 22:46:15.877104 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.876957 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.877104 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.876997 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c457g\"" Jul 24 22:46:15.877104 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.877037 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 22:46:15.879676 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.879471 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.879676 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.879470 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.879676 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.879582 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xn59k\"" Jul 24 22:46:15.879676 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.879669 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.881469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.881386 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 22:46:15.881566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.881545 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:15.881631 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.881602 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:15.881922 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.881889 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 22:46:15.881922 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.881893 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 22:46:15.882073 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.881926 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k8kk5\"" Jul 24 22:46:15.883832 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.883813 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.886177 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.886161 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 22:46:15.886346 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.886331 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pt9d6\"" Jul 24 22:46:15.886419 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.886380 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.886613 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.886596 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.886890 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.886874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:15.889176 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889154 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:15.889287 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.889245 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:15.889528 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889508 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 22:46:15.889618 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889546 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.889719 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889505 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xxz4q\"" Jul 24 22:46:15.889788 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889768 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.889943 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889924 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-systemd\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890014 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889956 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890014 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.889981 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-ovn\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890014 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890006 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890138 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890030 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9t9w\" (UniqueName: \"kubernetes.io/projected/20675f17-edae-4ad5-960c-9aff1a7fd760-kube-api-access-b9t9w\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890138 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890057 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890138 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890080 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-netns\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890138 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-run\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.890299 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890173 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-os-release\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.890299 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890205 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:15.890299 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890270 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-cni-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890305 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-k8s-cni-cncf-io\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890333 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-multus-certs\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890355 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60f70359-925f-4018-8c1e-8c35bfc8a21c-konnectivity-ca\") pod \"konnectivity-agent-d22vc\" (UID: \"60f70359-925f-4018-8c1e-8c35bfc8a21c\") " pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:15.890469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890395 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.890469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890417 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d2805d-bf10-4bb3-927f-83bdb1606515-tmp\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890506 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-run-netns\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890533 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-var-lib-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890565 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-log-socket\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-conf-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890613 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-daemon-config\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890632 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-socket-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-kubelet\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890673 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-device-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890690 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdp7s\" (UniqueName: \"kubernetes.io/projected/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-kube-api-access-bdp7s\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:15.890731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890713 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-systemd-units\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890764 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovnkube-config\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890839 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-hostroot\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890864 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2hcm\" (UniqueName: \"kubernetes.io/projected/57d2805d-bf10-4bb3-927f-83bdb1606515-kube-api-access-h2hcm\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890900 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-kubelet\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890915 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-slash\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890941 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-cni-netd\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890957 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890970 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-system-cni-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.890983 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20675f17-edae-4ad5-960c-9aff1a7fd760-cni-binary-copy\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891013 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxbb8\" (UniqueName: \"kubernetes.io/projected/bb6e4e50-6550-4178-b2b7-f28e7ba59754-kube-api-access-mxbb8\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891031 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-sys-fs\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891046 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj4bm\" (UniqueName: \"kubernetes.io/projected/16cdd27a-fbce-4409-8ca7-36e3e8105f04-kube-api-access-zj4bm\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891070 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-modprobe-d\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovnkube-script-lib\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.891322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891150 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-cnibin\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891185 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-kubernetes\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891214 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-var-lib-kubelet\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891272 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-cni-bin\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891318 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-system-cni-dir\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891347 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysctl-d\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891372 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-os-release\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891405 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-socket-dir-parent\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891442 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-cni-multus\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891475 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-tuned\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-env-overrides\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891592 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-etc-kubernetes\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891621 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-registration-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891647 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-node-log\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891668 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891695 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-systemd\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891719 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60f70359-925f-4018-8c1e-8c35bfc8a21c-agent-certs\") pod \"konnectivity-agent-d22vc\" (UID: \"60f70359-925f-4018-8c1e-8c35bfc8a21c\") " pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:15.892079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891770 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-sys\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891837 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cni-binary-copy\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.892862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891871 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysconfig\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysctl-conf\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.892862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.891912 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:15.892862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.892204 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-cni-bin\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.892862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.892678 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cnibin\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.893120 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.892713 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-lib-modules\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.893120 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.893111 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-host\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.893218 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.893149 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-etc-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.893218 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.893186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbsgm\" (UniqueName: \"kubernetes.io/projected/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-kube-api-access-dbsgm\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.893337 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.893221 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.893337 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.893271 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.895876 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.895545 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6mpq\"" Jul 24 22:46:15.895876 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.895588 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.895876 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.895870 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 22:46:15.896137 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.895874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:15.897370 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.897350 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.898099 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.898078 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 22:46:15.898393 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.898372 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xf75t\"" Jul 24 22:46:15.898393 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.898384 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 22:46:15.898542 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.898528 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 22:46:15.898758 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.898734 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:15.898893 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.898869 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:15.917907 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.917888 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xqb4b" Jul 24 22:46:15.926546 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.926523 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xqb4b" Jul 24 22:46:15.983482 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.983454 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 22:46:15.994489 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994457 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.994489 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994494 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9t9w\" (UniqueName: \"kubernetes.io/projected/20675f17-edae-4ad5-960c-9aff1a7fd760-kube-api-access-b9t9w\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.994700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994521 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.994700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-netns\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.994700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994596 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-netns\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.994700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994604 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.994700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-run\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.994700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994686 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-os-release\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994714 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994739 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-cni-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994764 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-k8s-cni-cncf-io\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994818 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-multus-certs\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994830 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-run\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994842 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60f70359-925f-4018-8c1e-8c35bfc8a21c-konnectivity-ca\") pod \"konnectivity-agent-d22vc\" (UID: \"60f70359-925f-4018-8c1e-8c35bfc8a21c\") " pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.994849 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994882 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-multus-certs\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-os-release\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994899 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994908 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-cni-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994916 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994936 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-run-k8s-cni-cncf-io\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:15.994946 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:16.494921723 +0000 UTC m=+2.959110149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:15.995003 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.994987 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995026 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d2805d-bf10-4bb3-927f-83bdb1606515-tmp\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-run-netns\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995076 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-var-lib-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995099 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-log-socket\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995123 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-conf-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995132 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-var-lib-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995099 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-run-netns\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995147 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-daemon-config\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995184 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-socket-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995211 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-kubelet\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995206 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-conf-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995239 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995266 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-device-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995327 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdp7s\" (UniqueName: \"kubernetes.io/projected/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-kube-api-access-bdp7s\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995348 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-socket-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995393 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-systemd-units\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.995709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995393 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-kubelet\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995433 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-log-socket\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995350 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-systemd-units\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995456 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-device-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovnkube-config\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995529 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-hostroot\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60f70359-925f-4018-8c1e-8c35bfc8a21c-konnectivity-ca\") pod \"konnectivity-agent-d22vc\" (UID: \"60f70359-925f-4018-8c1e-8c35bfc8a21c\") " pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995540 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995561 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fdd9652-a28f-4f8b-8190-cf0629da7d63-host\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995586 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fdd9652-a28f-4f8b-8190-cf0629da7d63-serviceca\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995609 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-hostroot\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2hcm\" (UniqueName: \"kubernetes.io/projected/57d2805d-bf10-4bb3-927f-83bdb1606515-kube-api-access-h2hcm\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995678 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-kubelet\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995696 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995718 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-kubelet\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995724 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-daemon-config\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.996556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-slash\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-cni-netd\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995872 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995880 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-slash\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995896 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-system-cni-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995919 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20675f17-edae-4ad5-960c-9aff1a7fd760-cni-binary-copy\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995924 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-cni-netd\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995944 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc2b5735-0688-4900-83a9-53eda1359d41-dbus\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995968 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxbb8\" (UniqueName: \"kubernetes.io/projected/bb6e4e50-6550-4178-b2b7-f28e7ba59754-kube-api-access-mxbb8\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995985 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-system-cni-dir\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.995994 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-sys-fs\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996015 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996019 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj4bm\" (UniqueName: \"kubernetes.io/projected/16cdd27a-fbce-4409-8ca7-36e3e8105f04-kube-api-access-zj4bm\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-modprobe-d\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovnkube-script-lib\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996144 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-cnibin\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996165 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-sys-fs\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.997248 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996118 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovnkube-config\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996194 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-cnibin\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996223 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-kubernetes\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-var-lib-kubelet\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996264 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-cni-bin\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996266 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-modprobe-d\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996286 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-system-cni-dir\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996306 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysctl-d\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996330 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-os-release\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996342 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-var-lib-kubelet\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996353 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-socket-dir-parent\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996362 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-system-cni-dir\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996374 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-kubernetes\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-cni-bin\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996398 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-os-release\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996404 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-cni-multus\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-cni-multus\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996440 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-hosts-file\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:15.998045 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996443 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-multus-socket-dir-parent\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996455 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20675f17-edae-4ad5-960c-9aff1a7fd760-cni-binary-copy\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996465 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysctl-d\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996472 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-tmp-dir\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996500 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-tuned\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996533 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-env-overrides\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996570 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-etc-kubernetes\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996595 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvm29\" (UniqueName: \"kubernetes.io/projected/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-kube-api-access-kvm29\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996622 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-registration-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovnkube-script-lib\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-node-log\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996663 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-etc-kubernetes\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996696 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-registration-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996704 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-host-slash\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996708 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-node-log\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996729 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4pn\" (UniqueName: \"kubernetes.io/projected/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-kube-api-access-rc4pn\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:15.998900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996735 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996752 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn52f\" (UniqueName: \"kubernetes.io/projected/9fdd9652-a28f-4f8b-8190-cf0629da7d63-kube-api-access-bn52f\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996777 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-systemd\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60f70359-925f-4018-8c1e-8c35bfc8a21c-agent-certs\") pod \"konnectivity-agent-d22vc\" (UID: \"60f70359-925f-4018-8c1e-8c35bfc8a21c\") " pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996852 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-iptables-alerter-script\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996876 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-sys\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cni-binary-copy\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysconfig\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996936 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-env-overrides\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996909 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-systemd\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.996957 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysctl-conf\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-cni-bin\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997018 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-sys\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997042 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc2b5735-0688-4900-83a9-53eda1359d41-kubelet-config\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cnibin\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-lib-modules\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997116 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-host\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:15.999743 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-etc-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997173 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbsgm\" (UniqueName: \"kubernetes.io/projected/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-kube-api-access-dbsgm\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997190 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysctl-conf\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997197 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997236 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-sysconfig\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997253 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997272 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20675f17-edae-4ad5-960c-9aff1a7fd760-host-var-lib-cni-bin\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997279 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-systemd\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997320 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-systemd\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997327 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cnibin\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997370 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16cdd27a-fbce-4409-8ca7-36e3e8105f04-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997368 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-etc-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cni-binary-copy\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997465 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997470 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-lib-modules\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997491 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-ovn\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997517 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d2805d-bf10-4bb3-927f-83bdb1606515-host\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.000611 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997552 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-ovn\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.001512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997564 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-run-openvswitch\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.001512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.997673 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb6e4e50-6550-4178-b2b7-f28e7ba59754-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:16.001512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.998855 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57d2805d-bf10-4bb3-927f-83bdb1606515-etc-tuned\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.001512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.998875 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.001512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.999000 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d2805d-bf10-4bb3-927f-83bdb1606515-tmp\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.001512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:15.999551 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60f70359-925f-4018-8c1e-8c35bfc8a21c-agent-certs\") pod \"konnectivity-agent-d22vc\" (UID: \"60f70359-925f-4018-8c1e-8c35bfc8a21c\") " pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:16.003544 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.003518 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9t9w\" (UniqueName: \"kubernetes.io/projected/20675f17-edae-4ad5-960c-9aff1a7fd760-kube-api-access-b9t9w\") pod \"multus-6krhr\" (UID: \"20675f17-edae-4ad5-960c-9aff1a7fd760\") " pod="openshift-multus/multus-6krhr" Jul 24 22:46:16.004006 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.003984 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2hcm\" (UniqueName: \"kubernetes.io/projected/57d2805d-bf10-4bb3-927f-83bdb1606515-kube-api-access-h2hcm\") pod \"tuned-668w8\" (UID: \"57d2805d-bf10-4bb3-927f-83bdb1606515\") " pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.004703 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.004666 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxbb8\" (UniqueName: \"kubernetes.io/projected/bb6e4e50-6550-4178-b2b7-f28e7ba59754-kube-api-access-mxbb8\") pod \"multus-additional-cni-plugins-rcdd2\" (UID: \"bb6e4e50-6550-4178-b2b7-f28e7ba59754\") " pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:16.004894 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.004862 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj4bm\" (UniqueName: \"kubernetes.io/projected/16cdd27a-fbce-4409-8ca7-36e3e8105f04-kube-api-access-zj4bm\") pod \"aws-ebs-csi-driver-node-bj6q6\" (UID: \"16cdd27a-fbce-4409-8ca7-36e3e8105f04\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:16.005461 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.005281 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbsgm\" (UniqueName: \"kubernetes.io/projected/a101d45a-fe1a-47eb-a19b-6311bc8e3a19-kube-api-access-dbsgm\") pod \"ovnkube-node-t7mvk\" (UID: \"a101d45a-fe1a-47eb-a19b-6311bc8e3a19\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.005461 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.005290 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdp7s\" (UniqueName: \"kubernetes.io/projected/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-kube-api-access-bdp7s\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:16.043134 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.043105 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 22:46:16.098077 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098034 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:16.098077 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098078 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fdd9652-a28f-4f8b-8190-cf0629da7d63-host\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098100 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fdd9652-a28f-4f8b-8190-cf0629da7d63-serviceca\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098159 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fdd9652-a28f-4f8b-8190-cf0629da7d63-host\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098174 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc2b5735-0688-4900-83a9-53eda1359d41-dbus\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098221 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-hosts-file\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-tmp-dir\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098271 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm29\" (UniqueName: \"kubernetes.io/projected/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-kube-api-access-kvm29\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.098316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098302 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-host-slash\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.098321 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098327 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4pn\" (UniqueName: \"kubernetes.io/projected/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-kube-api-access-rc4pn\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098344 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-hosts-file\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098356 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn52f\" (UniqueName: \"kubernetes.io/projected/9fdd9652-a28f-4f8b-8190-cf0629da7d63-kube-api-access-bn52f\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.098386 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:16.598363498 +0000 UTC m=+3.062551926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098419 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc2b5735-0688-4900-83a9-53eda1359d41-dbus\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098508 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-iptables-alerter-script\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098537 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-host-slash\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098547 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc2b5735-0688-4900-83a9-53eda1359d41-kubelet-config\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fdd9652-a28f-4f8b-8190-cf0629da7d63-serviceca\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098591 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc2b5735-0688-4900-83a9-53eda1359d41-kubelet-config\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:16.098635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098634 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:16.099032 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.098846 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-tmp-dir\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.099124 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.099105 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-iptables-alerter-script\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.105038 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.105008 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:16.105038 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.105034 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:16.105246 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.105049 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:16.105246 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.105113 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:16.60509633 +0000 UTC m=+3.069284740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:16.107154 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.107131 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvm29\" (UniqueName: \"kubernetes.io/projected/d4a20072-e90c-4f9d-a5b6-1b0b453f4c66-kube-api-access-kvm29\") pod \"node-resolver-85lrd\" (UID: \"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66\") " pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.107396 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.107374 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4pn\" (UniqueName: \"kubernetes.io/projected/f87daa3b-e7ef-4b4d-aa19-5cd12561bcea-kube-api-access-rc4pn\") pod \"iptables-alerter-s482f\" (UID: \"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea\") " pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.107464 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.107418 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn52f\" (UniqueName: \"kubernetes.io/projected/9fdd9652-a28f-4f8b-8190-cf0629da7d63-kube-api-access-bn52f\") pod \"node-ca-bxr24\" (UID: \"9fdd9652-a28f-4f8b-8190-cf0629da7d63\") " pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.183554 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.183467 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:16.191011 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.190986 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6krhr" Jul 24 22:46:16.205957 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.205926 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" Jul 24 22:46:16.212907 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.212882 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:16.219706 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.219678 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-668w8" Jul 24 22:46:16.226538 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.226516 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" Jul 24 22:46:16.235103 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.235080 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s482f" Jul 24 22:46:16.242723 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.242702 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-85lrd" Jul 24 22:46:16.248301 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.248276 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxr24" Jul 24 22:46:16.501934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.501842 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:16.502087 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.502011 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:16.502134 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.502090 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:17.502068933 +0000 UTC m=+3.966257355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:16.602716 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.602679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:16.602912 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.602821 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:16.602912 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.602887 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:17.602874138 +0000 UTC m=+4.067062541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:16.703834 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.703779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:16.704016 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.703930 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:16.704016 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.703950 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:16.704016 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.703981 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:16.704149 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:16.704043 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:17.70402412 +0000 UTC m=+4.168212541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:16.909360 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.909332 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cdd27a_fbce_4409_8ca7_36e3e8105f04.slice/crio-7ced0ce12276a98f4d2449f78469b7c3583f8919139fbe3e05a24676065b4fcb WatchSource:0}: Error finding container 7ced0ce12276a98f4d2449f78469b7c3583f8919139fbe3e05a24676065b4fcb: Status 404 returned error can't find the container with id 7ced0ce12276a98f4d2449f78469b7c3583f8919139fbe3e05a24676065b4fcb Jul 24 22:46:16.911227 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.911078 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f70359_925f_4018_8c1e_8c35bfc8a21c.slice/crio-423429e9d53f479f8dfdd25199404205e1ee611d8bdb9c3ab113ae4ff33de720 WatchSource:0}: Error finding container 423429e9d53f479f8dfdd25199404205e1ee611d8bdb9c3ab113ae4ff33de720: Status 404 returned error can't find the container with id 423429e9d53f479f8dfdd25199404205e1ee611d8bdb9c3ab113ae4ff33de720 Jul 24 22:46:16.912265 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.912238 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20675f17_edae_4ad5_960c_9aff1a7fd760.slice/crio-9e1debdaa49e41993afaa35bbf9ef2fa4f7b587a3e70ca81ca99b20577f8f2eb WatchSource:0}: Error finding container 9e1debdaa49e41993afaa35bbf9ef2fa4f7b587a3e70ca81ca99b20577f8f2eb: Status 404 returned error can't find the container with id 9e1debdaa49e41993afaa35bbf9ef2fa4f7b587a3e70ca81ca99b20577f8f2eb Jul 24 22:46:16.915075 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.914874 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a20072_e90c_4f9d_a5b6_1b0b453f4c66.slice/crio-47b2cb79bf05c127f1c7246e390375f8f36658f25d1915b2d2662a7b425343ee WatchSource:0}: Error finding container 47b2cb79bf05c127f1c7246e390375f8f36658f25d1915b2d2662a7b425343ee: Status 404 returned error can't find the container with id 47b2cb79bf05c127f1c7246e390375f8f36658f25d1915b2d2662a7b425343ee Jul 24 22:46:16.916626 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.916591 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d2805d_bf10_4bb3_927f_83bdb1606515.slice/crio-35352d6babd61d5d3748d8b0f298f4939e58d713487739d91511a1bee7db603f WatchSource:0}: Error finding container 35352d6babd61d5d3748d8b0f298f4939e58d713487739d91511a1bee7db603f: Status 404 returned error can't find the container with id 35352d6babd61d5d3748d8b0f298f4939e58d713487739d91511a1bee7db603f Jul 24 22:46:16.917513 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.917488 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda101d45a_fe1a_47eb_a19b_6311bc8e3a19.slice/crio-2ffc7fb55f918a18b914dcc7f425436e8f206572489594cd0663a62318eb4492 WatchSource:0}: Error finding container 2ffc7fb55f918a18b914dcc7f425436e8f206572489594cd0663a62318eb4492: Status 404 returned error can't find the container with id 2ffc7fb55f918a18b914dcc7f425436e8f206572489594cd0663a62318eb4492 Jul 24 22:46:16.918486 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.918467 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6e4e50_6550_4178_b2b7_f28e7ba59754.slice/crio-f95941d081dad2bc609340b468545d9eb4d55685bd3247413f695aeb5a72825f WatchSource:0}: Error finding container f95941d081dad2bc609340b468545d9eb4d55685bd3247413f695aeb5a72825f: Status 404 returned error can't find the container with id f95941d081dad2bc609340b468545d9eb4d55685bd3247413f695aeb5a72825f Jul 24 22:46:16.919424 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:16.919397 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87daa3b_e7ef_4b4d_aa19_5cd12561bcea.slice/crio-09298803c22565be017669fb9279b442ec3fd0a37d3d9e3097e7283787dd914b WatchSource:0}: Error finding container 09298803c22565be017669fb9279b442ec3fd0a37d3d9e3097e7283787dd914b: Status 404 returned error can't find the container with id 09298803c22565be017669fb9279b442ec3fd0a37d3d9e3097e7283787dd914b Jul 24 22:46:16.929860 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.929778 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 22:41:15 +0000 UTC" deadline="2028-02-23 22:45:24.828541543 +0000 UTC" Jul 24 22:46:16.929939 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:16.929855 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13895h59m7.898691609s" Jul 24 22:46:17.046572 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.046401 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:17.046711 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.046660 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:17.054541 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.054499 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d22vc" event={"ID":"60f70359-925f-4018-8c1e-8c35bfc8a21c","Type":"ContainerStarted","Data":"423429e9d53f479f8dfdd25199404205e1ee611d8bdb9c3ab113ae4ff33de720"} Jul 24 22:46:17.055745 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.055720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s482f" event={"ID":"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea","Type":"ContainerStarted","Data":"09298803c22565be017669fb9279b442ec3fd0a37d3d9e3097e7283787dd914b"} Jul 24 22:46:17.056838 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.056814 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerStarted","Data":"f95941d081dad2bc609340b468545d9eb4d55685bd3247413f695aeb5a72825f"} Jul 24 22:46:17.057974 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.057949 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-668w8" event={"ID":"57d2805d-bf10-4bb3-927f-83bdb1606515","Type":"ContainerStarted","Data":"35352d6babd61d5d3748d8b0f298f4939e58d713487739d91511a1bee7db603f"} Jul 24 22:46:17.059658 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.059631 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-85lrd" event={"ID":"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66","Type":"ContainerStarted","Data":"47b2cb79bf05c127f1c7246e390375f8f36658f25d1915b2d2662a7b425343ee"} Jul 24 22:46:17.061010 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.060983 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" event={"ID":"16cdd27a-fbce-4409-8ca7-36e3e8105f04","Type":"ContainerStarted","Data":"7ced0ce12276a98f4d2449f78469b7c3583f8919139fbe3e05a24676065b4fcb"} Jul 24 22:46:17.062765 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.062743 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" event={"ID":"c3e94d89104b64808722a056b82536ee","Type":"ContainerStarted","Data":"56d82b5536b5f3e3f4ffba3897f0aa5e715046ee5a83871617f71d54b3f8fa08"} Jul 24 22:46:17.064955 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.064931 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxr24" event={"ID":"9fdd9652-a28f-4f8b-8190-cf0629da7d63","Type":"ContainerStarted","Data":"9b51bfb1689658209fe1b79c3974efa6b5f7edcf854fc535675b4db43611c0b5"} Jul 24 22:46:17.067670 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.067649 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"2ffc7fb55f918a18b914dcc7f425436e8f206572489594cd0663a62318eb4492"} Jul 24 22:46:17.068709 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.068690 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6krhr" event={"ID":"20675f17-edae-4ad5-960c-9aff1a7fd760","Type":"ContainerStarted","Data":"9e1debdaa49e41993afaa35bbf9ef2fa4f7b587a3e70ca81ca99b20577f8f2eb"} Jul 24 22:46:17.076092 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.076055 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-39.ec2.internal" podStartSLOduration=2.076043155 podStartE2EDuration="2.076043155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:17.075748435 +0000 UTC m=+3.539936860" watchObservedRunningTime="2026-07-24 22:46:17.076043155 +0000 UTC m=+3.540231581" Jul 24 22:46:17.512833 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.509361 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:17.512833 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.509559 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:17.512833 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.509624 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:19.509604611 +0000 UTC m=+5.973793017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:17.610429 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.610357 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:17.610614 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.610490 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:17.610614 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.610551 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:19.610533002 +0000 UTC m=+6.074721407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:17.711582 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.711515 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:17.711746 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.711696 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:17.711746 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.711722 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:17.711746 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.711735 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:17.711929 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:17.711830 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:19.711777542 +0000 UTC m=+6.175965968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:17.930512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.930425 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 22:41:15 +0000 UTC" deadline="2027-12-26 00:12:30.986861178 +0000 UTC" Jul 24 22:46:17.930512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:17.930463 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12457h26m13.056403207s" Jul 24 22:46:18.049141 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:18.048402 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:18.049141 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:18.048577 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:18.049141 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:18.048985 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:18.049141 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:18.049075 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:18.094820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:18.093727 2585 generic.go:356] "Generic (PLEG): container finished" podID="4036643f3e6cef3ea45959f2a8054c05" containerID="0f15890477cadd580c1be3a30a95df4558dd2363801c3d440a45c46c886b6a09" exitCode=0 Jul 24 22:46:18.094820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:18.094683 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" event={"ID":"4036643f3e6cef3ea45959f2a8054c05","Type":"ContainerDied","Data":"0f15890477cadd580c1be3a30a95df4558dd2363801c3d440a45c46c886b6a09"} Jul 24 22:46:19.046775 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:19.046272 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:19.046775 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.046415 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:19.112544 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:19.111923 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" event={"ID":"4036643f3e6cef3ea45959f2a8054c05","Type":"ContainerStarted","Data":"810c0b5e5b2150357a7420813d02312413a4027703576ff7c75b7ebf0a4b22d8"} Jul 24 22:46:19.132974 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:19.132914 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-39.ec2.internal" podStartSLOduration=4.132894015 podStartE2EDuration="4.132894015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:19.132018348 +0000 UTC m=+5.596206774" watchObservedRunningTime="2026-07-24 22:46:19.132894015 +0000 UTC m=+5.597082444" Jul 24 22:46:19.526986 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:19.526905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:19.527161 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.527071 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:19.527161 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.527148 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:23.527127406 +0000 UTC m=+9.991315814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:19.627385 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:19.627344 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:19.627565 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.627548 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:19.627657 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.627621 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:23.627601157 +0000 UTC m=+10.091789580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:19.728115 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:19.728080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:19.728283 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.728258 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:19.728283 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.728279 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:19.728386 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.728294 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:19.728386 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:19.728354 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:23.728335864 +0000 UTC m=+10.192524271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:20.047993 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:20.047916 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:20.048449 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:20.048052 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:20.048449 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:20.048377 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:20.048559 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:20.048460 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:21.046594 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:21.046564 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:21.046778 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:21.046694 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:22.046073 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:22.046039 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:22.046520 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:22.046039 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:22.046520 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:22.046166 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:22.046520 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:22.046232 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:23.047041 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:23.046948 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:23.047411 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.047103 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:23.563088 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:23.562462 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:23.563088 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.562668 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:23.563088 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.562732 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:31.562712791 +0000 UTC m=+18.026901210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:23.663631 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:23.663583 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:23.663817 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.663751 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:23.663883 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.663875 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:31.66385508 +0000 UTC m=+18.128043490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:23.764687 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:23.764344 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:23.764687 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.764520 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:23.764687 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.764540 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:23.764687 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.764552 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:23.764687 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:23.764610 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:31.764591938 +0000 UTC m=+18.228780345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:24.047179 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:24.047096 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:24.047603 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:24.047209 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:24.047603 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:24.047258 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:24.047603 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:24.047354 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:25.046884 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:25.046851 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:25.047057 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:25.046974 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:26.046039 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:26.045997 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:26.046039 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:26.046037 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:26.046620 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:26.046128 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:26.046620 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:26.046262 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:27.046883 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:27.046854 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:27.047244 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:27.046953 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:28.046628 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:28.046538 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:28.046628 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:28.046570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:28.046860 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:28.046669 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:28.046860 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:28.046827 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:29.046616 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:29.046576 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:29.046854 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:29.046716 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:30.046226 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:30.046194 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:30.046688 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:30.046200 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:30.046688 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:30.046329 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:30.046688 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:30.046396 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:31.045963 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:31.045924 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:31.046187 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.046037 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:31.623944 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:31.623903 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:31.624404 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.624084 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:31.624404 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.624169 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:47.624154254 +0000 UTC m=+34.088342670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:31.724322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:31.724283 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:31.724491 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.724423 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:31.724568 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.724502 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:47.724472832 +0000 UTC m=+34.188661239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:31.825150 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:31.825068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:31.825301 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.825242 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:31.825301 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.825267 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:31.825301 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.825281 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:31.825417 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:31.825343 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:47.825328832 +0000 UTC m=+34.289517234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:32.046473 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:32.046436 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:32.046645 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:32.046484 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:32.046645 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:32.046585 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:32.046752 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:32.046713 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:33.046832 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:33.046783 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:33.047272 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:33.046921 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:34.047638 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:34.047605 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:34.048126 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:34.047708 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:34.048126 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:34.047758 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:34.048126 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:34.047875 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:35.046984 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:35.046924 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:35.047181 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:35.047062 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:36.046392 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.046086 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:36.046989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.046089 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:36.046989 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:36.046476 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:36.046989 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:36.046527 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:36.150109 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.150031 2585 generic.go:356] "Generic (PLEG): container finished" podID="bb6e4e50-6550-4178-b2b7-f28e7ba59754" containerID="642a0b3db6c75bf406afb4fb4a9bf4007f8a7e63afbfa8774e3f19fc2d360bdf" exitCode=0 Jul 24 22:46:36.150265 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.150129 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerDied","Data":"642a0b3db6c75bf406afb4fb4a9bf4007f8a7e63afbfa8774e3f19fc2d360bdf"} Jul 24 22:46:36.152015 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.151968 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-668w8" event={"ID":"57d2805d-bf10-4bb3-927f-83bdb1606515","Type":"ContainerStarted","Data":"a96867a21f15c18516f3d6977968b5928b9916f90eb607159ad7e6fee4078212"} Jul 24 22:46:36.153738 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.153705 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-85lrd" event={"ID":"d4a20072-e90c-4f9d-a5b6-1b0b453f4c66","Type":"ContainerStarted","Data":"ca1bafb3dac1c0a35d95ff3be7f23b35631d2bec2d68a29c1e1e3f8033d23d74"} Jul 24 22:46:36.155339 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.155311 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" event={"ID":"16cdd27a-fbce-4409-8ca7-36e3e8105f04","Type":"ContainerStarted","Data":"5bc4013942fb2c3c5482130c6dc3ff9c0ca50ae03534427222c83a03ca9547e9"} Jul 24 22:46:36.156939 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.156906 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxr24" event={"ID":"9fdd9652-a28f-4f8b-8190-cf0629da7d63","Type":"ContainerStarted","Data":"f3c234d1d01e97ea255606fb96ce3eaed5bfd1b130a6a88304defed26f94649e"} Jul 24 22:46:36.160074 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.160050 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"b92589e50fb223adaa01052e162e8988246135fdef54448ba00d21f91640362e"} Jul 24 22:46:36.160187 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.160132 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"d79f838181c60b5c2e67713dc144411805c8995ce52e4b06d1777849977fc16f"} Jul 24 22:46:36.160187 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.160174 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"21f9eb5deb6930c71327b02a6f65e16f8e00cb81e926c94b9957b41a73519e91"} Jul 24 22:46:36.160293 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.160203 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"a8e3ac675e2ad526451f3fcfa94e3d835c215cb022015bd8ca38192a46a01c95"} Jul 24 22:46:36.160293 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.160230 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"af51c456b886fce2c00a05f050a95a419fb2c1444c43ee7bdf0b0ff8f9dc0c0f"} Jul 24 22:46:36.160293 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.160262 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"ff4734bee360c08fefe227a3e017a6b5a2496fc81053e5bdd0f5ce31504fd16f"} Jul 24 22:46:36.161552 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.161530 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6krhr" event={"ID":"20675f17-edae-4ad5-960c-9aff1a7fd760","Type":"ContainerStarted","Data":"8012893ac9251629705cedd9365e64a6b96a7e24990dd3193af684df1ee34c61"} Jul 24 22:46:36.163035 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.163011 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d22vc" event={"ID":"60f70359-925f-4018-8c1e-8c35bfc8a21c","Type":"ContainerStarted","Data":"82de41b7c16bc5075ee3b07ae2b37067806752fac9d7a4db3ef9bcb441e14bc8"} Jul 24 22:46:36.181999 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.181963 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxr24" podStartSLOduration=3.76743042 podStartE2EDuration="22.181950242s" totalImagesPullingTime="18.414519822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:36.18140817 +0000 UTC m=+22.645596599" watchObservedRunningTime="2026-07-24 22:46:36.181950242 +0000 UTC m=+22.646138666" Jul 24 22:46:36.200167 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.200122 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6krhr" podStartSLOduration=3.711188137 podStartE2EDuration="22.200105314s" totalImagesPullingTime="18.488917177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:36.199979163 +0000 UTC m=+22.664167589" watchObservedRunningTime="2026-07-24 22:46:36.200105314 +0000 UTC m=+22.664293740" Jul 24 22:46:36.212756 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.212724 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d22vc" podStartSLOduration=7.560724846 podStartE2EDuration="22.212717676s" totalImagesPullingTime="14.65199283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:36.212485788 +0000 UTC m=+22.676674213" watchObservedRunningTime="2026-07-24 22:46:36.212717676 +0000 UTC m=+22.676906101" Jul 24 22:46:36.240591 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.240556 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-85lrd" podStartSLOduration=3.820287034 podStartE2EDuration="22.240545679s" totalImagesPullingTime="18.420258645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:36.240340006 +0000 UTC m=+22.704528431" watchObservedRunningTime="2026-07-24 22:46:36.240545679 +0000 UTC m=+22.704734103" Jul 24 22:46:36.240841 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.240822 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-668w8" podStartSLOduration=3.815036099 podStartE2EDuration="22.240815413s" totalImagesPullingTime="18.425779314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:36.227079662 +0000 UTC m=+22.691268087" watchObservedRunningTime="2026-07-24 22:46:36.240815413 +0000 UTC m=+22.705003838" Jul 24 22:46:36.843024 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:36.843000 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 22:46:37.045974 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.045899 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:37.046126 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:37.046019 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:37.109912 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.109768 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T22:46:36.843019851Z","UUID":"1f49ce36-4f44-4ad6-90b0-be1c36ee5f89","Handler":null,"Name":"","Endpoint":""} Jul 24 22:46:37.111415 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.111386 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 22:46:37.111535 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.111425 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 22:46:37.167181 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.167150 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s482f" event={"ID":"f87daa3b-e7ef-4b4d-aa19-5cd12561bcea","Type":"ContainerStarted","Data":"3378fe2ea330e146976f47c2fec625934347d437fc1027d111882dd02203bae4"} Jul 24 22:46:37.169244 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.169217 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" event={"ID":"16cdd27a-fbce-4409-8ca7-36e3e8105f04","Type":"ContainerStarted","Data":"7d83007476a4c598577b17b7483b90b194938182533b8f74d7a857cadffdec93"} Jul 24 22:46:37.181397 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.181361 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s482f" podStartSLOduration=8.537626344 podStartE2EDuration="23.18134798s" totalImagesPullingTime="14.643721636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:37.180983206 +0000 UTC m=+23.645171630" watchObservedRunningTime="2026-07-24 22:46:37.18134798 +0000 UTC m=+23.645536406" Jul 24 22:46:37.321265 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.321194 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:37.321873 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:37.321853 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:38.046669 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.046638 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:38.046860 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.046649 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:38.046860 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:38.046760 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:38.046860 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:38.046841 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:38.176683 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.176491 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"034722c8ec01577b2ab525304ebdb2373c2b045928dfd69216b916a1f87e5bf2"} Jul 24 22:46:38.179201 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.179066 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" event={"ID":"16cdd27a-fbce-4409-8ca7-36e3e8105f04","Type":"ContainerStarted","Data":"c407c6d68de3984750ffb13ac49f35f5a24e6f0f9ddabb833af7d3511cdd4b98"} Jul 24 22:46:38.179637 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.179506 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:38.179940 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.179919 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d22vc" Jul 24 22:46:38.198293 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:38.198238 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj6q6" podStartSLOduration=3.589504284 podStartE2EDuration="24.198218044s" totalImagesPullingTime="20.60871376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:38.197322169 +0000 UTC m=+24.661510595" watchObservedRunningTime="2026-07-24 22:46:38.198218044 +0000 UTC m=+24.662406470" Jul 24 22:46:39.046481 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:39.046291 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:39.046666 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:39.046586 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:40.046231 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:40.046203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:40.046659 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:40.046203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:40.046659 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:40.046326 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:40.046659 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:40.046415 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:41.046512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.046315 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:41.047412 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:41.046616 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:41.190247 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.190206 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" event={"ID":"a101d45a-fe1a-47eb-a19b-6311bc8e3a19","Type":"ContainerStarted","Data":"028ff43657d05f0800a4f67c39795ab76eadf01fcec9f864092eee867ccdc81b"} Jul 24 22:46:41.190469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.190395 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:41.190543 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.190473 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:41.190543 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.190521 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:41.192338 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.192308 2585 generic.go:356] "Generic (PLEG): container finished" podID="bb6e4e50-6550-4178-b2b7-f28e7ba59754" containerID="334a5b914b79964adeb7cc876be6ca7c1dab793184f5150157cff23ff4341990" exitCode=0 Jul 24 22:46:41.192468 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.192344 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerDied","Data":"334a5b914b79964adeb7cc876be6ca7c1dab793184f5150157cff23ff4341990"} Jul 24 22:46:41.207754 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.207725 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:41.207972 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.207860 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:46:41.218859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:41.218780 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" podStartSLOduration=8.749230487 podStartE2EDuration="27.218764515s" totalImagesPullingTime="18.469534028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:41.217348113 +0000 UTC m=+27.681536537" watchObservedRunningTime="2026-07-24 22:46:41.218764515 +0000 UTC m=+27.682952940" Jul 24 22:46:42.046288 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.046195 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:42.046409 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:42.046331 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:42.046781 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.046535 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:42.046781 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:42.046633 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:42.196690 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.196658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerStarted","Data":"bf9c0f34ad07bd29f73882406124517531fb7b4aed41d71d9fd2e246b0731c5c"} Jul 24 22:46:42.259379 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.259335 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5k5b"] Jul 24 22:46:42.259515 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.259501 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:42.259647 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:42.259620 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:42.263145 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.263112 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w8lhp"] Jul 24 22:46:42.263268 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.263257 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:42.263378 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:42.263355 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:42.263897 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.263873 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjswr"] Jul 24 22:46:42.263998 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:42.263984 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:42.264110 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:42.264088 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:43.201128 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:43.200930 2585 generic.go:356] "Generic (PLEG): container finished" podID="bb6e4e50-6550-4178-b2b7-f28e7ba59754" containerID="bf9c0f34ad07bd29f73882406124517531fb7b4aed41d71d9fd2e246b0731c5c" exitCode=0 Jul 24 22:46:43.201128 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:43.201013 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerDied","Data":"bf9c0f34ad07bd29f73882406124517531fb7b4aed41d71d9fd2e246b0731c5c"} Jul 24 22:46:44.047238 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:44.047203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:44.047408 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:44.047299 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:44.047408 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:44.047316 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:44.047408 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:44.047337 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:44.047515 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:44.047419 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:44.047515 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:44.047493 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:45.211396 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:45.211319 2585 generic.go:356] "Generic (PLEG): container finished" podID="bb6e4e50-6550-4178-b2b7-f28e7ba59754" containerID="42e649eeb273cac09b7ac7425878e1c0f2bef76348ba73d6d436e45bf873d579" exitCode=0 Jul 24 22:46:45.211396 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:45.211356 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerDied","Data":"42e649eeb273cac09b7ac7425878e1c0f2bef76348ba73d6d436e45bf873d579"} Jul 24 22:46:46.046366 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:46.046334 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:46.046544 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:46.046349 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:46.046544 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:46.046437 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:46.046544 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:46.046492 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:46.046544 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:46.046485 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:46.046757 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:46.046580 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:47.644735 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:47.644703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:47.645196 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.644888 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:47.645196 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.644967 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs podName:ca48d86b-9252-448f-ab1b-5abe1d3c03b4 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:19.644946156 +0000 UTC m=+66.109134574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs") pod "network-metrics-daemon-qjswr" (UID: "ca48d86b-9252-448f-ab1b-5abe1d3c03b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 22:46:47.745410 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:47.745377 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:47.745587 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.745543 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:47.745655 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.745618 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret podName:dc2b5735-0688-4900-83a9-53eda1359d41 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:19.745597792 +0000 UTC m=+66.209786196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret") pod "global-pull-secret-syncer-k5k5b" (UID: "dc2b5735-0688-4900-83a9-53eda1359d41") : object "kube-system"/"original-pull-secret" not registered Jul 24 22:46:47.846091 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:47.846056 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:47.847827 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.846468 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 22:46:47.847827 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.846498 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 22:46:47.847827 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.846512 2585 projected.go:196] Error preparing data for projected volume kube-api-access-g7rp9 for pod openshift-network-diagnostics/network-check-target-w8lhp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:47.847827 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:47.846576 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9 podName:b22801b2-7bcc-41a2-866f-6fe16c6a5b11 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:19.84655782 +0000 UTC m=+66.310746240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7rp9" (UniqueName: "kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9") pod "network-check-target-w8lhp" (UID: "b22801b2-7bcc-41a2-866f-6fe16c6a5b11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 22:46:48.046368 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.046281 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:48.046522 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.046281 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:48.046522 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.046411 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5k5b" podUID="dc2b5735-0688-4900-83a9-53eda1359d41" Jul 24 22:46:48.046522 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.046490 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjswr" podUID="ca48d86b-9252-448f-ab1b-5abe1d3c03b4" Jul 24 22:46:48.046653 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.046550 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:48.046653 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.046623 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8lhp" podUID="b22801b2-7bcc-41a2-866f-6fe16c6a5b11" Jul 24 22:46:48.360287 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.360221 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-39.ec2.internal" event="NodeReady" Jul 24 22:46:48.360437 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.360347 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 22:46:48.393745 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.393719 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt"] Jul 24 22:46:48.396260 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.396233 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.399370 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.398830 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 22:46:48.399370 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.398850 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 22:46:48.399370 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.398870 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59m4s\"" Jul 24 22:46:48.400318 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.399905 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 22:46:48.404371 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.404349 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h9z5x"] Jul 24 22:46:48.404485 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.404360 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 22:46:48.406939 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.406922 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.407593 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.407573 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6krcc"] Jul 24 22:46:48.409362 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.409344 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.410060 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.410036 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 22:46:48.410401 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.410380 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 22:46:48.410586 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.410565 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l2hpm\"" Jul 24 22:46:48.411211 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.411189 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt"] Jul 24 22:46:48.411847 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.411672 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-69gfn\"" Jul 24 22:46:48.411847 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.411703 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 22:46:48.411847 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.411736 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 22:46:48.412125 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.412107 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 22:46:48.417512 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.417492 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9z5x"] Jul 24 22:46:48.420729 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.420685 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6krcc"] Jul 24 22:46:48.551648 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551601 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f8692cb-9393-4eee-9b4e-c6b491f26b18-ca-trust-extracted\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.551648 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551648 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-certificates\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.551895 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551677 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/683c14c1-c931-4334-ac0e-400c01d51dc3-config-volume\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.551895 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551703 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2vh\" (UniqueName: \"kubernetes.io/projected/46d51505-a901-49de-a502-cf1ad9d190a4-kube-api-access-lq2vh\") pod \"ingress-canary-6krcc\" (UID: \"46d51505-a901-49de-a502-cf1ad9d190a4\") " pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.551895 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551733 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-image-registry-private-configuration\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.551895 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551791 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.551895 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551844 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-installation-pull-secrets\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.552101 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551905 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.552101 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551933 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-bound-sa-token\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.552101 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.551966 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfrt9\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-kube-api-access-lfrt9\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.552101 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.552011 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683c14c1-c931-4334-ac0e-400c01d51dc3-tmp-dir\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.552101 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.552071 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rftj\" (UniqueName: \"kubernetes.io/projected/683c14c1-c931-4334-ac0e-400c01d51dc3-kube-api-access-5rftj\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.552311 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.552112 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-trusted-ca\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.552311 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.552139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46d51505-a901-49de-a502-cf1ad9d190a4-cert\") pod \"ingress-canary-6krcc\" (UID: \"46d51505-a901-49de-a502-cf1ad9d190a4\") " pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.653039 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.652953 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-trusted-ca\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.653039 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.653031 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46d51505-a901-49de-a502-cf1ad9d190a4-cert\") pod \"ingress-canary-6krcc\" (UID: \"46d51505-a901-49de-a502-cf1ad9d190a4\") " pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.653465 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.653081 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f8692cb-9393-4eee-9b4e-c6b491f26b18-ca-trust-extracted\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.653465 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.653113 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-certificates\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.653465 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.653140 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/683c14c1-c931-4334-ac0e-400c01d51dc3-config-volume\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.653465 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.653163 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2vh\" (UniqueName: \"kubernetes.io/projected/46d51505-a901-49de-a502-cf1ad9d190a4-kube-api-access-lq2vh\") pod \"ingress-canary-6krcc\" (UID: \"46d51505-a901-49de-a502-cf1ad9d190a4\") " pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.654052 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f8692cb-9393-4eee-9b4e-c6b491f26b18-ca-trust-extracted\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654222 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654200 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-certificates\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654274 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.653200 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-image-registry-private-configuration\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654377 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654332 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-installation-pull-secrets\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654433 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654407 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.654487 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654452 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-bound-sa-token\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654540 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfrt9\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-kube-api-access-lfrt9\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.654540 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683c14c1-c931-4334-ac0e-400c01d51dc3-tmp-dir\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.654636 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.654558 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rftj\" (UniqueName: \"kubernetes.io/projected/683c14c1-c931-4334-ac0e-400c01d51dc3-kube-api-access-5rftj\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.654981 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.655005 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt: secret "image-registry-tls" not found Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.655099 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-trusted-ca\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.655296 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/683c14c1-c931-4334-ac0e-400c01d51dc3-config-volume\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.655482 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683c14c1-c931-4334-ac0e-400c01d51dc3-tmp-dir\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.655591 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.655613 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls podName:2f8692cb-9393-4eee-9b4e-c6b491f26b18 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:49.155590221 +0000 UTC m=+35.619778639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls") pod "image-registry-5ddf8f4b6b-kbqdt" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18") : secret "image-registry-tls" not found Jul 24 22:46:48.658288 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:48.655646 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls podName:683c14c1-c931-4334-ac0e-400c01d51dc3 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:49.155623884 +0000 UTC m=+35.619812292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls") pod "dns-default-h9z5x" (UID: "683c14c1-c931-4334-ac0e-400c01d51dc3") : secret "dns-default-metrics-tls" not found Jul 24 22:46:48.659473 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.659449 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-installation-pull-secrets\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.659580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.659506 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46d51505-a901-49de-a502-cf1ad9d190a4-cert\") pod \"ingress-canary-6krcc\" (UID: \"46d51505-a901-49de-a502-cf1ad9d190a4\") " pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.659580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.659527 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-image-registry-private-configuration\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.664083 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.663922 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rftj\" (UniqueName: \"kubernetes.io/projected/683c14c1-c931-4334-ac0e-400c01d51dc3-kube-api-access-5rftj\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:48.664160 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.664010 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfrt9\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-kube-api-access-lfrt9\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.664160 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.664036 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2vh\" (UniqueName: \"kubernetes.io/projected/46d51505-a901-49de-a502-cf1ad9d190a4-kube-api-access-lq2vh\") pod \"ingress-canary-6krcc\" (UID: \"46d51505-a901-49de-a502-cf1ad9d190a4\") " pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:48.664160 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.664060 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-bound-sa-token\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:48.727191 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:48.727171 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6krcc" Jul 24 22:46:49.159454 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:49.159425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:49.159603 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:49.159489 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:49.159666 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:49.159614 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 22:46:49.159666 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:49.159641 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt: secret "image-registry-tls" not found Jul 24 22:46:49.159763 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:49.159673 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 22:46:49.159763 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:49.159711 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls podName:2f8692cb-9393-4eee-9b4e-c6b491f26b18 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:50.159689722 +0000 UTC m=+36.623878151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls") pod "image-registry-5ddf8f4b6b-kbqdt" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18") : secret "image-registry-tls" not found Jul 24 22:46:49.159763 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:49.159737 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls podName:683c14c1-c931-4334-ac0e-400c01d51dc3 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:50.159719474 +0000 UTC m=+36.623907898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls") pod "dns-default-h9z5x" (UID: "683c14c1-c931-4334-ac0e-400c01d51dc3") : secret "dns-default-metrics-tls" not found Jul 24 22:46:49.208964 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:49.208933 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6krcc"] Jul 24 22:46:49.212854 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:49.212758 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d51505_a901_49de_a502_cf1ad9d190a4.slice/crio-e2e333dc8aa6c652ad65ad4f2ecd6fead1d5dd27f8fc0d6cb4f81b3f5f14f427 WatchSource:0}: Error finding container e2e333dc8aa6c652ad65ad4f2ecd6fead1d5dd27f8fc0d6cb4f81b3f5f14f427: Status 404 returned error can't find the container with id e2e333dc8aa6c652ad65ad4f2ecd6fead1d5dd27f8fc0d6cb4f81b3f5f14f427 Jul 24 22:46:49.222118 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:49.222095 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6krcc" event={"ID":"46d51505-a901-49de-a502-cf1ad9d190a4","Type":"ContainerStarted","Data":"e2e333dc8aa6c652ad65ad4f2ecd6fead1d5dd27f8fc0d6cb4f81b3f5f14f427"} Jul 24 22:46:49.225057 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:49.225032 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerStarted","Data":"a38614ca5f8c211488c7097949382dbb79bc0ec9e1364c5064db4228dcaf8bcc"} Jul 24 22:46:50.046211 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.046129 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:46:50.046646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.046136 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:46:50.046646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.046136 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:46:50.050246 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.050224 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 22:46:50.050369 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.050284 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 22:46:50.050369 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.050298 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 22:46:50.050369 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.050361 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4wx4\"" Jul 24 22:46:50.050529 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.050390 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 22:46:50.050529 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.050441 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmr4r\"" Jul 24 22:46:50.167097 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.167061 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:50.167234 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.167146 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:50.167234 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:50.167218 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 22:46:50.167234 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:50.167232 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 22:46:50.167376 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:50.167243 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt: secret "image-registry-tls" not found Jul 24 22:46:50.167376 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:50.167279 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls podName:683c14c1-c931-4334-ac0e-400c01d51dc3 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:52.167260223 +0000 UTC m=+38.631448646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls") pod "dns-default-h9z5x" (UID: "683c14c1-c931-4334-ac0e-400c01d51dc3") : secret "dns-default-metrics-tls" not found Jul 24 22:46:50.167376 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:50.167296 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls podName:2f8692cb-9393-4eee-9b4e-c6b491f26b18 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:52.167288086 +0000 UTC m=+38.631476504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls") pod "image-registry-5ddf8f4b6b-kbqdt" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18") : secret "image-registry-tls" not found Jul 24 22:46:50.230822 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.230776 2585 generic.go:356] "Generic (PLEG): container finished" podID="bb6e4e50-6550-4178-b2b7-f28e7ba59754" containerID="a38614ca5f8c211488c7097949382dbb79bc0ec9e1364c5064db4228dcaf8bcc" exitCode=0 Jul 24 22:46:50.230970 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:50.230831 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerDied","Data":"a38614ca5f8c211488c7097949382dbb79bc0ec9e1364c5064db4228dcaf8bcc"} Jul 24 22:46:51.235865 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:51.235683 2585 generic.go:356] "Generic (PLEG): container finished" podID="bb6e4e50-6550-4178-b2b7-f28e7ba59754" containerID="3814b0b06e273c048165358099fb3f5fe2068898bafd36d7d3e2ae9d8986eb56" exitCode=0 Jul 24 22:46:51.235865 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:51.235759 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerDied","Data":"3814b0b06e273c048165358099fb3f5fe2068898bafd36d7d3e2ae9d8986eb56"} Jul 24 22:46:52.184614 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:52.184537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:52.184614 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:52.184589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:52.184784 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:52.184671 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 22:46:52.184784 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:52.184680 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 22:46:52.184784 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:52.184701 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt: secret "image-registry-tls" not found Jul 24 22:46:52.184784 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:52.184718 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls podName:683c14c1-c931-4334-ac0e-400c01d51dc3 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:56.184705183 +0000 UTC m=+42.648893585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls") pod "dns-default-h9z5x" (UID: "683c14c1-c931-4334-ac0e-400c01d51dc3") : secret "dns-default-metrics-tls" not found Jul 24 22:46:52.184784 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:52.184743 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls podName:2f8692cb-9393-4eee-9b4e-c6b491f26b18 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:56.18473141 +0000 UTC m=+42.648919814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls") pod "image-registry-5ddf8f4b6b-kbqdt" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18") : secret "image-registry-tls" not found Jul 24 22:46:52.241641 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:52.241611 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" event={"ID":"bb6e4e50-6550-4178-b2b7-f28e7ba59754","Type":"ContainerStarted","Data":"a6115f29733bbf4bb747b0d6a8753a4298a5b21cfd3dc29340564923d963e049"} Jul 24 22:46:52.243059 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:52.243037 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6krcc" event={"ID":"46d51505-a901-49de-a502-cf1ad9d190a4","Type":"ContainerStarted","Data":"99f135d4f3ce411e8f3bf5c5851ab1785f6c837537613915748553534bdd47bd"} Jul 24 22:46:52.264885 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:52.264848 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rcdd2" podStartSLOduration=9.98021984 podStartE2EDuration="38.264833192s" totalImagesPullingTime="28.284613352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:52.26430884 +0000 UTC m=+38.728497302" watchObservedRunningTime="2026-07-24 22:46:52.264833192 +0000 UTC m=+38.729021611" Jul 24 22:46:52.278899 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:52.278859 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6krcc" podStartSLOduration=2.099114409 podStartE2EDuration="4.278846501s" totalImagesPullingTime="2.179732092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:46:52.278563992 +0000 UTC m=+38.742752428" watchObservedRunningTime="2026-07-24 22:46:52.278846501 +0000 UTC m=+38.743034927" Jul 24 22:46:56.211438 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.211397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:46:56.212055 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.211452 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:46:56.212055 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:56.211571 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 22:46:56.212055 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:56.211594 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt: secret "image-registry-tls" not found Jul 24 22:46:56.212055 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:56.211640 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 22:46:56.212055 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:56.211661 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls podName:2f8692cb-9393-4eee-9b4e-c6b491f26b18 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:04.211641314 +0000 UTC m=+50.675829732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls") pod "image-registry-5ddf8f4b6b-kbqdt" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18") : secret "image-registry-tls" not found Jul 24 22:46:56.212055 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:56.211682 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls podName:683c14c1-c931-4334-ac0e-400c01d51dc3 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:04.211671503 +0000 UTC m=+50.675859906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls") pod "dns-default-h9z5x" (UID: "683c14c1-c931-4334-ac0e-400c01d51dc3") : secret "dns-default-metrics-tls" not found Jul 24 22:46:56.764923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.764889 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zmvt4"] Jul 24 22:46:56.795352 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.795324 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zmvt4"] Jul 24 22:46:56.795475 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.795431 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:56.798102 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.798081 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 22:46:56.798239 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.798179 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 22:46:56.798239 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.798181 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 22:46:56.799346 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.799327 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xlc68\"" Jul 24 22:46:56.799424 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.799335 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 22:46:56.917508 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.917477 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-crio-socket\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:56.917666 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.917515 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:56.917666 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.917532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:56.917666 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.917558 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-data-volume\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:56.917666 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:56.917619 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tz58\" (UniqueName: \"kubernetes.io/projected/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-api-access-6tz58\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018341 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018265 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-crio-socket\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018341 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018304 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018341 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018363 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-data-volume\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018383 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tz58\" (UniqueName: \"kubernetes.io/projected/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-api-access-6tz58\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.018407 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018494 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-crio-socket\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.018500 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:57.518478291 +0000 UTC m=+43.982666712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : configmap "kube-rbac-proxy" not found Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.018499 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 22:46:57.018580 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.018571 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:57.518555998 +0000 UTC m=+43.982744417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : secret "insights-runtime-extractor-tls" not found Jul 24 22:46:57.018823 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.018671 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-data-volume\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.030331 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.030306 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tz58\" (UniqueName: \"kubernetes.io/projected/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-api-access-6tz58\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.081486 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.081460 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg"] Jul 24 22:46:57.096669 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.096650 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg"] Jul 24 22:46:57.096786 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.096772 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" Jul 24 22:46:57.099478 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.099455 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rwn2z\"" Jul 24 22:46:57.099574 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.099476 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 22:46:57.099769 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.099756 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 22:46:57.219146 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.219121 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvf2\" (UniqueName: \"kubernetes.io/projected/7b568d64-c948-49f9-84b7-960befb04bda-kube-api-access-szvf2\") pod \"migrator-6865c9967-28hgg\" (UID: \"7b568d64-c948-49f9-84b7-960befb04bda\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" Jul 24 22:46:57.320367 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.320301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvf2\" (UniqueName: \"kubernetes.io/projected/7b568d64-c948-49f9-84b7-960befb04bda-kube-api-access-szvf2\") pod \"migrator-6865c9967-28hgg\" (UID: \"7b568d64-c948-49f9-84b7-960befb04bda\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" Jul 24 22:46:57.327685 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.327663 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvf2\" (UniqueName: \"kubernetes.io/projected/7b568d64-c948-49f9-84b7-960befb04bda-kube-api-access-szvf2\") pod \"migrator-6865c9967-28hgg\" (UID: \"7b568d64-c948-49f9-84b7-960befb04bda\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" Jul 24 22:46:57.405243 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.405222 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" Jul 24 22:46:57.521241 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.521214 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.521358 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.521253 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:57.521358 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.521337 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 22:46:57.521427 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.521360 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 22:46:57.521427 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.521406 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:58.521389775 +0000 UTC m=+44.985578178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : configmap "kube-rbac-proxy" not found Jul 24 22:46:57.521492 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:57.521484 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:46:58.521476809 +0000 UTC m=+44.985665218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : secret "insights-runtime-extractor-tls" not found Jul 24 22:46:57.543440 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:57.543415 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg"] Jul 24 22:46:57.545975 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:46:57.545946 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b568d64_c948_49f9_84b7_960befb04bda.slice/crio-52250bb72531f1736e501eb5a3bd1ee13cf14469d734035c81bec1a1a9a7a890 WatchSource:0}: Error finding container 52250bb72531f1736e501eb5a3bd1ee13cf14469d734035c81bec1a1a9a7a890: Status 404 returned error can't find the container with id 52250bb72531f1736e501eb5a3bd1ee13cf14469d734035c81bec1a1a9a7a890 Jul 24 22:46:58.259471 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:58.259437 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" event={"ID":"7b568d64-c948-49f9-84b7-960befb04bda","Type":"ContainerStarted","Data":"52250bb72531f1736e501eb5a3bd1ee13cf14469d734035c81bec1a1a9a7a890"} Jul 24 22:46:58.357211 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:58.357185 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-85lrd_d4a20072-e90c-4f9d-a5b6-1b0b453f4c66/dns-node-resolver/0.log" Jul 24 22:46:58.529749 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:58.529686 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:58.529749 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:58.529723 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:46:58.529953 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:58.529897 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 22:46:58.529953 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:58.529912 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 22:46:58.530050 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:58.529956 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:00.529941994 +0000 UTC m=+46.994130396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : secret "insights-runtime-extractor-tls" not found Jul 24 22:46:58.530050 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:46:58.529973 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:00.529967268 +0000 UTC m=+46.994155670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : configmap "kube-rbac-proxy" not found Jul 24 22:46:59.263018 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:59.262992 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" event={"ID":"7b568d64-c948-49f9-84b7-960befb04bda","Type":"ContainerStarted","Data":"63f83eeb8fe56344f389486bd7436b28ac1f392660a2b99850279d46a80223f6"} Jul 24 22:46:59.356763 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:59.356745 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxr24_9fdd9652-a28f-4f8b-8190-cf0629da7d63/node-ca/0.log" Jul 24 22:46:59.957612 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:46:59.957569 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6krcc_46d51505-a901-49de-a502-cf1ad9d190a4/serve-healthcheck-canary/0.log" Jul 24 22:47:00.266605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:00.266564 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" event={"ID":"7b568d64-c948-49f9-84b7-960befb04bda","Type":"ContainerStarted","Data":"0318295f67ef59c5297a60c38a9c5b4659cebd826fd67a0913edaf6b11f98e78"} Jul 24 22:47:00.282690 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:00.282648 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-28hgg" podStartSLOduration=1.695909256 podStartE2EDuration="3.282636693s" totalImagesPullingTime="1.586727437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:00.281561261 +0000 UTC m=+46.745749682" watchObservedRunningTime="2026-07-24 22:47:00.282636693 +0000 UTC m=+46.746825118" Jul 24 22:47:00.545920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:00.545845 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:00.545920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:00.545878 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:00.546136 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:00.545979 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 22:47:00.546136 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:00.546048 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 22:47:00.546136 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:00.546051 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:04.546031824 +0000 UTC m=+51.010220241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : configmap "kube-rbac-proxy" not found Jul 24 22:47:00.546136 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:00.546108 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:04.546093098 +0000 UTC m=+51.010281505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : secret "insights-runtime-extractor-tls" not found Jul 24 22:47:04.272299 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:04.272258 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:04.272713 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:04.272326 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:47:04.272713 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.272425 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 22:47:04.272713 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.272438 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 22:47:04.272713 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.272502 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls podName:683c14c1-c931-4334-ac0e-400c01d51dc3 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:20.272486406 +0000 UTC m=+66.736674809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls") pod "dns-default-h9z5x" (UID: "683c14c1-c931-4334-ac0e-400c01d51dc3") : secret "dns-default-metrics-tls" not found Jul 24 22:47:04.272713 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.272444 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt: secret "image-registry-tls" not found Jul 24 22:47:04.272713 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.272580 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls podName:2f8692cb-9393-4eee-9b4e-c6b491f26b18 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:20.272567785 +0000 UTC m=+66.736756188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls") pod "image-registry-5ddf8f4b6b-kbqdt" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18") : secret "image-registry-tls" not found Jul 24 22:47:04.575511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:04.575423 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:04.575511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:04.575463 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:04.575738 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.575612 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 22:47:04.575738 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:04.575674 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls podName:4749d72e-e2e8-4e91-acbd-a6abedbda3a2 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:12.575661588 +0000 UTC m=+59.039849990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zmvt4" (UID: "4749d72e-e2e8-4e91-acbd-a6abedbda3a2") : secret "insights-runtime-extractor-tls" not found Jul 24 22:47:04.576161 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:04.576136 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:12.636877 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:12.636844 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:12.639037 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:12.639012 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4749d72e-e2e8-4e91-acbd-a6abedbda3a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmvt4\" (UID: \"4749d72e-e2e8-4e91-acbd-a6abedbda3a2\") " pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:12.704434 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:12.704408 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zmvt4" Jul 24 22:47:12.848421 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:12.848320 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zmvt4"] Jul 24 22:47:12.850837 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:12.850809 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4749d72e_e2e8_4e91_acbd_a6abedbda3a2.slice/crio-b9510f8ee0870e5f86858ed0bf8e76b15f4ca7fc534a9d92c791872f64968d9f WatchSource:0}: Error finding container b9510f8ee0870e5f86858ed0bf8e76b15f4ca7fc534a9d92c791872f64968d9f: Status 404 returned error can't find the container with id b9510f8ee0870e5f86858ed0bf8e76b15f4ca7fc534a9d92c791872f64968d9f Jul 24 22:47:13.217070 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:13.217041 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvk" Jul 24 22:47:13.301515 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:13.301485 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmvt4" event={"ID":"4749d72e-e2e8-4e91-acbd-a6abedbda3a2","Type":"ContainerStarted","Data":"b9510f8ee0870e5f86858ed0bf8e76b15f4ca7fc534a9d92c791872f64968d9f"} Jul 24 22:47:18.315167 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:18.315088 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmvt4" event={"ID":"4749d72e-e2e8-4e91-acbd-a6abedbda3a2","Type":"ContainerStarted","Data":"81450c5e1bbdcac5caaa99b8ffea0de4295c7a251a2cab62d468f859cceb63c2"} Jul 24 22:47:19.690639 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.690602 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:47:19.693427 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.693403 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 22:47:19.703806 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.703772 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca48d86b-9252-448f-ab1b-5abe1d3c03b4-metrics-certs\") pod \"network-metrics-daemon-qjswr\" (UID: \"ca48d86b-9252-448f-ab1b-5abe1d3c03b4\") " pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:47:19.766460 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.766428 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmr4r\"" Jul 24 22:47:19.774700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.774676 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjswr" Jul 24 22:47:19.791366 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.791335 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:47:19.793931 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.793912 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 22:47:19.804116 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.804079 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc2b5735-0688-4900-83a9-53eda1359d41-original-pull-secret\") pod \"global-pull-secret-syncer-k5k5b\" (UID: \"dc2b5735-0688-4900-83a9-53eda1359d41\") " pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:47:19.891777 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.891740 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:47:19.894435 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.894416 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 22:47:19.904910 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.904888 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 22:47:19.915498 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:19.915477 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7rp9\" (UniqueName: \"kubernetes.io/projected/b22801b2-7bcc-41a2-866f-6fe16c6a5b11-kube-api-access-g7rp9\") pod \"network-check-target-w8lhp\" (UID: \"b22801b2-7bcc-41a2-866f-6fe16c6a5b11\") " pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:47:20.057142 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.057110 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5k5b" Jul 24 22:47:20.071661 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.071638 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4wx4\"" Jul 24 22:47:20.080229 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.080197 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:47:20.295860 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.295826 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:20.296029 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.295873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:47:20.298366 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.298337 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/683c14c1-c931-4334-ac0e-400c01d51dc3-metrics-tls\") pod \"dns-default-h9z5x\" (UID: \"683c14c1-c931-4334-ac0e-400c01d51dc3\") " pod="openshift-dns/dns-default-h9z5x" Jul 24 22:47:20.298543 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.298516 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"image-registry-5ddf8f4b6b-kbqdt\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:20.513008 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.512980 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59m4s\"" Jul 24 22:47:20.520193 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.520161 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:20.523691 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.523668 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l2hpm\"" Jul 24 22:47:20.531702 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:20.531677 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9z5x" Jul 24 22:47:21.837294 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:21.837238 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5k5b"] Jul 24 22:47:21.853123 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:21.853094 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2b5735_0688_4900_83a9_53eda1359d41.slice/crio-1b2802d936d1e85e610b027d5888b44cdbcda8ebf45067067fc2f301acfd3857 WatchSource:0}: Error finding container 1b2802d936d1e85e610b027d5888b44cdbcda8ebf45067067fc2f301acfd3857: Status 404 returned error can't find the container with id 1b2802d936d1e85e610b027d5888b44cdbcda8ebf45067067fc2f301acfd3857 Jul 24 22:47:22.042786 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.042750 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp"] Jul 24 22:47:22.068252 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.068226 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp"] Jul 24 22:47:22.068395 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.068341 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.072054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.072025 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 22:47:22.072181 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.072025 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 24 22:47:22.072181 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.072034 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 22:47:22.072181 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.072128 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 22:47:22.081704 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.081493 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w8lhp"] Jul 24 22:47:22.082324 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.082194 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9z5x"] Jul 24 22:47:22.083032 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.083007 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjswr"] Jul 24 22:47:22.084158 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:22.084135 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca48d86b_9252_448f_ab1b_5abe1d3c03b4.slice/crio-5bb33a8061a33cad1064cd54efc001cf611dab126318cb5145b50bf6b433cee1 WatchSource:0}: Error finding container 5bb33a8061a33cad1064cd54efc001cf611dab126318cb5145b50bf6b433cee1: Status 404 returned error can't find the container with id 5bb33a8061a33cad1064cd54efc001cf611dab126318cb5145b50bf6b433cee1 Jul 24 22:47:22.085418 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:22.085391 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22801b2_7bcc_41a2_866f_6fe16c6a5b11.slice/crio-b44ebbd56eea96b7cfe6c1c17cecf96ede3d8d51a6058f8d2b0ad9c5d01dca97 WatchSource:0}: Error finding container b44ebbd56eea96b7cfe6c1c17cecf96ede3d8d51a6058f8d2b0ad9c5d01dca97: Status 404 returned error can't find the container with id b44ebbd56eea96b7cfe6c1c17cecf96ede3d8d51a6058f8d2b0ad9c5d01dca97 Jul 24 22:47:22.087105 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.087081 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt"] Jul 24 22:47:22.090415 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:22.089492 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8692cb_9393_4eee_9b4e_c6b491f26b18.slice/crio-59bf1f0b1ac4f6ee9b769c71addf729eb6ed0401687b960e1ebb7f29df8593e7 WatchSource:0}: Error finding container 59bf1f0b1ac4f6ee9b769c71addf729eb6ed0401687b960e1ebb7f29df8593e7: Status 404 returned error can't find the container with id 59bf1f0b1ac4f6ee9b769c71addf729eb6ed0401687b960e1ebb7f29df8593e7 Jul 24 22:47:22.094327 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.094307 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt"] Jul 24 22:47:22.109890 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.109870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09d6f701-a94c-4cba-8be5-a38e786e7dbb-tmp\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.109971 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.109913 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09d6f701-a94c-4cba-8be5-a38e786e7dbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.109971 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.109932 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njm8q\" (UniqueName: \"kubernetes.io/projected/09d6f701-a94c-4cba-8be5-a38e786e7dbb-kube-api-access-njm8q\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.179402 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.179383 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58db85c5b4-z4s55"] Jul 24 22:47:22.209397 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.209377 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58db85c5b4-z4s55"] Jul 24 22:47:22.209483 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.209465 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.210374 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.210355 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09d6f701-a94c-4cba-8be5-a38e786e7dbb-tmp\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.210462 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.210414 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09d6f701-a94c-4cba-8be5-a38e786e7dbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.210462 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.210444 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njm8q\" (UniqueName: \"kubernetes.io/projected/09d6f701-a94c-4cba-8be5-a38e786e7dbb-kube-api-access-njm8q\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.210808 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.210775 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09d6f701-a94c-4cba-8be5-a38e786e7dbb-tmp\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.212944 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.212924 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09d6f701-a94c-4cba-8be5-a38e786e7dbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.218713 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.218693 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njm8q\" (UniqueName: \"kubernetes.io/projected/09d6f701-a94c-4cba-8be5-a38e786e7dbb-kube-api-access-njm8q\") pod \"klusterlet-addon-workmgr-5c46f9d8f7-czjrp\" (UID: \"09d6f701-a94c-4cba-8be5-a38e786e7dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.311693 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311666 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-installation-pull-secrets\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.311693 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311695 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl896\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-kube-api-access-jl896\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.311859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311725 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-image-registry-private-configuration\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.311859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-trusted-ca\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.311859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311807 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-ca-trust-extracted\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.311859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311835 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-registry-tls\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.311859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311850 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-bound-sa-token\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.312009 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.311870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-registry-certificates\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.327427 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.327402 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9z5x" event={"ID":"683c14c1-c931-4334-ac0e-400c01d51dc3","Type":"ContainerStarted","Data":"f341bf947bb44881f3a0cef34e88d4d014353fd47ac17c9d2096672f91792f54"} Jul 24 22:47:22.328581 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.328555 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjswr" event={"ID":"ca48d86b-9252-448f-ab1b-5abe1d3c03b4","Type":"ContainerStarted","Data":"5bb33a8061a33cad1064cd54efc001cf611dab126318cb5145b50bf6b433cee1"} Jul 24 22:47:22.329738 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.329716 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w8lhp" event={"ID":"b22801b2-7bcc-41a2-866f-6fe16c6a5b11","Type":"ContainerStarted","Data":"b44ebbd56eea96b7cfe6c1c17cecf96ede3d8d51a6058f8d2b0ad9c5d01dca97"} Jul 24 22:47:22.331155 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.331129 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" event={"ID":"2f8692cb-9393-4eee-9b4e-c6b491f26b18","Type":"ContainerStarted","Data":"ebf4da0f6e515877df4e2b351190a6daa8879ab8ea081df4a1a54be2f55f1afc"} Jul 24 22:47:22.331252 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.331171 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" event={"ID":"2f8692cb-9393-4eee-9b4e-c6b491f26b18","Type":"ContainerStarted","Data":"59bf1f0b1ac4f6ee9b769c71addf729eb6ed0401687b960e1ebb7f29df8593e7"} Jul 24 22:47:22.331308 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.331249 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:22.332366 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.332339 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5k5b" event={"ID":"dc2b5735-0688-4900-83a9-53eda1359d41","Type":"ContainerStarted","Data":"1b2802d936d1e85e610b027d5888b44cdbcda8ebf45067067fc2f301acfd3857"} Jul 24 22:47:22.334112 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.334090 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmvt4" event={"ID":"4749d72e-e2e8-4e91-acbd-a6abedbda3a2","Type":"ContainerStarted","Data":"df1e300896a7939da0950f6a85b56bee2a08cc25e2860baa0f045f890c017b93"} Jul 24 22:47:22.357028 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.356982 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" podStartSLOduration=67.356968446 podStartE2EDuration="1m7.356968446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:22.356618508 +0000 UTC m=+68.820806935" watchObservedRunningTime="2026-07-24 22:47:22.356968446 +0000 UTC m=+68.821156868" Jul 24 22:47:22.378090 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.378061 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:22.412364 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412323 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-image-registry-private-configuration\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-trusted-ca\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412403 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-ca-trust-extracted\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412432 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-registry-tls\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412456 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-bound-sa-token\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412659 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412476 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-registry-certificates\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412659 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-installation-pull-secrets\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.412659 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.412521 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl896\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-kube-api-access-jl896\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.413187 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.413114 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-ca-trust-extracted\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.413786 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.413513 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-registry-certificates\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.413943 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.413878 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-trusted-ca\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.415373 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.415326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-image-registry-private-configuration\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.415619 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.415595 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-installation-pull-secrets\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.416205 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.416185 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-registry-tls\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.424014 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.423993 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl896\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-kube-api-access-jl896\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.425210 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.425173 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2ab1c75-ca3d-4940-ae4e-014976c0d95e-bound-sa-token\") pod \"image-registry-58db85c5b4-z4s55\" (UID: \"c2ab1c75-ca3d-4940-ae4e-014976c0d95e\") " pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.517729 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.517696 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:22.534176 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.534014 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp"] Jul 24 22:47:22.539579 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:22.539533 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d6f701_a94c_4cba_8be5_a38e786e7dbb.slice/crio-27917d2e67ad78feb0bf263283a22e7f946f7d4999c066d6638d7d36d39c1487 WatchSource:0}: Error finding container 27917d2e67ad78feb0bf263283a22e7f946f7d4999c066d6638d7d36d39c1487: Status 404 returned error can't find the container with id 27917d2e67ad78feb0bf263283a22e7f946f7d4999c066d6638d7d36d39c1487 Jul 24 22:47:22.688585 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:22.688509 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58db85c5b4-z4s55"] Jul 24 22:47:22.694299 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:22.694264 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ab1c75_ca3d_4940_ae4e_014976c0d95e.slice/crio-cbfe4c9bfcf32afd38acdcb3cc670d1392a45ddd231ad411fbf2e4cbe4c8c49a WatchSource:0}: Error finding container cbfe4c9bfcf32afd38acdcb3cc670d1392a45ddd231ad411fbf2e4cbe4c8c49a: Status 404 returned error can't find the container with id cbfe4c9bfcf32afd38acdcb3cc670d1392a45ddd231ad411fbf2e4cbe4c8c49a Jul 24 22:47:23.341111 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:23.341024 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" event={"ID":"09d6f701-a94c-4cba-8be5-a38e786e7dbb","Type":"ContainerStarted","Data":"27917d2e67ad78feb0bf263283a22e7f946f7d4999c066d6638d7d36d39c1487"} Jul 24 22:47:23.345342 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:23.344542 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" event={"ID":"c2ab1c75-ca3d-4940-ae4e-014976c0d95e","Type":"ContainerStarted","Data":"96923c4063ee91144d0649e6ca8e0a47a6fbb54bdc3f9f2e1eaac17023899ee1"} Jul 24 22:47:23.345342 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:23.344589 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" event={"ID":"c2ab1c75-ca3d-4940-ae4e-014976c0d95e","Type":"ContainerStarted","Data":"cbfe4c9bfcf32afd38acdcb3cc670d1392a45ddd231ad411fbf2e4cbe4c8c49a"} Jul 24 22:47:23.345342 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:23.345299 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:23.364632 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:23.364587 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" podStartSLOduration=1.36457409 podStartE2EDuration="1.36457409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:23.363339332 +0000 UTC m=+69.827527757" watchObservedRunningTime="2026-07-24 22:47:23.36457409 +0000 UTC m=+69.828762493" Jul 24 22:47:24.353670 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:24.353630 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjswr" event={"ID":"ca48d86b-9252-448f-ab1b-5abe1d3c03b4","Type":"ContainerStarted","Data":"c097ceb575b5c25f3d8b03b79312cd6de5220f2ec720e0804f650305ac995426"} Jul 24 22:47:25.364029 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:25.363909 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9z5x" event={"ID":"683c14c1-c931-4334-ac0e-400c01d51dc3","Type":"ContainerStarted","Data":"970aaaffd2f8f5b6f8c01f3ecce020b0762b631ad5229e7f4deebbaf6dbe1bfa"} Jul 24 22:47:25.370617 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:25.370553 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjswr" event={"ID":"ca48d86b-9252-448f-ab1b-5abe1d3c03b4","Type":"ContainerStarted","Data":"23628ffdff1c4f371cfe40cd4e6e01c9ab837e9c3676813c239ee575fc8817a4"} Jul 24 22:47:25.387639 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:25.387227 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qjswr" podStartSLOduration=69.676916815 podStartE2EDuration="1m11.387208719s" totalImagesPullingTime="1.710291904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:25.386877303 +0000 UTC m=+71.851065757" watchObservedRunningTime="2026-07-24 22:47:25.387208719 +0000 UTC m=+71.851397149" Jul 24 22:47:26.376341 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:26.376299 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9z5x" event={"ID":"683c14c1-c931-4334-ac0e-400c01d51dc3","Type":"ContainerStarted","Data":"775ca477266145c2c76dbdceb447bc46c8fe5e79e1285d6e8c79da2ee60c8e0d"} Jul 24 22:47:26.394463 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:26.394409 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h9z5x" podStartSLOduration=35.376727783 podStartE2EDuration="38.394390257s" totalImagesPullingTime="3.017662474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:26.393349475 +0000 UTC m=+72.857537902" watchObservedRunningTime="2026-07-24 22:47:26.394390257 +0000 UTC m=+72.858578684" Jul 24 22:47:27.380641 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.380607 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h9z5x" Jul 24 22:47:27.587991 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.587958 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h"] Jul 24 22:47:27.591185 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.591163 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:27.593863 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.593645 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 22:47:27.593863 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.593807 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ls95q\"" Jul 24 22:47:27.599281 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.599242 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h"] Jul 24 22:47:27.653391 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.653321 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5acf01f9-3e3f-4827-ae20-665b691207cb-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ndj8h\" (UID: \"5acf01f9-3e3f-4827-ae20-665b691207cb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:27.753746 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.753710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5acf01f9-3e3f-4827-ae20-665b691207cb-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ndj8h\" (UID: \"5acf01f9-3e3f-4827-ae20-665b691207cb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:27.756299 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.756271 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5acf01f9-3e3f-4827-ae20-665b691207cb-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ndj8h\" (UID: \"5acf01f9-3e3f-4827-ae20-665b691207cb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:27.901687 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:27.901651 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:31.587098 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:31.587066 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h"] Jul 24 22:47:32.333694 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.333659 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-8xl5m"] Jul 24 22:47:32.336869 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.336845 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:32.339227 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.339204 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 22:47:32.339322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.339268 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 22:47:32.339376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.339324 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b6qhf\"" Jul 24 22:47:32.347490 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.347466 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8xl5m"] Jul 24 22:47:32.391882 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.391845 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sslkz\" (UniqueName: \"kubernetes.io/projected/0855abfd-8fdf-4077-94be-8d4dae23842f-kube-api-access-sslkz\") pod \"downloads-7c97dc4555-8xl5m\" (UID: \"0855abfd-8fdf-4077-94be-8d4dae23842f\") " pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:32.401437 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.401410 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmvt4" event={"ID":"4749d72e-e2e8-4e91-acbd-a6abedbda3a2","Type":"ContainerStarted","Data":"e1ab23dd72f6e65b5ff9ece9698d5ed33dcb182d2c160fc6b9fe31be6ba13e21"} Jul 24 22:47:32.403042 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.403013 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w8lhp" event={"ID":"b22801b2-7bcc-41a2-866f-6fe16c6a5b11","Type":"ContainerStarted","Data":"1c56f0bd5295f78df052aa96d957ccb06657b9d73503034196e6e8c69b03455c"} Jul 24 22:47:32.403172 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.403097 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:47:32.404310 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.404286 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" event={"ID":"5acf01f9-3e3f-4827-ae20-665b691207cb","Type":"ContainerStarted","Data":"8884eaab02c9026fbee44b35e5c691f8359bb61f192336b97ccf5ce955a1d23c"} Jul 24 22:47:32.405784 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.405756 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" event={"ID":"09d6f701-a94c-4cba-8be5-a38e786e7dbb","Type":"ContainerStarted","Data":"bff35ae2d2f30bacd73d3bd6fe8c9f0699f6dcb22caa46fc256b4eae9234e031"} Jul 24 22:47:32.405886 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.405815 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:32.407421 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.407395 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5k5b" event={"ID":"dc2b5735-0688-4900-83a9-53eda1359d41","Type":"ContainerStarted","Data":"7a66105637b7ceb3a36e2bac3bb6f71d4474fb547e4863d8bc631d7f7a15d2ce"} Jul 24 22:47:32.407595 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.407580 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" Jul 24 22:47:32.433334 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.433294 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zmvt4" podStartSLOduration=17.989311864 podStartE2EDuration="36.433281567s" totalImagesPullingTime="18.443969703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:32.432405152 +0000 UTC m=+78.896593633" watchObservedRunningTime="2026-07-24 22:47:32.433281567 +0000 UTC m=+78.897469991" Jul 24 22:47:32.449612 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.449560 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5k5b" podStartSLOduration=68.865372022 podStartE2EDuration="1m18.449548056s" totalImagesPullingTime="9.584176034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:32.448966704 +0000 UTC m=+78.913155128" watchObservedRunningTime="2026-07-24 22:47:32.449548056 +0000 UTC m=+78.913736477" Jul 24 22:47:32.467934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.467893 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w8lhp" podStartSLOduration=69.106910105 podStartE2EDuration="1m18.467879763s" totalImagesPullingTime="9.360969658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:32.467446481 +0000 UTC m=+78.931634906" watchObservedRunningTime="2026-07-24 22:47:32.467879763 +0000 UTC m=+78.932068190" Jul 24 22:47:32.492488 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.492452 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c46f9d8f7-czjrp" podStartSLOduration=1.562572724 podStartE2EDuration="10.492436868s" totalImagesPullingTime="8.929864144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:32.489472967 +0000 UTC m=+78.953661393" watchObservedRunningTime="2026-07-24 22:47:32.492436868 +0000 UTC m=+78.956625292" Jul 24 22:47:32.493102 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.493084 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sslkz\" (UniqueName: \"kubernetes.io/projected/0855abfd-8fdf-4077-94be-8d4dae23842f-kube-api-access-sslkz\") pod \"downloads-7c97dc4555-8xl5m\" (UID: \"0855abfd-8fdf-4077-94be-8d4dae23842f\") " pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:32.502304 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.502284 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslkz\" (UniqueName: \"kubernetes.io/projected/0855abfd-8fdf-4077-94be-8d4dae23842f-kube-api-access-sslkz\") pod \"downloads-7c97dc4555-8xl5m\" (UID: \"0855abfd-8fdf-4077-94be-8d4dae23842f\") " pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:32.645923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.645897 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:32.789914 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:32.789885 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8xl5m"] Jul 24 22:47:32.792777 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:32.792750 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0855abfd_8fdf_4077_94be_8d4dae23842f.slice/crio-71f4907f7c3fcf0df40b90c5efc959a032a32a173cecc3d35feaa0f5e0ef1152 WatchSource:0}: Error finding container 71f4907f7c3fcf0df40b90c5efc959a032a32a173cecc3d35feaa0f5e0ef1152: Status 404 returned error can't find the container with id 71f4907f7c3fcf0df40b90c5efc959a032a32a173cecc3d35feaa0f5e0ef1152 Jul 24 22:47:33.413861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.413821 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" event={"ID":"5acf01f9-3e3f-4827-ae20-665b691207cb","Type":"ContainerStarted","Data":"719d5a8afcfaf22ae3a3fa3cdf0cce59bbc3240a175aa4ea7b67c9f97e67252d"} Jul 24 22:47:33.414886 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.414812 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:33.417084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.417055 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8xl5m" event={"ID":"0855abfd-8fdf-4077-94be-8d4dae23842f","Type":"ContainerStarted","Data":"71f4907f7c3fcf0df40b90c5efc959a032a32a173cecc3d35feaa0f5e0ef1152"} Jul 24 22:47:33.420362 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.420336 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" Jul 24 22:47:33.432537 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.432489 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ndj8h" podStartSLOduration=5.387682236 podStartE2EDuration="6.432391752s" totalImagesPullingTime="1.044709516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:33.430882754 +0000 UTC m=+79.895071177" watchObservedRunningTime="2026-07-24 22:47:33.432391752 +0000 UTC m=+79.896580179" Jul 24 22:47:33.656439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.656404 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xt69p"] Jul 24 22:47:33.660823 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.660749 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.664137 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.663815 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 22:47:33.664137 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.663988 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 22:47:33.664137 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.664028 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 22:47:33.664604 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.664580 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 22:47:33.664720 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.664687 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n2qmc\"" Jul 24 22:47:33.664777 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.664715 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 22:47:33.670580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.670557 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xt69p"] Jul 24 22:47:33.803224 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.803195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.803224 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.803228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.803441 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.803281 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.803441 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.803346 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mnvd\" (UniqueName: \"kubernetes.io/projected/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-kube-api-access-4mnvd\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.904016 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.903986 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.904240 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.904022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mnvd\" (UniqueName: \"kubernetes.io/projected/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-kube-api-access-4mnvd\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.904240 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.904074 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.904240 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.904098 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.904240 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:33.904220 2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 24 22:47:33.904445 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:47:33.904288 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-tls podName:c6283a90-c5e3-4973-ac01-ed9c7fc061d5 nodeName:}" failed. No retries permitted until 2026-07-24 22:47:34.404265256 +0000 UTC m=+80.868453676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-xt69p" (UID: "c6283a90-c5e3-4973-ac01-ed9c7fc061d5") : secret "prometheus-operator-tls" not found Jul 24 22:47:33.904807 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.904778 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.906528 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.906501 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:33.926404 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:33.913852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mnvd\" (UniqueName: \"kubernetes.io/projected/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-kube-api-access-4mnvd\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:34.408585 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:34.408538 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:34.411325 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:34.411296 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c6283a90-c5e3-4973-ac01-ed9c7fc061d5-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xt69p\" (UID: \"c6283a90-c5e3-4973-ac01-ed9c7fc061d5\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:34.573059 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:34.573025 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" Jul 24 22:47:34.714208 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:34.714171 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xt69p"] Jul 24 22:47:34.716738 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:34.716713 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6283a90_c5e3_4973_ac01_ed9c7fc061d5.slice/crio-73f7f6faac27a2ba9a4aa82f97ec6190f9ed63c52e922fb9544e6bfc62e3eeff WatchSource:0}: Error finding container 73f7f6faac27a2ba9a4aa82f97ec6190f9ed63c52e922fb9544e6bfc62e3eeff: Status 404 returned error can't find the container with id 73f7f6faac27a2ba9a4aa82f97ec6190f9ed63c52e922fb9544e6bfc62e3eeff Jul 24 22:47:35.427506 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:35.427273 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" event={"ID":"c6283a90-c5e3-4973-ac01-ed9c7fc061d5","Type":"ContainerStarted","Data":"73f7f6faac27a2ba9a4aa82f97ec6190f9ed63c52e922fb9544e6bfc62e3eeff"} Jul 24 22:47:36.433494 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:36.433455 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" event={"ID":"c6283a90-c5e3-4973-ac01-ed9c7fc061d5","Type":"ContainerStarted","Data":"3165afcc2ed1ca75444f2689f93d0a3b30103cd1d63457ede088b9ea511e44f3"} Jul 24 22:47:36.433930 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:36.433518 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" event={"ID":"c6283a90-c5e3-4973-ac01-ed9c7fc061d5","Type":"ContainerStarted","Data":"176a2ca05e86793b0cfa78e0de591abeca811b8b8cef479ca6ceb847dcffd500"} Jul 24 22:47:36.451256 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:36.451202 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-xt69p" podStartSLOduration=2.194352436 podStartE2EDuration="3.451183831s" totalImagesPullingTime="1.256831395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:36.449466599 +0000 UTC m=+82.913655025" watchObservedRunningTime="2026-07-24 22:47:36.451183831 +0000 UTC m=+82.915372257" Jul 24 22:47:37.386822 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:37.386775 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h9z5x" Jul 24 22:47:38.037407 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.037367 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx"] Jul 24 22:47:38.040878 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.040852 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.043567 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.043544 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 22:47:38.043693 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.043546 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 22:47:38.044400 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.044380 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 22:47:38.044518 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.044386 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nqd6z\"" Jul 24 22:47:38.054645 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.054622 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-266jd"] Jul 24 22:47:38.057920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.057902 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx"] Jul 24 22:47:38.058029 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.058011 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.060516 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.060356 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jjfp8\"" Jul 24 22:47:38.060516 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.060367 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 22:47:38.060516 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.060375 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 22:47:38.060721 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.060666 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 22:47:38.140605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140569 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-sys\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.140790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140617 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-tls\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.140790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140651 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-metrics-client-ca\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.140790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.140790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140730 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-wtmp\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.140790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140754 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-accelerators-collector-config\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.140790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-root\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140859 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdee2e83-0eea-44a0-b75f-8433b81972c3-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140902 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140934 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lffnz\" (UniqueName: \"kubernetes.io/projected/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-api-access-lffnz\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.140981 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-textfile\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.141025 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.141053 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cdee2e83-0eea-44a0-b75f-8433b81972c3-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.141113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.141098 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.141426 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.141128 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjls7\" (UniqueName: \"kubernetes.io/projected/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-kube-api-access-cjls7\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.241617 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-wtmp\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241633 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-accelerators-collector-config\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241677 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-root\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241706 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdee2e83-0eea-44a0-b75f-8433b81972c3-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241739 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241769 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lffnz\" (UniqueName: \"kubernetes.io/projected/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-api-access-lffnz\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241816 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-wtmp\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.241861 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241819 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-textfile\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241816 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-root\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241889 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241922 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cdee2e83-0eea-44a0-b75f-8433b81972c3-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.241975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjls7\" (UniqueName: \"kubernetes.io/projected/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-kube-api-access-cjls7\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242049 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-sys\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242074 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-tls\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242116 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-metrics-client-ca\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242376 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242143 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.242912 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242392 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-accelerators-collector-config\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.242912 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242676 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cdee2e83-0eea-44a0-b75f-8433b81972c3-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.242912 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.242832 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdee2e83-0eea-44a0-b75f-8433b81972c3-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.243079 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.243036 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-sys\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.243319 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.243271 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-textfile\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.243420 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.243366 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-metrics-client-ca\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.243758 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.243727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.245859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.245840 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.246570 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.246508 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-node-exporter-tls\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.247505 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.247480 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.248015 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.247987 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.252511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.252466 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lffnz\" (UniqueName: \"kubernetes.io/projected/cdee2e83-0eea-44a0-b75f-8433b81972c3-kube-api-access-lffnz\") pod \"kube-state-metrics-56d9f944b4-2q7rx\" (UID: \"cdee2e83-0eea-44a0-b75f-8433b81972c3\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.252511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.252496 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjls7\" (UniqueName: \"kubernetes.io/projected/595b8e55-e7f3-4ecc-b3ec-18eb3866cf85-kube-api-access-cjls7\") pod \"node-exporter-266jd\" (UID: \"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85\") " pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.351416 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.351332 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" Jul 24 22:47:38.367928 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.367900 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-266jd" Jul 24 22:47:38.383137 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:38.383090 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595b8e55_e7f3_4ecc_b3ec_18eb3866cf85.slice/crio-a8fedbd44e32eae097de5cbf299873879ceedd2fb6b7477d58005f507fbda7c0 WatchSource:0}: Error finding container a8fedbd44e32eae097de5cbf299873879ceedd2fb6b7477d58005f507fbda7c0: Status 404 returned error can't find the container with id a8fedbd44e32eae097de5cbf299873879ceedd2fb6b7477d58005f507fbda7c0 Jul 24 22:47:38.456549 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.456443 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-266jd" event={"ID":"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85","Type":"ContainerStarted","Data":"a8fedbd44e32eae097de5cbf299873879ceedd2fb6b7477d58005f507fbda7c0"} Jul 24 22:47:38.491421 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:38.491341 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx"] Jul 24 22:47:38.494429 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:47:38.494398 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdee2e83_0eea_44a0_b75f_8433b81972c3.slice/crio-98376645bee1152f1c9ea919c4ab0231a5ba170efeb7d7cea8ff0beae74c0d10 WatchSource:0}: Error finding container 98376645bee1152f1c9ea919c4ab0231a5ba170efeb7d7cea8ff0beae74c0d10: Status 404 returned error can't find the container with id 98376645bee1152f1c9ea919c4ab0231a5ba170efeb7d7cea8ff0beae74c0d10 Jul 24 22:47:39.464404 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:39.464366 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" event={"ID":"cdee2e83-0eea-44a0-b75f-8433b81972c3","Type":"ContainerStarted","Data":"98376645bee1152f1c9ea919c4ab0231a5ba170efeb7d7cea8ff0beae74c0d10"} Jul 24 22:47:39.466350 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:39.466292 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-266jd" event={"ID":"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85","Type":"ContainerStarted","Data":"614522f9f2be86fb6ca93eb0a5791b211bab99e6e577c0790bf052b30bcf8cc0"} Jul 24 22:47:40.471729 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:40.471646 2585 generic.go:356] "Generic (PLEG): container finished" podID="595b8e55-e7f3-4ecc-b3ec-18eb3866cf85" containerID="614522f9f2be86fb6ca93eb0a5791b211bab99e6e577c0790bf052b30bcf8cc0" exitCode=0 Jul 24 22:47:40.472192 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:40.471738 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-266jd" event={"ID":"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85","Type":"ContainerDied","Data":"614522f9f2be86fb6ca93eb0a5791b211bab99e6e577c0790bf052b30bcf8cc0"} Jul 24 22:47:40.474290 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:40.474264 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" event={"ID":"cdee2e83-0eea-44a0-b75f-8433b81972c3","Type":"ContainerStarted","Data":"d1300b33c12474719f6b9b3d12aab7e1a3f534a031404bad9f76766fc6fc9b4d"} Jul 24 22:47:40.474409 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:40.474323 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" event={"ID":"cdee2e83-0eea-44a0-b75f-8433b81972c3","Type":"ContainerStarted","Data":"4ae8f1e80d89ac642795ec95cfb2ad4854519ec9139d27e93632f3a469de4676"} Jul 24 22:47:40.474409 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:40.474354 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" event={"ID":"cdee2e83-0eea-44a0-b75f-8433b81972c3","Type":"ContainerStarted","Data":"de7c7e6c9f974784bb479724da33c30f45b5745237db3259d50ab83a91f22593"} Jul 24 22:47:40.508587 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:40.508539 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2q7rx" podStartSLOduration=0.94542679 podStartE2EDuration="2.508519975s" totalImagesPullingTime="1.563093185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:40.506632676 +0000 UTC m=+86.970821102" watchObservedRunningTime="2026-07-24 22:47:40.508519975 +0000 UTC m=+86.972708399" Jul 24 22:47:41.481119 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:41.481080 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-266jd" event={"ID":"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85","Type":"ContainerStarted","Data":"caf82613041e5fc533a12c506f29067a2c590b19087532509300825f271439c3"} Jul 24 22:47:41.481570 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:41.481144 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-266jd" event={"ID":"595b8e55-e7f3-4ecc-b3ec-18eb3866cf85","Type":"ContainerStarted","Data":"f953abb54e2bb9902e1a32d7e57334dd44c0f7683ad4d48676e6f2bc440b6912"} Jul 24 22:47:41.502302 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:41.502245 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-266jd" podStartSLOduration=2.451277876 podStartE2EDuration="3.502229403s" totalImagesPullingTime="969.462243ms" totalInitContainerRuntime="81.489284ms" isStatefulPod=true podCreationTimestamp="2026-07-24 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:41.501777937 +0000 UTC m=+87.965966363" watchObservedRunningTime="2026-07-24 22:47:41.502229403 +0000 UTC m=+87.966417845" Jul 24 22:47:42.337993 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:42.337953 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:45.375848 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:45.375819 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58db85c5b4-z4s55" Jul 24 22:47:47.352948 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:47.352902 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" podUID="2f8692cb-9393-4eee-9b4e-c6b491f26b18" containerName="registry" containerID="cri-o://ebf4da0f6e515877df4e2b351190a6daa8879ab8ea081df4a1a54be2f55f1afc" gracePeriod=30 Jul 24 22:47:49.514587 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.514553 2585 generic.go:356] "Generic (PLEG): container finished" podID="2f8692cb-9393-4eee-9b4e-c6b491f26b18" containerID="ebf4da0f6e515877df4e2b351190a6daa8879ab8ea081df4a1a54be2f55f1afc" exitCode=0 Jul 24 22:47:49.514916 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.514606 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" event={"ID":"2f8692cb-9393-4eee-9b4e-c6b491f26b18","Type":"ContainerDied","Data":"ebf4da0f6e515877df4e2b351190a6daa8879ab8ea081df4a1a54be2f55f1afc"} Jul 24 22:47:49.574113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.574087 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:49.751319 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751295 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-certificates\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751452 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751328 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-bound-sa-token\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751452 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751349 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-image-registry-private-configuration\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751452 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751391 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-installation-pull-secrets\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751452 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751418 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751452 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751438 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfrt9\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-kube-api-access-lfrt9\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751704 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751465 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f8692cb-9393-4eee-9b4e-c6b491f26b18-ca-trust-extracted\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.751704 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.751555 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-trusted-ca\") pod \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\" (UID: \"2f8692cb-9393-4eee-9b4e-c6b491f26b18\") " Jul 24 22:47:49.752070 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.752041 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 22:47:49.752183 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.752106 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 22:47:49.753873 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.753835 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-kube-api-access-lfrt9" (OuterVolumeSpecName: "kube-api-access-lfrt9") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "kube-api-access-lfrt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:47:49.754007 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.753989 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:47:49.754094 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.754061 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 22:47:49.754132 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.754081 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:47:49.754310 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.754293 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 22:47:49.760295 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.760273 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8692cb-9393-4eee-9b4e-c6b491f26b18-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2f8692cb-9393-4eee-9b4e-c6b491f26b18" (UID: "2f8692cb-9393-4eee-9b4e-c6b491f26b18"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:47:49.852432 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852407 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-certificates\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852432 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852430 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-bound-sa-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852445 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-image-registry-private-configuration\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852458 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f8692cb-9393-4eee-9b4e-c6b491f26b18-installation-pull-secrets\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852470 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-registry-tls\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852482 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfrt9\" (UniqueName: \"kubernetes.io/projected/2f8692cb-9393-4eee-9b4e-c6b491f26b18-kube-api-access-lfrt9\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852497 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f8692cb-9393-4eee-9b4e-c6b491f26b18-ca-trust-extracted\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:49.852566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:49.852509 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f8692cb-9393-4eee-9b4e-c6b491f26b18-trusted-ca\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:47:50.520302 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.520265 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" event={"ID":"2f8692cb-9393-4eee-9b4e-c6b491f26b18","Type":"ContainerDied","Data":"59bf1f0b1ac4f6ee9b769c71addf729eb6ed0401687b960e1ebb7f29df8593e7"} Jul 24 22:47:50.520755 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.520278 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt" Jul 24 22:47:50.520755 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.520346 2585 scope.go:117] "RemoveContainer" containerID="ebf4da0f6e515877df4e2b351190a6daa8879ab8ea081df4a1a54be2f55f1afc" Jul 24 22:47:50.522372 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.522343 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8xl5m" event={"ID":"0855abfd-8fdf-4077-94be-8d4dae23842f","Type":"ContainerStarted","Data":"421864e7f0c3cf74467e76e259f46cfce3182af5958c2e8e9ba92cad760a878f"} Jul 24 22:47:50.523285 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.522824 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:50.533493 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.533476 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-8xl5m" Jul 24 22:47:50.538312 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.538289 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt"] Jul 24 22:47:50.548349 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.548325 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5ddf8f4b6b-kbqdt"] Jul 24 22:47:50.561581 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:50.561527 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-8xl5m" podStartSLOduration=1.538268552 podStartE2EDuration="18.561510242s" totalImagesPullingTime="17.02324169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:47:50.560971852 +0000 UTC m=+97.025160293" watchObservedRunningTime="2026-07-24 22:47:50.561510242 +0000 UTC m=+97.025698668" Jul 24 22:47:52.051883 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:47:52.051845 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8692cb-9393-4eee-9b4e-c6b491f26b18" path="/var/lib/kubelet/pods/2f8692cb-9393-4eee-9b4e-c6b491f26b18/volumes" Jul 24 22:48:03.419535 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:48:03.419505 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w8lhp" Jul 24 22:49:02.337847 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.337809 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68d66977b4-4kjct"] Jul 24 22:49:02.338357 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.338179 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8692cb-9393-4eee-9b4e-c6b491f26b18" containerName="registry" Jul 24 22:49:02.338357 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.338197 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8692cb-9393-4eee-9b4e-c6b491f26b18" containerName="registry" Jul 24 22:49:02.338357 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.338302 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f8692cb-9393-4eee-9b4e-c6b491f26b18" containerName="registry" Jul 24 22:49:02.341586 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.341564 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.344269 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.344245 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 22:49:02.344511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.344259 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 22:49:02.344511 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.344259 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 22:49:02.344682 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.344271 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 22:49:02.344682 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.344271 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 22:49:02.344682 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.344333 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sr27w\"" Jul 24 22:49:02.356243 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.356217 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68d66977b4-4kjct"] Jul 24 22:49:02.359909 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.359715 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 22:49:02.461986 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.461956 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.461997 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.462024 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-telemeter-client-tls\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.462053 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-serving-certs-ca-bundle\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.462141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-metrics-client-ca\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.462191 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-federate-client-tls\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.462220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vff5\" (UniqueName: \"kubernetes.io/projected/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-kube-api-access-2vff5\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.462298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.462250 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-secret-telemeter-client\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.562757 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.562719 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-metrics-client-ca\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.562975 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.562775 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-federate-client-tls\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.562975 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.562822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vff5\" (UniqueName: \"kubernetes.io/projected/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-kube-api-access-2vff5\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.562975 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.562948 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-secret-telemeter-client\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563013 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563061 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-telemeter-client-tls\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563148 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563084 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-serving-certs-ca-bundle\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563625 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563596 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-metrics-client-ca\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563847 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563819 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-serving-certs-ca-bundle\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.563963 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.563888 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.565526 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.565506 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-secret-telemeter-client\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.565638 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.565621 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-telemeter-client-tls\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.565763 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.565744 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.565895 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.565877 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-federate-client-tls\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.570789 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.570765 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vff5\" (UniqueName: \"kubernetes.io/projected/4c0e6ff2-14df-4116-8c1a-02d560dfc6a1-kube-api-access-2vff5\") pod \"telemeter-client-68d66977b4-4kjct\" (UID: \"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1\") " pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.658081 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.657942 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" Jul 24 22:49:02.805549 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:02.805427 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68d66977b4-4kjct"] Jul 24 22:49:02.808216 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:49:02.808190 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0e6ff2_14df_4116_8c1a_02d560dfc6a1.slice/crio-fe7b53b0f554928db41f2c3c41878caa4296f57f3c3eb4cb58e0bab763a69bbd WatchSource:0}: Error finding container fe7b53b0f554928db41f2c3c41878caa4296f57f3c3eb4cb58e0bab763a69bbd: Status 404 returned error can't find the container with id fe7b53b0f554928db41f2c3c41878caa4296f57f3c3eb4cb58e0bab763a69bbd Jul 24 22:49:03.783773 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:03.783737 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" event={"ID":"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1","Type":"ContainerStarted","Data":"fe7b53b0f554928db41f2c3c41878caa4296f57f3c3eb4cb58e0bab763a69bbd"} Jul 24 22:49:04.788989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:04.788953 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" event={"ID":"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1","Type":"ContainerStarted","Data":"238373c09e1dc4247570bd6aafb7380375f78f6e6e76e5e9fedc3bef819b2991"} Jul 24 22:49:06.797396 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:06.797314 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" event={"ID":"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1","Type":"ContainerStarted","Data":"eaf1a081544d5e67f82d2184b62f917f6c14e62e8b71f3ba1f543b6d52bb73f7"} Jul 24 22:49:06.797396 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:06.797375 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" event={"ID":"4c0e6ff2-14df-4116-8c1a-02d560dfc6a1","Type":"ContainerStarted","Data":"d2c31f1ae14fef84e7916c8fba15030f27ca92b67e0a062ddac5d5462656cf01"} Jul 24 22:49:06.820736 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:49:06.820692 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68d66977b4-4kjct" podStartSLOduration=1.899876025 podStartE2EDuration="4.820676544s" totalImagesPullingTime="2.920800519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:49:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:49:06.81970061 +0000 UTC m=+173.283889070" watchObservedRunningTime="2026-07-24 22:49:06.820676544 +0000 UTC m=+173.284864968" Jul 24 22:51:13.897402 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:13.897376 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 22:51:19.771545 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.771487 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw"] Jul 24 22:51:19.776040 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.776020 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:19.778528 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.778506 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 22:51:19.779525 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.779500 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7g6wh\"" Jul 24 22:51:19.779625 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.779528 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 22:51:19.783247 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.783225 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw"] Jul 24 22:51:19.934883 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.934848 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:19.934883 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.934886 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzspt\" (UniqueName: \"kubernetes.io/projected/545b9c08-66e5-47bb-b0c0-00b04f8aef60-kube-api-access-gzspt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:19.935105 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:19.934926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.035477 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.035404 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzspt\" (UniqueName: \"kubernetes.io/projected/545b9c08-66e5-47bb-b0c0-00b04f8aef60-kube-api-access-gzspt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.035477 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.035449 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.035692 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.035494 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.035863 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.035845 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.035911 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.035871 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.043414 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.043395 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzspt\" (UniqueName: \"kubernetes.io/projected/545b9c08-66e5-47bb-b0c0-00b04f8aef60-kube-api-access-gzspt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.085341 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.085321 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:20.207779 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.207754 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw"] Jul 24 22:51:20.209560 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:51:20.209537 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545b9c08_66e5_47bb_b0c0_00b04f8aef60.slice/crio-2c0be842154aee12304c8604a8cfe4796fe200048042bdea377b5ccd8f8d7661 WatchSource:0}: Error finding container 2c0be842154aee12304c8604a8cfe4796fe200048042bdea377b5ccd8f8d7661: Status 404 returned error can't find the container with id 2c0be842154aee12304c8604a8cfe4796fe200048042bdea377b5ccd8f8d7661 Jul 24 22:51:20.211885 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.211868 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 22:51:20.242217 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:20.242193 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" event={"ID":"545b9c08-66e5-47bb-b0c0-00b04f8aef60","Type":"ContainerStarted","Data":"2c0be842154aee12304c8604a8cfe4796fe200048042bdea377b5ccd8f8d7661"} Jul 24 22:51:27.269962 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:27.269925 2585 generic.go:356] "Generic (PLEG): container finished" podID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerID="abcb38b8ab1d2608f3a1dea77178caee84479490612acd52f2011203cf07c07e" exitCode=0 Jul 24 22:51:27.270330 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:27.269974 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" event={"ID":"545b9c08-66e5-47bb-b0c0-00b04f8aef60","Type":"ContainerDied","Data":"abcb38b8ab1d2608f3a1dea77178caee84479490612acd52f2011203cf07c07e"} Jul 24 22:51:30.282012 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:30.281979 2585 generic.go:356] "Generic (PLEG): container finished" podID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerID="50ec1c0ba47253a848f163fdea551d0193490f0a1d2a0e045281924edaaf130a" exitCode=0 Jul 24 22:51:30.282427 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:30.282066 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" event={"ID":"545b9c08-66e5-47bb-b0c0-00b04f8aef60","Type":"ContainerDied","Data":"50ec1c0ba47253a848f163fdea551d0193490f0a1d2a0e045281924edaaf130a"} Jul 24 22:51:38.313436 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:38.313405 2585 generic.go:356] "Generic (PLEG): container finished" podID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerID="5a8bc9bafb7ab37455430be6ad64a50bb49507f605d75d4eda515962fff8f7e2" exitCode=0 Jul 24 22:51:38.313837 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:38.313471 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" event={"ID":"545b9c08-66e5-47bb-b0c0-00b04f8aef60","Type":"ContainerDied","Data":"5a8bc9bafb7ab37455430be6ad64a50bb49507f605d75d4eda515962fff8f7e2"} Jul 24 22:51:39.438452 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.438429 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:39.486728 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.486700 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-util\") pod \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " Jul 24 22:51:39.486858 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.486758 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-bundle\") pod \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " Jul 24 22:51:39.486858 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.486784 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzspt\" (UniqueName: \"kubernetes.io/projected/545b9c08-66e5-47bb-b0c0-00b04f8aef60-kube-api-access-gzspt\") pod \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\" (UID: \"545b9c08-66e5-47bb-b0c0-00b04f8aef60\") " Jul 24 22:51:39.487519 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.487494 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-bundle" (OuterVolumeSpecName: "bundle") pod "545b9c08-66e5-47bb-b0c0-00b04f8aef60" (UID: "545b9c08-66e5-47bb-b0c0-00b04f8aef60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:51:39.488910 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.488887 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545b9c08-66e5-47bb-b0c0-00b04f8aef60-kube-api-access-gzspt" (OuterVolumeSpecName: "kube-api-access-gzspt") pod "545b9c08-66e5-47bb-b0c0-00b04f8aef60" (UID: "545b9c08-66e5-47bb-b0c0-00b04f8aef60"). InnerVolumeSpecName "kube-api-access-gzspt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:51:39.490923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.490903 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-util" (OuterVolumeSpecName: "util") pod "545b9c08-66e5-47bb-b0c0-00b04f8aef60" (UID: "545b9c08-66e5-47bb-b0c0-00b04f8aef60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:51:39.587947 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.587894 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:51:39.587947 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.587918 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545b9c08-66e5-47bb-b0c0-00b04f8aef60-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:51:39.587947 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:39.587926 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzspt\" (UniqueName: \"kubernetes.io/projected/545b9c08-66e5-47bb-b0c0-00b04f8aef60-kube-api-access-gzspt\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:51:40.321790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:40.321706 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" event={"ID":"545b9c08-66e5-47bb-b0c0-00b04f8aef60","Type":"ContainerDied","Data":"2c0be842154aee12304c8604a8cfe4796fe200048042bdea377b5ccd8f8d7661"} Jul 24 22:51:40.321790 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:40.321744 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f98bw" Jul 24 22:51:40.321979 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:40.321749 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c0be842154aee12304c8604a8cfe4796fe200048042bdea377b5ccd8f8d7661" Jul 24 22:51:47.721464 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721431 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q"] Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721717 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="util" Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721728 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="util" Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721743 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="extract" Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721749 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="extract" Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721756 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="pull" Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721762 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="pull" Jul 24 22:51:47.721920 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.721825 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="545b9c08-66e5-47bb-b0c0-00b04f8aef60" containerName="extract" Jul 24 22:51:47.724974 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.724959 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:47.727676 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.727654 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 22:51:47.727788 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.727657 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 22:51:47.727788 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.727657 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hdtgq\"" Jul 24 22:51:47.736562 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.736541 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q"] Jul 24 22:51:47.745105 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.745083 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/003ecfdc-1b47-4346-970d-cf62772f0215-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgx4q\" (UID: \"003ecfdc-1b47-4346-970d-cf62772f0215\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:47.745195 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.745115 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrgvb\" (UniqueName: \"kubernetes.io/projected/003ecfdc-1b47-4346-970d-cf62772f0215-kube-api-access-hrgvb\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgx4q\" (UID: \"003ecfdc-1b47-4346-970d-cf62772f0215\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:47.845981 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.845949 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/003ecfdc-1b47-4346-970d-cf62772f0215-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgx4q\" (UID: \"003ecfdc-1b47-4346-970d-cf62772f0215\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:47.845981 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.845982 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrgvb\" (UniqueName: \"kubernetes.io/projected/003ecfdc-1b47-4346-970d-cf62772f0215-kube-api-access-hrgvb\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgx4q\" (UID: \"003ecfdc-1b47-4346-970d-cf62772f0215\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:47.846325 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.846304 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/003ecfdc-1b47-4346-970d-cf62772f0215-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgx4q\" (UID: \"003ecfdc-1b47-4346-970d-cf62772f0215\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:47.855923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:47.855899 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrgvb\" (UniqueName: \"kubernetes.io/projected/003ecfdc-1b47-4346-970d-cf62772f0215-kube-api-access-hrgvb\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgx4q\" (UID: \"003ecfdc-1b47-4346-970d-cf62772f0215\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:48.033310 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:48.033274 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" Jul 24 22:51:48.185558 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:48.185536 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q"] Jul 24 22:51:48.188373 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:51:48.188345 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003ecfdc_1b47_4346_970d_cf62772f0215.slice/crio-5f8d02f23f3840342bd7df076353c53fa3b744758f7bef0658dae612268be0db WatchSource:0}: Error finding container 5f8d02f23f3840342bd7df076353c53fa3b744758f7bef0658dae612268be0db: Status 404 returned error can't find the container with id 5f8d02f23f3840342bd7df076353c53fa3b744758f7bef0658dae612268be0db Jul 24 22:51:48.350395 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:48.350316 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" event={"ID":"003ecfdc-1b47-4346-970d-cf62772f0215","Type":"ContainerStarted","Data":"5f8d02f23f3840342bd7df076353c53fa3b744758f7bef0658dae612268be0db"} Jul 24 22:51:50.360060 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:50.360026 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" event={"ID":"003ecfdc-1b47-4346-970d-cf62772f0215","Type":"ContainerStarted","Data":"e285e6a551ae827fcf9a396d084d7905ea8b818cec147086613d43b34635089c"} Jul 24 22:51:50.380372 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:50.380327 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgx4q" podStartSLOduration=1.78784758 podStartE2EDuration="3.380308459s" totalImagesPullingTime="1.592460879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:51:50.378900956 +0000 UTC m=+336.843089380" watchObservedRunningTime="2026-07-24 22:51:50.380308459 +0000 UTC m=+336.844496885" Jul 24 22:51:51.496421 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.496388 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72"] Jul 24 22:51:51.498642 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.498622 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.501272 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.501254 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 22:51:51.501365 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.501271 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 22:51:51.502316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.502304 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7g6wh\"" Jul 24 22:51:51.512935 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.512914 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72"] Jul 24 22:51:51.577451 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.577424 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.577550 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.577471 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csmtq\" (UniqueName: \"kubernetes.io/projected/02fd9885-faa2-4227-be25-a3a0bf39fe78-kube-api-access-csmtq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.577550 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.577506 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.678633 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.678596 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.678756 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.678652 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csmtq\" (UniqueName: \"kubernetes.io/projected/02fd9885-faa2-4227-be25-a3a0bf39fe78-kube-api-access-csmtq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.678756 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.678679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.679006 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.678988 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.679043 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.679005 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.691565 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.691540 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csmtq\" (UniqueName: \"kubernetes.io/projected/02fd9885-faa2-4227-be25-a3a0bf39fe78-kube-api-access-csmtq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.807747 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.807680 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:51.936469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:51.936445 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72"] Jul 24 22:51:51.938642 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:51:51.938608 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fd9885_faa2_4227_be25_a3a0bf39fe78.slice/crio-42fa8e2eb949e6bd968963a2f93ac8129337369c94d0299930fc1e0e016a6520 WatchSource:0}: Error finding container 42fa8e2eb949e6bd968963a2f93ac8129337369c94d0299930fc1e0e016a6520: Status 404 returned error can't find the container with id 42fa8e2eb949e6bd968963a2f93ac8129337369c94d0299930fc1e0e016a6520 Jul 24 22:51:52.369276 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.369242 2585 generic.go:356] "Generic (PLEG): container finished" podID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerID="f92389724dadf130b7b3e437098a46981a3cbe33d18f9c73162ee51f88ed6329" exitCode=0 Jul 24 22:51:52.369445 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.369322 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" event={"ID":"02fd9885-faa2-4227-be25-a3a0bf39fe78","Type":"ContainerDied","Data":"f92389724dadf130b7b3e437098a46981a3cbe33d18f9c73162ee51f88ed6329"} Jul 24 22:51:52.369445 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.369367 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" event={"ID":"02fd9885-faa2-4227-be25-a3a0bf39fe78","Type":"ContainerStarted","Data":"42fa8e2eb949e6bd968963a2f93ac8129337369c94d0299930fc1e0e016a6520"} Jul 24 22:51:52.514900 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.512631 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zpmms"] Jul 24 22:51:52.516100 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.516072 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.518872 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.518849 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 22:51:52.518993 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.518976 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h6cfc\"" Jul 24 22:51:52.519250 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.518975 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 22:51:52.526433 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.526412 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zpmms"] Jul 24 22:51:52.585888 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.585860 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12156e41-8dd1-4b3d-a52a-b69a57828086-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zpmms\" (UID: \"12156e41-8dd1-4b3d-a52a-b69a57828086\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.585989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.585923 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qh9\" (UniqueName: \"kubernetes.io/projected/12156e41-8dd1-4b3d-a52a-b69a57828086-kube-api-access-r9qh9\") pod \"cert-manager-webhook-6486ffd997-zpmms\" (UID: \"12156e41-8dd1-4b3d-a52a-b69a57828086\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.687134 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.687071 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qh9\" (UniqueName: \"kubernetes.io/projected/12156e41-8dd1-4b3d-a52a-b69a57828086-kube-api-access-r9qh9\") pod \"cert-manager-webhook-6486ffd997-zpmms\" (UID: \"12156e41-8dd1-4b3d-a52a-b69a57828086\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.687232 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.687133 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12156e41-8dd1-4b3d-a52a-b69a57828086-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zpmms\" (UID: \"12156e41-8dd1-4b3d-a52a-b69a57828086\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.695130 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.695064 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12156e41-8dd1-4b3d-a52a-b69a57828086-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zpmms\" (UID: \"12156e41-8dd1-4b3d-a52a-b69a57828086\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.695179 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.695158 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qh9\" (UniqueName: \"kubernetes.io/projected/12156e41-8dd1-4b3d-a52a-b69a57828086-kube-api-access-r9qh9\") pod \"cert-manager-webhook-6486ffd997-zpmms\" (UID: \"12156e41-8dd1-4b3d-a52a-b69a57828086\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.844296 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.844269 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:52.971135 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:52.971066 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zpmms"] Jul 24 22:51:52.974296 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:51:52.974274 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12156e41_8dd1_4b3d_a52a_b69a57828086.slice/crio-5910b99235f6c3ced4c4ea7e84da7fff93ebe8f921e8b01e6c3be37061712e02 WatchSource:0}: Error finding container 5910b99235f6c3ced4c4ea7e84da7fff93ebe8f921e8b01e6c3be37061712e02: Status 404 returned error can't find the container with id 5910b99235f6c3ced4c4ea7e84da7fff93ebe8f921e8b01e6c3be37061712e02 Jul 24 22:51:53.375731 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:53.375692 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" event={"ID":"12156e41-8dd1-4b3d-a52a-b69a57828086","Type":"ContainerStarted","Data":"5910b99235f6c3ced4c4ea7e84da7fff93ebe8f921e8b01e6c3be37061712e02"} Jul 24 22:51:54.382985 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:54.382946 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" event={"ID":"02fd9885-faa2-4227-be25-a3a0bf39fe78","Type":"ContainerStarted","Data":"b706d70e2f62848207b5efeebdb84cbe67e2e5b6cb98856344316b6b9b9c1c5c"} Jul 24 22:51:55.389761 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:55.389725 2585 generic.go:356] "Generic (PLEG): container finished" podID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerID="b706d70e2f62848207b5efeebdb84cbe67e2e5b6cb98856344316b6b9b9c1c5c" exitCode=0 Jul 24 22:51:55.390184 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:55.389789 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" event={"ID":"02fd9885-faa2-4227-be25-a3a0bf39fe78","Type":"ContainerDied","Data":"b706d70e2f62848207b5efeebdb84cbe67e2e5b6cb98856344316b6b9b9c1c5c"} Jul 24 22:51:56.395113 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:56.395076 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" event={"ID":"12156e41-8dd1-4b3d-a52a-b69a57828086","Type":"ContainerStarted","Data":"d1bf7150ba870c1b9934028ca63eba64590014e0bc4274750bbc3509721a46b8"} Jul 24 22:51:56.395545 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:56.395208 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:51:56.397086 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:56.397060 2585 generic.go:356] "Generic (PLEG): container finished" podID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerID="9c45f618bd1a646415d7a69942ce605163b6524b6f601333969ca5b5ea20b2ef" exitCode=0 Jul 24 22:51:56.397197 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:56.397089 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" event={"ID":"02fd9885-faa2-4227-be25-a3a0bf39fe78","Type":"ContainerDied","Data":"9c45f618bd1a646415d7a69942ce605163b6524b6f601333969ca5b5ea20b2ef"} Jul 24 22:51:56.411195 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:56.411150 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" podStartSLOduration=1.154956401 podStartE2EDuration="4.411136156s" totalImagesPullingTime="3.256179755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:51:56.410771763 +0000 UTC m=+342.874960187" watchObservedRunningTime="2026-07-24 22:51:56.411136156 +0000 UTC m=+342.875324581" Jul 24 22:51:57.522385 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.522356 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:57.625383 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.625356 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csmtq\" (UniqueName: \"kubernetes.io/projected/02fd9885-faa2-4227-be25-a3a0bf39fe78-kube-api-access-csmtq\") pod \"02fd9885-faa2-4227-be25-a3a0bf39fe78\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " Jul 24 22:51:57.625523 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.625400 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-bundle\") pod \"02fd9885-faa2-4227-be25-a3a0bf39fe78\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " Jul 24 22:51:57.625523 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.625475 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-util\") pod \"02fd9885-faa2-4227-be25-a3a0bf39fe78\" (UID: \"02fd9885-faa2-4227-be25-a3a0bf39fe78\") " Jul 24 22:51:57.625787 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.625760 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-bundle" (OuterVolumeSpecName: "bundle") pod "02fd9885-faa2-4227-be25-a3a0bf39fe78" (UID: "02fd9885-faa2-4227-be25-a3a0bf39fe78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:51:57.627388 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.627362 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02fd9885-faa2-4227-be25-a3a0bf39fe78-kube-api-access-csmtq" (OuterVolumeSpecName: "kube-api-access-csmtq") pod "02fd9885-faa2-4227-be25-a3a0bf39fe78" (UID: "02fd9885-faa2-4227-be25-a3a0bf39fe78"). InnerVolumeSpecName "kube-api-access-csmtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:51:57.630595 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.630559 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-util" (OuterVolumeSpecName: "util") pod "02fd9885-faa2-4227-be25-a3a0bf39fe78" (UID: "02fd9885-faa2-4227-be25-a3a0bf39fe78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:51:57.726842 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.726773 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:51:57.726842 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.726813 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csmtq\" (UniqueName: \"kubernetes.io/projected/02fd9885-faa2-4227-be25-a3a0bf39fe78-kube-api-access-csmtq\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:51:57.726842 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:57.726823 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02fd9885-faa2-4227-be25-a3a0bf39fe78-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:51:58.407080 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:58.407008 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" Jul 24 22:51:58.407080 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:58.407033 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmqs72" event={"ID":"02fd9885-faa2-4227-be25-a3a0bf39fe78","Type":"ContainerDied","Data":"42fa8e2eb949e6bd968963a2f93ac8129337369c94d0299930fc1e0e016a6520"} Jul 24 22:51:58.407080 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:51:58.407073 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42fa8e2eb949e6bd968963a2f93ac8129337369c94d0299930fc1e0e016a6520" Jul 24 22:52:01.878566 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878534 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc"] Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878824 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="extract" Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878835 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="extract" Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878844 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="util" Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878850 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="util" Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878861 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="pull" Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878867 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="pull" Jul 24 22:52:01.878934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.878911 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="02fd9885-faa2-4227-be25-a3a0bf39fe78" containerName="extract" Jul 24 22:52:01.882963 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.882939 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:01.889138 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.888822 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 22:52:01.889990 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.889967 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 22:52:01.890110 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.889979 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hcxq6\"" Jul 24 22:52:01.894999 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.894979 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc"] Jul 24 22:52:01.959814 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.959762 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6df8ceb0-ae3f-4842-9c0c-f067f481b78c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kppbc\" (UID: \"6df8ceb0-ae3f-4842-9c0c-f067f481b78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:01.959963 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:01.959872 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khkzp\" (UniqueName: \"kubernetes.io/projected/6df8ceb0-ae3f-4842-9c0c-f067f481b78c-kube-api-access-khkzp\") pod \"openshift-lws-operator-fd8ccff4c-kppbc\" (UID: \"6df8ceb0-ae3f-4842-9c0c-f067f481b78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:02.060893 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.060866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6df8ceb0-ae3f-4842-9c0c-f067f481b78c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kppbc\" (UID: \"6df8ceb0-ae3f-4842-9c0c-f067f481b78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:02.061053 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.060915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khkzp\" (UniqueName: \"kubernetes.io/projected/6df8ceb0-ae3f-4842-9c0c-f067f481b78c-kube-api-access-khkzp\") pod \"openshift-lws-operator-fd8ccff4c-kppbc\" (UID: \"6df8ceb0-ae3f-4842-9c0c-f067f481b78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:02.061221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.061204 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6df8ceb0-ae3f-4842-9c0c-f067f481b78c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kppbc\" (UID: \"6df8ceb0-ae3f-4842-9c0c-f067f481b78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:02.069262 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.069235 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khkzp\" (UniqueName: \"kubernetes.io/projected/6df8ceb0-ae3f-4842-9c0c-f067f481b78c-kube-api-access-khkzp\") pod \"openshift-lws-operator-fd8ccff4c-kppbc\" (UID: \"6df8ceb0-ae3f-4842-9c0c-f067f481b78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:02.191444 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.191375 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" Jul 24 22:52:02.315819 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.315784 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc"] Jul 24 22:52:02.318115 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:52:02.318084 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6df8ceb0_ae3f_4842_9c0c_f067f481b78c.slice/crio-51138ad69a2efc2dda8de52124b10aa8b96ae98c5b3058319037034df1653474 WatchSource:0}: Error finding container 51138ad69a2efc2dda8de52124b10aa8b96ae98c5b3058319037034df1653474: Status 404 returned error can't find the container with id 51138ad69a2efc2dda8de52124b10aa8b96ae98c5b3058319037034df1653474 Jul 24 22:52:02.403242 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.403220 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zpmms" Jul 24 22:52:02.426282 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:02.426250 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" event={"ID":"6df8ceb0-ae3f-4842-9c0c-f067f481b78c","Type":"ContainerStarted","Data":"51138ad69a2efc2dda8de52124b10aa8b96ae98c5b3058319037034df1653474"} Jul 24 22:52:05.440570 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:05.440537 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" event={"ID":"6df8ceb0-ae3f-4842-9c0c-f067f481b78c","Type":"ContainerStarted","Data":"95209ac1c27876946774e963fb830675430a4c4c950d84e43f3f98d0722fc238"} Jul 24 22:52:05.456514 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:05.456467 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kppbc" podStartSLOduration=1.866984306 podStartE2EDuration="4.456448393s" totalImagesPullingTime="2.589464087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:52:05.456135286 +0000 UTC m=+351.920323712" watchObservedRunningTime="2026-07-24 22:52:05.456448393 +0000 UTC m=+351.920636818" Jul 24 22:52:08.495960 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.495886 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5"] Jul 24 22:52:08.517080 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.517052 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5"] Jul 24 22:52:08.517238 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.517148 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.519946 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.519916 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 22:52:08.520976 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.520955 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7g6wh\"" Jul 24 22:52:08.521060 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.521028 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 22:52:08.609898 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.609872 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.609992 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.609900 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.609992 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.609937 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xh9\" (UniqueName: \"kubernetes.io/projected/71daf57e-92e3-4f9a-bc65-c6c651e135ae-kube-api-access-v9xh9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.711145 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.711118 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xh9\" (UniqueName: \"kubernetes.io/projected/71daf57e-92e3-4f9a-bc65-c6c651e135ae-kube-api-access-v9xh9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.711258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.711167 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.711258 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.711182 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.711504 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.711488 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.711579 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.711563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.719080 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.719053 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xh9\" (UniqueName: \"kubernetes.io/projected/71daf57e-92e3-4f9a-bc65-c6c651e135ae-kube-api-access-v9xh9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.826433 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.826361 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:08.960590 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:08.960558 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5"] Jul 24 22:52:08.963082 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:52:08.963054 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71daf57e_92e3_4f9a_bc65_c6c651e135ae.slice/crio-f5d858cef44b11e4a3f1c0c689d0da36870b749235c714734ffaa6dd23b9fe19 WatchSource:0}: Error finding container f5d858cef44b11e4a3f1c0c689d0da36870b749235c714734ffaa6dd23b9fe19: Status 404 returned error can't find the container with id f5d858cef44b11e4a3f1c0c689d0da36870b749235c714734ffaa6dd23b9fe19 Jul 24 22:52:09.457509 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:09.457434 2585 generic.go:356] "Generic (PLEG): container finished" podID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerID="082fa09a1251893b68bfc1c0dac0356fb2ceb24b7c00ca1f57cbd8befefc09a7" exitCode=0 Jul 24 22:52:09.457509 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:09.457484 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" event={"ID":"71daf57e-92e3-4f9a-bc65-c6c651e135ae","Type":"ContainerDied","Data":"082fa09a1251893b68bfc1c0dac0356fb2ceb24b7c00ca1f57cbd8befefc09a7"} Jul 24 22:52:09.457675 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:09.457517 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" event={"ID":"71daf57e-92e3-4f9a-bc65-c6c651e135ae","Type":"ContainerStarted","Data":"f5d858cef44b11e4a3f1c0c689d0da36870b749235c714734ffaa6dd23b9fe19"} Jul 24 22:52:10.464201 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:10.464167 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" event={"ID":"71daf57e-92e3-4f9a-bc65-c6c651e135ae","Type":"ContainerStarted","Data":"bfea8671afcb3b6bc156db7309e005a1bce6f3a9c5b4f81247b242483cf59928"} Jul 24 22:52:11.469762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:11.469729 2585 generic.go:356] "Generic (PLEG): container finished" podID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerID="bfea8671afcb3b6bc156db7309e005a1bce6f3a9c5b4f81247b242483cf59928" exitCode=0 Jul 24 22:52:11.470161 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:11.469789 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" event={"ID":"71daf57e-92e3-4f9a-bc65-c6c651e135ae","Type":"ContainerDied","Data":"bfea8671afcb3b6bc156db7309e005a1bce6f3a9c5b4f81247b242483cf59928"} Jul 24 22:52:12.480518 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:12.480486 2585 generic.go:356] "Generic (PLEG): container finished" podID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerID="2af2d62f16395bf0eb6fa7d90d40b9b09e4162aa5cefb8ab26c37a6f9f9b7302" exitCode=0 Jul 24 22:52:12.480907 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:12.480565 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" event={"ID":"71daf57e-92e3-4f9a-bc65-c6c651e135ae","Type":"ContainerDied","Data":"2af2d62f16395bf0eb6fa7d90d40b9b09e4162aa5cefb8ab26c37a6f9f9b7302"} Jul 24 22:52:13.604840 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.604818 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:13.751393 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.751370 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9xh9\" (UniqueName: \"kubernetes.io/projected/71daf57e-92e3-4f9a-bc65-c6c651e135ae-kube-api-access-v9xh9\") pod \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " Jul 24 22:52:13.751514 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.751444 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-bundle\") pod \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " Jul 24 22:52:13.751571 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.751552 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-util\") pod \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\" (UID: \"71daf57e-92e3-4f9a-bc65-c6c651e135ae\") " Jul 24 22:52:13.752206 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.752175 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-bundle" (OuterVolumeSpecName: "bundle") pod "71daf57e-92e3-4f9a-bc65-c6c651e135ae" (UID: "71daf57e-92e3-4f9a-bc65-c6c651e135ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:52:13.753450 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.753424 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71daf57e-92e3-4f9a-bc65-c6c651e135ae-kube-api-access-v9xh9" (OuterVolumeSpecName: "kube-api-access-v9xh9") pod "71daf57e-92e3-4f9a-bc65-c6c651e135ae" (UID: "71daf57e-92e3-4f9a-bc65-c6c651e135ae"). InnerVolumeSpecName "kube-api-access-v9xh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:52:13.757094 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.757073 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-util" (OuterVolumeSpecName: "util") pod "71daf57e-92e3-4f9a-bc65-c6c651e135ae" (UID: "71daf57e-92e3-4f9a-bc65-c6c651e135ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:52:13.852384 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.852341 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:52:13.852384 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.852378 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9xh9\" (UniqueName: \"kubernetes.io/projected/71daf57e-92e3-4f9a-bc65-c6c651e135ae-kube-api-access-v9xh9\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:52:13.852384 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:13.852389 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71daf57e-92e3-4f9a-bc65-c6c651e135ae-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:52:14.490645 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:14.490613 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" event={"ID":"71daf57e-92e3-4f9a-bc65-c6c651e135ae","Type":"ContainerDied","Data":"f5d858cef44b11e4a3f1c0c689d0da36870b749235c714734ffaa6dd23b9fe19"} Jul 24 22:52:14.490645 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:14.490638 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2fm5" Jul 24 22:52:14.490862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:14.490667 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5d858cef44b11e4a3f1c0c689d0da36870b749235c714734ffaa6dd23b9fe19" Jul 24 22:52:24.151627 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.151587 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf"] Jul 24 22:52:24.152717 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.152695 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="util" Jul 24 22:52:24.152860 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.152849 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="util" Jul 24 22:52:24.152989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.152944 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="extract" Jul 24 22:52:24.153066 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.153057 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="extract" Jul 24 22:52:24.153140 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.153132 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="pull" Jul 24 22:52:24.153200 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.153193 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="pull" Jul 24 22:52:24.153353 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.153342 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="71daf57e-92e3-4f9a-bc65-c6c651e135ae" containerName="extract" Jul 24 22:52:24.156161 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.156140 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.167648 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.167232 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2r4tk\"" Jul 24 22:52:24.167648 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.167280 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 22:52:24.167648 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.167370 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 22:52:24.167648 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.167500 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 22:52:24.168411 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.168390 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 22:52:24.171422 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.171392 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf"] Jul 24 22:52:24.328206 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.328162 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.328206 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.328210 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vndjd\" (UniqueName: \"kubernetes.io/projected/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-kube-api-access-vndjd\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.328462 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.328244 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-manifests\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.328462 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.328306 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.328462 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.328368 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-tmp\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.429568 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.429499 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.429568 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.429529 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vndjd\" (UniqueName: \"kubernetes.io/projected/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-kube-api-access-vndjd\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.429568 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.429554 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-manifests\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.429819 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.429609 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.429819 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.429757 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-tmp\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.430019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.430002 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-manifests\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.431923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.431904 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-tmp\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.432183 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.432162 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.432245 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.432192 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.440899 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.440868 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vndjd\" (UniqueName: \"kubernetes.io/projected/35aa88b0-59ce-4cb4-8afe-2c94b8cd6183-kube-api-access-vndjd\") pod \"opendatahub-operator-controller-manager-69d99768bd-7zdxf\" (UID: \"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183\") " pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.481626 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.481606 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:24.613686 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:24.613594 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf"] Jul 24 22:52:24.616674 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:52:24.616627 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35aa88b0_59ce_4cb4_8afe_2c94b8cd6183.slice/crio-4268bd51eb63e62fc44036bb674279f9f3752aae479015fec21a8f56f0ee0234 WatchSource:0}: Error finding container 4268bd51eb63e62fc44036bb674279f9f3752aae479015fec21a8f56f0ee0234: Status 404 returned error can't find the container with id 4268bd51eb63e62fc44036bb674279f9f3752aae479015fec21a8f56f0ee0234 Jul 24 22:52:25.539326 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:25.539255 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" event={"ID":"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183","Type":"ContainerStarted","Data":"4268bd51eb63e62fc44036bb674279f9f3752aae479015fec21a8f56f0ee0234"} Jul 24 22:52:28.554035 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:28.553998 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" event={"ID":"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183","Type":"ContainerStarted","Data":"c2de6fdb3cd968ff0439f79affc34f5319c5f6dc733fca1d03bff97fd2aec8a6"} Jul 24 22:52:29.560063 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:29.560028 2585 generic.go:356] "Generic (PLEG): container finished" podID="35aa88b0-59ce-4cb4-8afe-2c94b8cd6183" containerID="c2de6fdb3cd968ff0439f79affc34f5319c5f6dc733fca1d03bff97fd2aec8a6" exitCode=0 Jul 24 22:52:29.560442 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:29.560117 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" event={"ID":"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183","Type":"ContainerDied","Data":"c2de6fdb3cd968ff0439f79affc34f5319c5f6dc733fca1d03bff97fd2aec8a6"} Jul 24 22:52:30.571483 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:30.571449 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" event={"ID":"35aa88b0-59ce-4cb4-8afe-2c94b8cd6183","Type":"ContainerStarted","Data":"16fae12a36f5eeeef10dbd9be8c9d1b76becd8a2ac2f8fdc9ccec36b0db40d09"} Jul 24 22:52:30.571882 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:30.571548 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:30.605191 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:30.605145 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" podStartSLOduration=2.156758867 podStartE2EDuration="6.605131904s" totalImagesPullingTime="3.368182386s" totalInitContainerRuntime="1.080190651s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:52:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:52:30.603848883 +0000 UTC m=+377.068037310" watchObservedRunningTime="2026-07-24 22:52:30.605131904 +0000 UTC m=+377.069320328" Jul 24 22:52:41.578227 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:41.578195 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69d99768bd-7zdxf" Jul 24 22:52:43.965478 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:43.965442 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dcc8r"] Jul 24 22:52:43.969284 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:43.969266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:43.971662 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:43.971642 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-76887\"" Jul 24 22:52:43.971765 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:43.971685 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 22:52:43.979206 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:43.979182 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dcc8r"] Jul 24 22:52:44.077989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.077955 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j244k\" (UniqueName: \"kubernetes.io/projected/4d43828c-d0c5-4c9e-b856-19b1633c16ff-kube-api-access-j244k\") pod \"odh-model-controller-7998c67dc4-dcc8r\" (UID: \"4d43828c-d0c5-4c9e-b856-19b1633c16ff\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.078157 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.078008 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d43828c-d0c5-4c9e-b856-19b1633c16ff-cert\") pod \"odh-model-controller-7998c67dc4-dcc8r\" (UID: \"4d43828c-d0c5-4c9e-b856-19b1633c16ff\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.178899 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.178865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j244k\" (UniqueName: \"kubernetes.io/projected/4d43828c-d0c5-4c9e-b856-19b1633c16ff-kube-api-access-j244k\") pod \"odh-model-controller-7998c67dc4-dcc8r\" (UID: \"4d43828c-d0c5-4c9e-b856-19b1633c16ff\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.179086 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.178910 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d43828c-d0c5-4c9e-b856-19b1633c16ff-cert\") pod \"odh-model-controller-7998c67dc4-dcc8r\" (UID: \"4d43828c-d0c5-4c9e-b856-19b1633c16ff\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.181191 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.181158 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d43828c-d0c5-4c9e-b856-19b1633c16ff-cert\") pod \"odh-model-controller-7998c67dc4-dcc8r\" (UID: \"4d43828c-d0c5-4c9e-b856-19b1633c16ff\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.190617 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.190591 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j244k\" (UniqueName: \"kubernetes.io/projected/4d43828c-d0c5-4c9e-b856-19b1633c16ff-kube-api-access-j244k\") pod \"odh-model-controller-7998c67dc4-dcc8r\" (UID: \"4d43828c-d0c5-4c9e-b856-19b1633c16ff\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.280583 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.280555 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:44.406227 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.406202 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dcc8r"] Jul 24 22:52:44.408259 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:52:44.408230 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d43828c_d0c5_4c9e_b856_19b1633c16ff.slice/crio-d16d757d2207dfed9b97f54e621cbedbdb638dcd3a2f8ddae84295113ce96009 WatchSource:0}: Error finding container d16d757d2207dfed9b97f54e621cbedbdb638dcd3a2f8ddae84295113ce96009: Status 404 returned error can't find the container with id d16d757d2207dfed9b97f54e621cbedbdb638dcd3a2f8ddae84295113ce96009 Jul 24 22:52:44.612323 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.612248 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-98nbw"] Jul 24 22:52:44.617104 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.617083 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.619558 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.619531 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 24 22:52:44.619558 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.619541 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bf2bj\"" Jul 24 22:52:44.625784 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.625763 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-98nbw"] Jul 24 22:52:44.632013 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.631992 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" event={"ID":"4d43828c-d0c5-4c9e-b856-19b1633c16ff","Type":"ContainerStarted","Data":"d16d757d2207dfed9b97f54e621cbedbdb638dcd3a2f8ddae84295113ce96009"} Jul 24 22:52:44.783725 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.783691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597c8\" (UniqueName: \"kubernetes.io/projected/8ca28a49-c475-44e6-a150-8bdf7fe6cfc5-kube-api-access-597c8\") pod \"model-serving-api-54d89bd5fc-98nbw\" (UID: \"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.783870 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.783730 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca28a49-c475-44e6-a150-8bdf7fe6cfc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-98nbw\" (UID: \"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.884815 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.884742 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597c8\" (UniqueName: \"kubernetes.io/projected/8ca28a49-c475-44e6-a150-8bdf7fe6cfc5-kube-api-access-597c8\") pod \"model-serving-api-54d89bd5fc-98nbw\" (UID: \"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.884815 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.884774 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca28a49-c475-44e6-a150-8bdf7fe6cfc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-98nbw\" (UID: \"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.887139 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.887119 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca28a49-c475-44e6-a150-8bdf7fe6cfc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-98nbw\" (UID: \"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.892442 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.892418 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-597c8\" (UniqueName: \"kubernetes.io/projected/8ca28a49-c475-44e6-a150-8bdf7fe6cfc5-kube-api-access-597c8\") pod \"model-serving-api-54d89bd5fc-98nbw\" (UID: \"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:44.927871 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:44.927848 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:45.061934 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:45.061905 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-98nbw"] Jul 24 22:52:45.064041 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:52:45.064009 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca28a49_c475_44e6_a150_8bdf7fe6cfc5.slice/crio-916ff5d921683d40655297c033f7e6b95e08ea61b2e5088cacada20cea8e4433 WatchSource:0}: Error finding container 916ff5d921683d40655297c033f7e6b95e08ea61b2e5088cacada20cea8e4433: Status 404 returned error can't find the container with id 916ff5d921683d40655297c033f7e6b95e08ea61b2e5088cacada20cea8e4433 Jul 24 22:52:45.638212 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:45.638174 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" event={"ID":"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5","Type":"ContainerStarted","Data":"916ff5d921683d40655297c033f7e6b95e08ea61b2e5088cacada20cea8e4433"} Jul 24 22:52:47.648876 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:47.648837 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" event={"ID":"4d43828c-d0c5-4c9e-b856-19b1633c16ff","Type":"ContainerStarted","Data":"0db9a90e08915e8679dc43e065eeb3599dce922865c50cfd52ea51eb9f4d346e"} Jul 24 22:52:47.649298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:47.648939 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:47.650317 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:47.650292 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" event={"ID":"8ca28a49-c475-44e6-a150-8bdf7fe6cfc5","Type":"ContainerStarted","Data":"be6a7daa9812b1c715321c67097398a689ddd43102e1551470528a60a0a4f3ea"} Jul 24 22:52:47.650423 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:47.650409 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:52:47.666044 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:47.665997 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" podStartSLOduration=1.5809469950000001 podStartE2EDuration="4.665983876s" totalImagesPullingTime="3.085036881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:52:47.664692763 +0000 UTC m=+394.128881212" watchObservedRunningTime="2026-07-24 22:52:47.665983876 +0000 UTC m=+394.130172302" Jul 24 22:52:47.679199 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:47.679161 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" podStartSLOduration=1.253426039 podStartE2EDuration="3.679148236s" totalImagesPullingTime="2.425722197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:52:47.678564172 +0000 UTC m=+394.142752598" watchObservedRunningTime="2026-07-24 22:52:47.679148236 +0000 UTC m=+394.143336661" Jul 24 22:52:51.139048 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.139017 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs"] Jul 24 22:52:51.142522 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.142499 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.146156 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.146137 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 22:52:51.146261 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.146162 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 22:52:51.146261 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.146170 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 22:52:51.146261 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.146197 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-stbf4\"" Jul 24 22:52:51.159625 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.159607 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs"] Jul 24 22:52:51.239563 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.239531 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6dc0b360-5bd8-4a63-ae86-564190f89bd9-manager-config\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.239712 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.239570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6dc0b360-5bd8-4a63-ae86-564190f89bd9-metrics-cert\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.239712 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.239598 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5h2t\" (UniqueName: \"kubernetes.io/projected/6dc0b360-5bd8-4a63-ae86-564190f89bd9-kube-api-access-q5h2t\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.239712 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.239649 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc0b360-5bd8-4a63-ae86-564190f89bd9-cert\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.340251 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.340219 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6dc0b360-5bd8-4a63-ae86-564190f89bd9-manager-config\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.340392 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.340258 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6dc0b360-5bd8-4a63-ae86-564190f89bd9-metrics-cert\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.340392 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.340285 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5h2t\" (UniqueName: \"kubernetes.io/projected/6dc0b360-5bd8-4a63-ae86-564190f89bd9-kube-api-access-q5h2t\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.340392 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.340329 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc0b360-5bd8-4a63-ae86-564190f89bd9-cert\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.341069 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.341046 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6dc0b360-5bd8-4a63-ae86-564190f89bd9-manager-config\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.343002 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.342976 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc0b360-5bd8-4a63-ae86-564190f89bd9-cert\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.343102 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.342976 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6dc0b360-5bd8-4a63-ae86-564190f89bd9-metrics-cert\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.349855 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.349830 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5h2t\" (UniqueName: \"kubernetes.io/projected/6dc0b360-5bd8-4a63-ae86-564190f89bd9-kube-api-access-q5h2t\") pod \"lws-controller-manager-86cd477748-tdgbs\" (UID: \"6dc0b360-5bd8-4a63-ae86-564190f89bd9\") " pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.452169 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.452110 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:51.582475 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.582454 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs"] Jul 24 22:52:51.583939 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:52:51.583915 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc0b360_5bd8_4a63_ae86_564190f89bd9.slice/crio-6c13634d15d73ac2a7a1aacfc64ab9b69d903514aae2f771655912a06192327d WatchSource:0}: Error finding container 6c13634d15d73ac2a7a1aacfc64ab9b69d903514aae2f771655912a06192327d: Status 404 returned error can't find the container with id 6c13634d15d73ac2a7a1aacfc64ab9b69d903514aae2f771655912a06192327d Jul 24 22:52:51.668465 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:51.668430 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" event={"ID":"6dc0b360-5bd8-4a63-ae86-564190f89bd9","Type":"ContainerStarted","Data":"6c13634d15d73ac2a7a1aacfc64ab9b69d903514aae2f771655912a06192327d"} Jul 24 22:52:53.679594 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:53.679556 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" event={"ID":"6dc0b360-5bd8-4a63-ae86-564190f89bd9","Type":"ContainerStarted","Data":"2c132a31483f40c8dd9dc6fc4d0dbae6c16612ed3fa8f3cf7953e43dcb7405b6"} Jul 24 22:52:53.679991 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:53.679663 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:52:53.699802 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:53.699754 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" podStartSLOduration=1.162675284 podStartE2EDuration="2.699739086s" totalImagesPullingTime="1.537063802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:52:53.698280623 +0000 UTC m=+400.162469049" watchObservedRunningTime="2026-07-24 22:52:53.699739086 +0000 UTC m=+400.163927511" Jul 24 22:52:58.657320 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:58.657290 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dcc8r" Jul 24 22:52:58.659441 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:52:58.659420 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-98nbw" Jul 24 22:53:01.755036 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.755000 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph"] Jul 24 22:53:01.762646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.762623 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.765392 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.765360 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 22:53:01.765537 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.765365 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 22:53:01.765537 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.765442 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jfdz9\"" Jul 24 22:53:01.765537 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.765492 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 22:53:01.772502 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.772477 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph"] Jul 24 22:53:01.814744 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814710 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.814744 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814749 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8b9\" (UniqueName: \"kubernetes.io/projected/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-kube-api-access-xs8b9\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815025 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814773 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815025 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814790 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815025 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815025 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814964 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815025 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.814989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815219 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.815038 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.815219 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.815140 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916559 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916519 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916579 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916609 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8b9\" (UniqueName: \"kubernetes.io/projected/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-kube-api-access-xs8b9\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916637 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916735 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.916762 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.917164 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.916787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.917164 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.917079 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.917164 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.917153 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.917322 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.917201 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.917372 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.917329 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.917644 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.917622 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.918985 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.918961 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.919283 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.919266 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.925698 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.925662 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:01.925698 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:01.925677 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8b9\" (UniqueName: \"kubernetes.io/projected/48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b-kube-api-access-xs8b9\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph\" (UID: \"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:02.074259 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:02.074162 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:02.209206 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:02.208451 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph"] Jul 24 22:53:02.215946 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:53:02.215914 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b8c2fb_4ad6_4fb7_9629_2a0456a5b51b.slice/crio-5f5bd01fc136ae1862d9df6ddf611cc3a80863d9527f9ff3536b251996d383d2 WatchSource:0}: Error finding container 5f5bd01fc136ae1862d9df6ddf611cc3a80863d9527f9ff3536b251996d383d2: Status 404 returned error can't find the container with id 5f5bd01fc136ae1862d9df6ddf611cc3a80863d9527f9ff3536b251996d383d2 Jul 24 22:53:02.721711 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:02.721674 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" event={"ID":"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b","Type":"ContainerStarted","Data":"5f5bd01fc136ae1862d9df6ddf611cc3a80863d9527f9ff3536b251996d383d2"} Jul 24 22:53:04.686582 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:04.686545 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86cd477748-tdgbs" Jul 24 22:53:08.649811 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:08.649761 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:53:08.650084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:08.649844 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:53:08.650084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:08.649874 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:53:08.753660 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:08.753623 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" event={"ID":"48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b","Type":"ContainerStarted","Data":"ee2936d818c6c36d7590d783c5c2d2ebf52d7c7c1c94660543918e58609713cc"} Jul 24 22:53:08.773720 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:08.773656 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" podStartSLOduration=1.341940994 podStartE2EDuration="7.7736417s" totalImagesPullingTime="6.431700706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:53:08.773208895 +0000 UTC m=+415.237397318" watchObservedRunningTime="2026-07-24 22:53:08.7736417 +0000 UTC m=+415.237830124" Jul 24 22:53:09.074700 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:09.074622 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:09.076106 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:09.076072 2585 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 24 22:53:09.076245 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:09.076138 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" podUID="48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 24 22:53:10.078632 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:10.078602 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:10.763295 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:10.763263 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:10.764187 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:10.764166 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph" Jul 24 22:53:44.783715 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.783634 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xfcfr"] Jul 24 22:53:44.793462 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.793441 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:44.796134 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.796112 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 22:53:44.797117 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.797064 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 22:53:44.797257 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.797063 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x5r2f\"" Jul 24 22:53:44.799917 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.799896 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xfcfr"] Jul 24 22:53:44.973181 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:44.973149 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj5bp\" (UniqueName: \"kubernetes.io/projected/b70cafc3-c2b1-41b2-a863-0d08907e387a-kube-api-access-fj5bp\") pod \"kuadrant-operator-catalog-xfcfr\" (UID: \"b70cafc3-c2b1-41b2-a863-0d08907e387a\") " pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:45.073559 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.073486 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj5bp\" (UniqueName: \"kubernetes.io/projected/b70cafc3-c2b1-41b2-a863-0d08907e387a-kube-api-access-fj5bp\") pod \"kuadrant-operator-catalog-xfcfr\" (UID: \"b70cafc3-c2b1-41b2-a863-0d08907e387a\") " pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:45.081622 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.081596 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj5bp\" (UniqueName: \"kubernetes.io/projected/b70cafc3-c2b1-41b2-a863-0d08907e387a-kube-api-access-fj5bp\") pod \"kuadrant-operator-catalog-xfcfr\" (UID: \"b70cafc3-c2b1-41b2-a863-0d08907e387a\") " pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:45.103846 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.103825 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:45.148325 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.148297 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xfcfr"] Jul 24 22:53:45.227105 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.227079 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xfcfr"] Jul 24 22:53:45.228862 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:53:45.228835 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70cafc3_c2b1_41b2_a863_0d08907e387a.slice/crio-b2128832b845fba36da1e1ff2b9507860d8b9737b899edf1d04ed927f1782dd7 WatchSource:0}: Error finding container b2128832b845fba36da1e1ff2b9507860d8b9737b899edf1d04ed927f1782dd7: Status 404 returned error can't find the container with id b2128832b845fba36da1e1ff2b9507860d8b9737b899edf1d04ed927f1782dd7 Jul 24 22:53:45.359431 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.359347 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krn5d"] Jul 24 22:53:45.364067 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.364051 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:45.375770 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.375743 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krn5d"] Jul 24 22:53:45.476966 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.476936 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4btx\" (UniqueName: \"kubernetes.io/projected/3a8cd855-0df1-4522-992a-6822493ef001-kube-api-access-h4btx\") pod \"kuadrant-operator-catalog-krn5d\" (UID: \"3a8cd855-0df1-4522-992a-6822493ef001\") " pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:45.578236 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.578207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4btx\" (UniqueName: \"kubernetes.io/projected/3a8cd855-0df1-4522-992a-6822493ef001-kube-api-access-h4btx\") pod \"kuadrant-operator-catalog-krn5d\" (UID: \"3a8cd855-0df1-4522-992a-6822493ef001\") " pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:45.591855 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.591820 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4btx\" (UniqueName: \"kubernetes.io/projected/3a8cd855-0df1-4522-992a-6822493ef001-kube-api-access-h4btx\") pod \"kuadrant-operator-catalog-krn5d\" (UID: \"3a8cd855-0df1-4522-992a-6822493ef001\") " pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:45.673758 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.673700 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:45.916941 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:45.916902 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" event={"ID":"b70cafc3-c2b1-41b2-a863-0d08907e387a","Type":"ContainerStarted","Data":"b2128832b845fba36da1e1ff2b9507860d8b9737b899edf1d04ed927f1782dd7"} Jul 24 22:53:46.012433 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:46.012400 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krn5d"] Jul 24 22:53:46.085714 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:53:46.085682 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8cd855_0df1_4522_992a_6822493ef001.slice/crio-8c7acd9b67ab2df8de41ba340d4bb0f4da22e8587faa85e9ea4a1eee82320c9d WatchSource:0}: Error finding container 8c7acd9b67ab2df8de41ba340d4bb0f4da22e8587faa85e9ea4a1eee82320c9d: Status 404 returned error can't find the container with id 8c7acd9b67ab2df8de41ba340d4bb0f4da22e8587faa85e9ea4a1eee82320c9d Jul 24 22:53:46.927133 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:46.927059 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" event={"ID":"3a8cd855-0df1-4522-992a-6822493ef001","Type":"ContainerStarted","Data":"8c7acd9b67ab2df8de41ba340d4bb0f4da22e8587faa85e9ea4a1eee82320c9d"} Jul 24 22:53:47.933663 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:47.933628 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" event={"ID":"3a8cd855-0df1-4522-992a-6822493ef001","Type":"ContainerStarted","Data":"8600aedf8450971b9739420d0c3e62ab98b028a9af2c75120732ad7a8720968a"} Jul 24 22:53:47.935123 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:47.935090 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" event={"ID":"b70cafc3-c2b1-41b2-a863-0d08907e387a","Type":"ContainerStarted","Data":"cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891"} Jul 24 22:53:47.935240 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:47.935158 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" podUID="b70cafc3-c2b1-41b2-a863-0d08907e387a" containerName="registry-server" containerID="cri-o://cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891" gracePeriod=2 Jul 24 22:53:47.948717 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:47.948677 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" podStartSLOduration=1.791588572 podStartE2EDuration="2.948658653s" totalImagesPullingTime="1.157070081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:53:47.94817365 +0000 UTC m=+454.412362095" watchObservedRunningTime="2026-07-24 22:53:47.948658653 +0000 UTC m=+454.412847080" Jul 24 22:53:47.963008 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:47.962964 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" podStartSLOduration=1.951545254 podStartE2EDuration="3.962947641s" totalImagesPullingTime="2.011402387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:53:47.962559003 +0000 UTC m=+454.426747427" watchObservedRunningTime="2026-07-24 22:53:47.962947641 +0000 UTC m=+454.427136067" Jul 24 22:53:48.180560 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.180538 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:48.202643 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.202583 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj5bp\" (UniqueName: \"kubernetes.io/projected/b70cafc3-c2b1-41b2-a863-0d08907e387a-kube-api-access-fj5bp\") pod \"b70cafc3-c2b1-41b2-a863-0d08907e387a\" (UID: \"b70cafc3-c2b1-41b2-a863-0d08907e387a\") " Jul 24 22:53:48.204640 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.204612 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b70cafc3-c2b1-41b2-a863-0d08907e387a-kube-api-access-fj5bp" (OuterVolumeSpecName: "kube-api-access-fj5bp") pod "b70cafc3-c2b1-41b2-a863-0d08907e387a" (UID: "b70cafc3-c2b1-41b2-a863-0d08907e387a"). InnerVolumeSpecName "kube-api-access-fj5bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:53:48.303199 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.303173 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj5bp\" (UniqueName: \"kubernetes.io/projected/b70cafc3-c2b1-41b2-a863-0d08907e387a-kube-api-access-fj5bp\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:53:48.940446 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.940408 2585 generic.go:356] "Generic (PLEG): container finished" podID="b70cafc3-c2b1-41b2-a863-0d08907e387a" containerID="cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891" exitCode=0 Jul 24 22:53:48.940849 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.940459 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" Jul 24 22:53:48.940849 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.940494 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" event={"ID":"b70cafc3-c2b1-41b2-a863-0d08907e387a","Type":"ContainerDied","Data":"cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891"} Jul 24 22:53:48.940849 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.940555 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xfcfr" event={"ID":"b70cafc3-c2b1-41b2-a863-0d08907e387a","Type":"ContainerDied","Data":"b2128832b845fba36da1e1ff2b9507860d8b9737b899edf1d04ed927f1782dd7"} Jul 24 22:53:48.940849 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.940579 2585 scope.go:117] "RemoveContainer" containerID="cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891" Jul 24 22:53:48.949366 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.949350 2585 scope.go:117] "RemoveContainer" containerID="cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891" Jul 24 22:53:48.949615 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:53:48.949597 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891\": container with ID starting with cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891 not found: ID does not exist" containerID="cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891" Jul 24 22:53:48.949662 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.949621 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891"} err="failed to get container status \"cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891\": rpc error: code = NotFound desc = could not find container \"cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891\": container with ID starting with cd54e29392a208fde832c0dfd636ecb6b746d5a01cea2b545bf47d2e92859891 not found: ID does not exist" Jul 24 22:53:48.960899 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.960878 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xfcfr"] Jul 24 22:53:48.964769 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:48.964747 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xfcfr"] Jul 24 22:53:50.051422 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:50.051392 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b70cafc3-c2b1-41b2-a863-0d08907e387a" path="/var/lib/kubelet/pods/b70cafc3-c2b1-41b2-a863-0d08907e387a/volumes" Jul 24 22:53:55.674081 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:55.674050 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:55.674531 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:55.674128 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:55.695377 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:55.695355 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:53:55.993860 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:53:55.993834 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-krn5d" Jul 24 22:54:00.391132 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.391096 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t"] Jul 24 22:54:00.391515 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.391412 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b70cafc3-c2b1-41b2-a863-0d08907e387a" containerName="registry-server" Jul 24 22:54:00.391515 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.391422 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b70cafc3-c2b1-41b2-a863-0d08907e387a" containerName="registry-server" Jul 24 22:54:00.391515 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.391483 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b70cafc3-c2b1-41b2-a863-0d08907e387a" containerName="registry-server" Jul 24 22:54:00.395883 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.395864 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.398256 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.398235 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pqjc8\"" Jul 24 22:54:00.402124 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.402103 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t"] Jul 24 22:54:00.501850 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.501818 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.501850 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.501851 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl9k9\" (UniqueName: \"kubernetes.io/projected/28220053-6ac3-4a3e-8343-5e08f64bacfb-kube-api-access-wl9k9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.502063 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.501948 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.602471 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.602440 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.602634 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.602487 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.602634 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.602505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl9k9\" (UniqueName: \"kubernetes.io/projected/28220053-6ac3-4a3e-8343-5e08f64bacfb-kube-api-access-wl9k9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.602813 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.602781 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.602902 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.602883 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.610834 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.610814 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl9k9\" (UniqueName: \"kubernetes.io/projected/28220053-6ac3-4a3e-8343-5e08f64bacfb-kube-api-access-wl9k9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.705453 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.705383 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:00.793123 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.793092 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9"] Jul 24 22:54:00.797533 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.797512 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:00.804574 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.804461 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9"] Jul 24 22:54:00.835372 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.835351 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t"] Jul 24 22:54:00.905874 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.905846 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:00.905971 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.905921 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:00.905971 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.905941 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxmm\" (UniqueName: \"kubernetes.io/projected/ffdd0e62-2668-4a89-ad4f-0f4715c87417-kube-api-access-6qxmm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:00.996319 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.996290 2585 generic.go:356] "Generic (PLEG): container finished" podID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerID="b19c9356f4fdd48b121a4e38718a51b0cb91acc783cea12a45b2e49dc6eab49c" exitCode=0 Jul 24 22:54:00.996431 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.996373 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" event={"ID":"28220053-6ac3-4a3e-8343-5e08f64bacfb","Type":"ContainerDied","Data":"b19c9356f4fdd48b121a4e38718a51b0cb91acc783cea12a45b2e49dc6eab49c"} Jul 24 22:54:00.996479 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:00.996454 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" event={"ID":"28220053-6ac3-4a3e-8343-5e08f64bacfb","Type":"ContainerStarted","Data":"c251bfe4d00a77474d4f80fca5a100e01676479d115bb99c7d4d23a3055877a3"} Jul 24 22:54:01.007015 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.006989 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.007129 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.007110 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxmm\" (UniqueName: \"kubernetes.io/projected/ffdd0e62-2668-4a89-ad4f-0f4715c87417-kube-api-access-6qxmm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.007193 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.007156 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.007365 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.007343 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.007497 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.007472 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.017084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.017051 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxmm\" (UniqueName: \"kubernetes.io/projected/ffdd0e62-2668-4a89-ad4f-0f4715c87417-kube-api-access-6qxmm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.109913 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.109893 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:01.191604 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.191566 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv"] Jul 24 22:54:01.196697 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.196658 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.208904 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.205586 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv"] Jul 24 22:54:01.276931 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.276905 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9"] Jul 24 22:54:01.278208 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:01.278184 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdd0e62_2668_4a89_ad4f_0f4715c87417.slice/crio-8e2e9421f6c1d66a48b8990b132f6afcdbc9c2bec2489604cd4dad0fc2ee5f54 WatchSource:0}: Error finding container 8e2e9421f6c1d66a48b8990b132f6afcdbc9c2bec2489604cd4dad0fc2ee5f54: Status 404 returned error can't find the container with id 8e2e9421f6c1d66a48b8990b132f6afcdbc9c2bec2489604cd4dad0fc2ee5f54 Jul 24 22:54:01.310675 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.310650 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.310770 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.310686 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b5t8\" (UniqueName: \"kubernetes.io/projected/87d04ac6-8a60-40d9-b912-94656277c488-kube-api-access-6b5t8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.310770 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.310763 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.411396 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.411366 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.411722 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.411424 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.411722 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.411449 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b5t8\" (UniqueName: \"kubernetes.io/projected/87d04ac6-8a60-40d9-b912-94656277c488-kube-api-access-6b5t8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.411820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.411771 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.411820 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.411786 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.419603 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.419583 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b5t8\" (UniqueName: \"kubernetes.io/projected/87d04ac6-8a60-40d9-b912-94656277c488-kube-api-access-6b5t8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.521418 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.521383 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:01.591585 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.591557 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd"] Jul 24 22:54:01.595327 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.595303 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.608658 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.608421 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd"] Jul 24 22:54:01.660413 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.660387 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv"] Jul 24 22:54:01.661641 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:01.661612 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d04ac6_8a60_40d9_b912_94656277c488.slice/crio-0e3986996f7f7839c176f2b83784461f5e40fc5d079748d5d7f12eb3d13987f3 WatchSource:0}: Error finding container 0e3986996f7f7839c176f2b83784461f5e40fc5d079748d5d7f12eb3d13987f3: Status 404 returned error can't find the container with id 0e3986996f7f7839c176f2b83784461f5e40fc5d079748d5d7f12eb3d13987f3 Jul 24 22:54:01.714105 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.714068 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvp6\" (UniqueName: \"kubernetes.io/projected/0344517d-8408-4c37-a146-39313c23dcfa-kube-api-access-6qvp6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.714298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.714195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.714298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.714233 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.814661 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.814632 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.814779 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.814681 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.814779 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.814758 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvp6\" (UniqueName: \"kubernetes.io/projected/0344517d-8408-4c37-a146-39313c23dcfa-kube-api-access-6qvp6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.815104 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.815080 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.815171 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.815102 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.823974 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.823949 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvp6\" (UniqueName: \"kubernetes.io/projected/0344517d-8408-4c37-a146-39313c23dcfa-kube-api-access-6qvp6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:01.906316 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:01.906291 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:02.004164 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.003714 2585 generic.go:356] "Generic (PLEG): container finished" podID="87d04ac6-8a60-40d9-b912-94656277c488" containerID="048dd5308ce66499abb58eac853d44a3bec6845d096c97808e52f8291376ed74" exitCode=0 Jul 24 22:54:02.004164 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.004057 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" event={"ID":"87d04ac6-8a60-40d9-b912-94656277c488","Type":"ContainerDied","Data":"048dd5308ce66499abb58eac853d44a3bec6845d096c97808e52f8291376ed74"} Jul 24 22:54:02.004164 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.004122 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" event={"ID":"87d04ac6-8a60-40d9-b912-94656277c488","Type":"ContainerStarted","Data":"0e3986996f7f7839c176f2b83784461f5e40fc5d079748d5d7f12eb3d13987f3"} Jul 24 22:54:02.006885 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.006694 2585 generic.go:356] "Generic (PLEG): container finished" podID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerID="55c19318a54eb0e1a30a6003f27b5348fa7a4dc5cf0ae25df20fe059686f588a" exitCode=0 Jul 24 22:54:02.006885 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.006739 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" event={"ID":"ffdd0e62-2668-4a89-ad4f-0f4715c87417","Type":"ContainerDied","Data":"55c19318a54eb0e1a30a6003f27b5348fa7a4dc5cf0ae25df20fe059686f588a"} Jul 24 22:54:02.006885 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.006787 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" event={"ID":"ffdd0e62-2668-4a89-ad4f-0f4715c87417","Type":"ContainerStarted","Data":"8e2e9421f6c1d66a48b8990b132f6afcdbc9c2bec2489604cd4dad0fc2ee5f54"} Jul 24 22:54:02.009116 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.009096 2585 generic.go:356] "Generic (PLEG): container finished" podID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerID="af1b1f692a6cc2e84b98c9ab06c51e3e9e8bad31d8eb0c598877395d50d4dfe5" exitCode=0 Jul 24 22:54:02.009221 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.009130 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" event={"ID":"28220053-6ac3-4a3e-8343-5e08f64bacfb","Type":"ContainerDied","Data":"af1b1f692a6cc2e84b98c9ab06c51e3e9e8bad31d8eb0c598877395d50d4dfe5"} Jul 24 22:54:02.034994 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:02.034974 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd"] Jul 24 22:54:02.038912 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:02.038889 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0344517d_8408_4c37_a146_39313c23dcfa.slice/crio-ecfe5aec5d2c9d4bf817cea0bff1ee8a4cc1f404ca8cf06fe4221263747cab71 WatchSource:0}: Error finding container ecfe5aec5d2c9d4bf817cea0bff1ee8a4cc1f404ca8cf06fe4221263747cab71: Status 404 returned error can't find the container with id ecfe5aec5d2c9d4bf817cea0bff1ee8a4cc1f404ca8cf06fe4221263747cab71 Jul 24 22:54:03.016038 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.016005 2585 generic.go:356] "Generic (PLEG): container finished" podID="87d04ac6-8a60-40d9-b912-94656277c488" containerID="a8b46b190da6bdb0fa05cc199fa21983812d4508d60de1996a6038a36269bf76" exitCode=0 Jul 24 22:54:03.016359 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.016038 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" event={"ID":"87d04ac6-8a60-40d9-b912-94656277c488","Type":"ContainerDied","Data":"a8b46b190da6bdb0fa05cc199fa21983812d4508d60de1996a6038a36269bf76"} Jul 24 22:54:03.017889 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.017868 2585 generic.go:356] "Generic (PLEG): container finished" podID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerID="b20326849edd389c825fb5750e9faf868bf318847aba49e1f9b53bac919cacb8" exitCode=0 Jul 24 22:54:03.017990 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.017945 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" event={"ID":"ffdd0e62-2668-4a89-ad4f-0f4715c87417","Type":"ContainerDied","Data":"b20326849edd389c825fb5750e9faf868bf318847aba49e1f9b53bac919cacb8"} Jul 24 22:54:03.019464 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.019410 2585 generic.go:356] "Generic (PLEG): container finished" podID="0344517d-8408-4c37-a146-39313c23dcfa" containerID="f534ab665a00e54d84742e56f3dce1e89fd4c406d6e648cb9cbfe298cb6fd93b" exitCode=0 Jul 24 22:54:03.019567 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.019504 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" event={"ID":"0344517d-8408-4c37-a146-39313c23dcfa","Type":"ContainerDied","Data":"f534ab665a00e54d84742e56f3dce1e89fd4c406d6e648cb9cbfe298cb6fd93b"} Jul 24 22:54:03.019567 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.019537 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" event={"ID":"0344517d-8408-4c37-a146-39313c23dcfa","Type":"ContainerStarted","Data":"ecfe5aec5d2c9d4bf817cea0bff1ee8a4cc1f404ca8cf06fe4221263747cab71"} Jul 24 22:54:03.021896 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.021872 2585 generic.go:356] "Generic (PLEG): container finished" podID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerID="b7b1aef9e4ac5d644defd7daba282e359ea07f3f8015a20687c27a40aa49d128" exitCode=0 Jul 24 22:54:03.021997 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:03.021904 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" event={"ID":"28220053-6ac3-4a3e-8343-5e08f64bacfb","Type":"ContainerDied","Data":"b7b1aef9e4ac5d644defd7daba282e359ea07f3f8015a20687c27a40aa49d128"} Jul 24 22:54:04.028414 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.028387 2585 generic.go:356] "Generic (PLEG): container finished" podID="0344517d-8408-4c37-a146-39313c23dcfa" containerID="be359bd394f3c866cd43210930862db1e46f1b169af061bb7f0481346f97048b" exitCode=0 Jul 24 22:54:04.028783 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.028472 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" event={"ID":"0344517d-8408-4c37-a146-39313c23dcfa","Type":"ContainerDied","Data":"be359bd394f3c866cd43210930862db1e46f1b169af061bb7f0481346f97048b"} Jul 24 22:54:04.030716 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.030693 2585 generic.go:356] "Generic (PLEG): container finished" podID="87d04ac6-8a60-40d9-b912-94656277c488" containerID="3a3623892f122a15f92824e3ac208e8176e9ab26d29f7c3d80e1126a49e18be1" exitCode=0 Jul 24 22:54:04.030822 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.030765 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" event={"ID":"87d04ac6-8a60-40d9-b912-94656277c488","Type":"ContainerDied","Data":"3a3623892f122a15f92824e3ac208e8176e9ab26d29f7c3d80e1126a49e18be1"} Jul 24 22:54:04.032786 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.032766 2585 generic.go:356] "Generic (PLEG): container finished" podID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerID="38b3fc9c90e1a0c83eb2588c39abde0d05cd45ae0130e7a523cd011e439f76ac" exitCode=0 Jul 24 22:54:04.032892 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.032814 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" event={"ID":"ffdd0e62-2668-4a89-ad4f-0f4715c87417","Type":"ContainerDied","Data":"38b3fc9c90e1a0c83eb2588c39abde0d05cd45ae0130e7a523cd011e439f76ac"} Jul 24 22:54:04.167554 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.167531 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:04.232584 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.232558 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl9k9\" (UniqueName: \"kubernetes.io/projected/28220053-6ac3-4a3e-8343-5e08f64bacfb-kube-api-access-wl9k9\") pod \"28220053-6ac3-4a3e-8343-5e08f64bacfb\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " Jul 24 22:54:04.232750 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.232637 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-bundle\") pod \"28220053-6ac3-4a3e-8343-5e08f64bacfb\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " Jul 24 22:54:04.232750 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.232675 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-util\") pod \"28220053-6ac3-4a3e-8343-5e08f64bacfb\" (UID: \"28220053-6ac3-4a3e-8343-5e08f64bacfb\") " Jul 24 22:54:04.233172 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.233145 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-bundle" (OuterVolumeSpecName: "bundle") pod "28220053-6ac3-4a3e-8343-5e08f64bacfb" (UID: "28220053-6ac3-4a3e-8343-5e08f64bacfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:04.234606 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.234585 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28220053-6ac3-4a3e-8343-5e08f64bacfb-kube-api-access-wl9k9" (OuterVolumeSpecName: "kube-api-access-wl9k9") pod "28220053-6ac3-4a3e-8343-5e08f64bacfb" (UID: "28220053-6ac3-4a3e-8343-5e08f64bacfb"). InnerVolumeSpecName "kube-api-access-wl9k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:54:04.240242 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.240220 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-util" (OuterVolumeSpecName: "util") pod "28220053-6ac3-4a3e-8343-5e08f64bacfb" (UID: "28220053-6ac3-4a3e-8343-5e08f64bacfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:04.333271 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.333232 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl9k9\" (UniqueName: \"kubernetes.io/projected/28220053-6ac3-4a3e-8343-5e08f64bacfb-kube-api-access-wl9k9\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:04.333271 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.333265 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:04.333271 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:04.333277 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28220053-6ac3-4a3e-8343-5e08f64bacfb-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:05.039962 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.039932 2585 generic.go:356] "Generic (PLEG): container finished" podID="0344517d-8408-4c37-a146-39313c23dcfa" containerID="dfdfab59d0feb8fd6eb322809bbdcf503ff04014125ca94ac79c880473427897" exitCode=0 Jul 24 22:54:05.040351 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.040015 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" event={"ID":"0344517d-8408-4c37-a146-39313c23dcfa","Type":"ContainerDied","Data":"dfdfab59d0feb8fd6eb322809bbdcf503ff04014125ca94ac79c880473427897"} Jul 24 22:54:05.041733 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.041710 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" event={"ID":"28220053-6ac3-4a3e-8343-5e08f64bacfb","Type":"ContainerDied","Data":"c251bfe4d00a77474d4f80fca5a100e01676479d115bb99c7d4d23a3055877a3"} Jul 24 22:54:05.041852 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.041747 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c251bfe4d00a77474d4f80fca5a100e01676479d115bb99c7d4d23a3055877a3" Jul 24 22:54:05.041852 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.041748 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t" Jul 24 22:54:05.174732 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.174712 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:05.203207 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.203184 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:05.240427 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.240393 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-bundle\") pod \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " Jul 24 22:54:05.240427 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.240427 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qxmm\" (UniqueName: \"kubernetes.io/projected/ffdd0e62-2668-4a89-ad4f-0f4715c87417-kube-api-access-6qxmm\") pod \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " Jul 24 22:54:05.240646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.240461 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b5t8\" (UniqueName: \"kubernetes.io/projected/87d04ac6-8a60-40d9-b912-94656277c488-kube-api-access-6b5t8\") pod \"87d04ac6-8a60-40d9-b912-94656277c488\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " Jul 24 22:54:05.240646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.240485 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-bundle\") pod \"87d04ac6-8a60-40d9-b912-94656277c488\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " Jul 24 22:54:05.240646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.240500 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-util\") pod \"87d04ac6-8a60-40d9-b912-94656277c488\" (UID: \"87d04ac6-8a60-40d9-b912-94656277c488\") " Jul 24 22:54:05.240646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.240520 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-util\") pod \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\" (UID: \"ffdd0e62-2668-4a89-ad4f-0f4715c87417\") " Jul 24 22:54:05.241097 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.241066 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-bundle" (OuterVolumeSpecName: "bundle") pod "87d04ac6-8a60-40d9-b912-94656277c488" (UID: "87d04ac6-8a60-40d9-b912-94656277c488"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:05.241232 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.241200 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-bundle" (OuterVolumeSpecName: "bundle") pod "ffdd0e62-2668-4a89-ad4f-0f4715c87417" (UID: "ffdd0e62-2668-4a89-ad4f-0f4715c87417"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:05.242653 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.242629 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffdd0e62-2668-4a89-ad4f-0f4715c87417-kube-api-access-6qxmm" (OuterVolumeSpecName: "kube-api-access-6qxmm") pod "ffdd0e62-2668-4a89-ad4f-0f4715c87417" (UID: "ffdd0e62-2668-4a89-ad4f-0f4715c87417"). InnerVolumeSpecName "kube-api-access-6qxmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:54:05.243009 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.242989 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d04ac6-8a60-40d9-b912-94656277c488-kube-api-access-6b5t8" (OuterVolumeSpecName: "kube-api-access-6b5t8") pod "87d04ac6-8a60-40d9-b912-94656277c488" (UID: "87d04ac6-8a60-40d9-b912-94656277c488"). InnerVolumeSpecName "kube-api-access-6b5t8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:54:05.246361 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.246340 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-util" (OuterVolumeSpecName: "util") pod "ffdd0e62-2668-4a89-ad4f-0f4715c87417" (UID: "ffdd0e62-2668-4a89-ad4f-0f4715c87417"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:05.247065 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.247044 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-util" (OuterVolumeSpecName: "util") pod "87d04ac6-8a60-40d9-b912-94656277c488" (UID: "87d04ac6-8a60-40d9-b912-94656277c488"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:05.341657 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.341576 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:05.341657 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.341603 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qxmm\" (UniqueName: \"kubernetes.io/projected/ffdd0e62-2668-4a89-ad4f-0f4715c87417-kube-api-access-6qxmm\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:05.341657 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.341614 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b5t8\" (UniqueName: \"kubernetes.io/projected/87d04ac6-8a60-40d9-b912-94656277c488-kube-api-access-6b5t8\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:05.341657 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.341626 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:05.341657 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.341635 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d04ac6-8a60-40d9-b912-94656277c488-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:05.341657 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:05.341642 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdd0e62-2668-4a89-ad4f-0f4715c87417-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:06.048195 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.048162 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" Jul 24 22:54:06.050240 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.050219 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" Jul 24 22:54:06.052937 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.052910 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv" event={"ID":"87d04ac6-8a60-40d9-b912-94656277c488","Type":"ContainerDied","Data":"0e3986996f7f7839c176f2b83784461f5e40fc5d079748d5d7f12eb3d13987f3"} Jul 24 22:54:06.053024 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.052946 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e3986996f7f7839c176f2b83784461f5e40fc5d079748d5d7f12eb3d13987f3" Jul 24 22:54:06.053024 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.052958 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9" event={"ID":"ffdd0e62-2668-4a89-ad4f-0f4715c87417","Type":"ContainerDied","Data":"8e2e9421f6c1d66a48b8990b132f6afcdbc9c2bec2489604cd4dad0fc2ee5f54"} Jul 24 22:54:06.053024 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.052975 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e2e9421f6c1d66a48b8990b132f6afcdbc9c2bec2489604cd4dad0fc2ee5f54" Jul 24 22:54:06.180580 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.180557 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:06.248911 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.248870 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-bundle\") pod \"0344517d-8408-4c37-a146-39313c23dcfa\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " Jul 24 22:54:06.249052 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.248967 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-util\") pod \"0344517d-8408-4c37-a146-39313c23dcfa\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " Jul 24 22:54:06.249052 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.249033 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qvp6\" (UniqueName: \"kubernetes.io/projected/0344517d-8408-4c37-a146-39313c23dcfa-kube-api-access-6qvp6\") pod \"0344517d-8408-4c37-a146-39313c23dcfa\" (UID: \"0344517d-8408-4c37-a146-39313c23dcfa\") " Jul 24 22:54:06.249386 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.249359 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-bundle" (OuterVolumeSpecName: "bundle") pod "0344517d-8408-4c37-a146-39313c23dcfa" (UID: "0344517d-8408-4c37-a146-39313c23dcfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:06.251061 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.251036 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0344517d-8408-4c37-a146-39313c23dcfa-kube-api-access-6qvp6" (OuterVolumeSpecName: "kube-api-access-6qvp6") pod "0344517d-8408-4c37-a146-39313c23dcfa" (UID: "0344517d-8408-4c37-a146-39313c23dcfa"). InnerVolumeSpecName "kube-api-access-6qvp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:54:06.255877 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.255836 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-util" (OuterVolumeSpecName: "util") pod "0344517d-8408-4c37-a146-39313c23dcfa" (UID: "0344517d-8408-4c37-a146-39313c23dcfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:06.349708 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.349621 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-util\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:06.349708 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.349654 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qvp6\" (UniqueName: \"kubernetes.io/projected/0344517d-8408-4c37-a146-39313c23dcfa-kube-api-access-6qvp6\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:06.349708 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:06.349664 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0344517d-8408-4c37-a146-39313c23dcfa-bundle\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:07.056399 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:07.056370 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" Jul 24 22:54:07.056399 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:07.056385 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd" event={"ID":"0344517d-8408-4c37-a146-39313c23dcfa","Type":"ContainerDied","Data":"ecfe5aec5d2c9d4bf817cea0bff1ee8a4cc1f404ca8cf06fe4221263747cab71"} Jul 24 22:54:07.056829 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:07.056418 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecfe5aec5d2c9d4bf817cea0bff1ee8a4cc1f404ca8cf06fe4221263747cab71" Jul 24 22:54:17.104724 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.104686 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lslps"] Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105069 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="pull" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105081 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="pull" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105088 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105094 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105101 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="pull" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105106 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="pull" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105121 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105132 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105140 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105144 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105149 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105154 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105159 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="pull" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105165 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="pull" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105173 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105178 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105184 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105188 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105194 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105210 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="util" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105217 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="extract" Jul 24 22:54:17.105214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105222 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="extract" Jul 24 22:54:17.106189 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105242 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="pull" Jul 24 22:54:17.106189 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105247 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="pull" Jul 24 22:54:17.106189 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105299 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0344517d-8408-4c37-a146-39313c23dcfa" containerName="extract" Jul 24 22:54:17.106189 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105305 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d04ac6-8a60-40d9-b912-94656277c488" containerName="extract" Jul 24 22:54:17.106189 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105314 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="28220053-6ac3-4a3e-8343-5e08f64bacfb" containerName="extract" Jul 24 22:54:17.106189 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.105320 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffdd0e62-2668-4a89-ad4f-0f4715c87417" containerName="extract" Jul 24 22:54:17.109285 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.109269 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:17.112214 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.112192 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5jxcj\"" Jul 24 22:54:17.118377 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.118351 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lslps"] Jul 24 22:54:17.235497 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.235463 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvj5f\" (UniqueName: \"kubernetes.io/projected/233ef833-97fa-4a9c-9659-81ccf5bdfe80-kube-api-access-hvj5f\") pod \"authorino-operator-75cc8d5cb7-lslps\" (UID: \"233ef833-97fa-4a9c-9659-81ccf5bdfe80\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:17.336123 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.336084 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvj5f\" (UniqueName: \"kubernetes.io/projected/233ef833-97fa-4a9c-9659-81ccf5bdfe80-kube-api-access-hvj5f\") pod \"authorino-operator-75cc8d5cb7-lslps\" (UID: \"233ef833-97fa-4a9c-9659-81ccf5bdfe80\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:17.358569 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.358503 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvj5f\" (UniqueName: \"kubernetes.io/projected/233ef833-97fa-4a9c-9659-81ccf5bdfe80-kube-api-access-hvj5f\") pod \"authorino-operator-75cc8d5cb7-lslps\" (UID: \"233ef833-97fa-4a9c-9659-81ccf5bdfe80\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:17.419923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.419890 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:17.552621 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:17.552581 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lslps"] Jul 24 22:54:17.557711 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:17.557679 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233ef833_97fa_4a9c_9659_81ccf5bdfe80.slice/crio-d0c38e63992581bab93b006ee4431f4d77fe0490117c81fb15a64261e22f878c WatchSource:0}: Error finding container d0c38e63992581bab93b006ee4431f4d77fe0490117c81fb15a64261e22f878c: Status 404 returned error can't find the container with id d0c38e63992581bab93b006ee4431f4d77fe0490117c81fb15a64261e22f878c Jul 24 22:54:18.110708 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:18.110666 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" event={"ID":"233ef833-97fa-4a9c-9659-81ccf5bdfe80","Type":"ContainerStarted","Data":"d0c38e63992581bab93b006ee4431f4d77fe0490117c81fb15a64261e22f878c"} Jul 24 22:54:20.122005 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:20.121906 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" event={"ID":"233ef833-97fa-4a9c-9659-81ccf5bdfe80","Type":"ContainerStarted","Data":"4aff1cc17d208b74f8285b8c347253a4d2f344e5c55d94ce8a047b340e675b40"} Jul 24 22:54:20.122427 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:20.122033 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:20.168632 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:20.168576 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" podStartSLOduration=0.898695888 podStartE2EDuration="3.168562955s" totalImagesPullingTime="2.269867067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:54:20.163481502 +0000 UTC m=+486.627669927" watchObservedRunningTime="2026-07-24 22:54:20.168562955 +0000 UTC m=+486.632751379" Jul 24 22:54:23.634338 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.634297 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk"] Jul 24 22:54:23.640929 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.640899 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:23.643856 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.643831 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 22:54:23.646333 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.646315 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sjbgx\"" Jul 24 22:54:23.649958 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.649936 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk"] Jul 24 22:54:23.790175 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.790142 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4x5n\" (UniqueName: \"kubernetes.io/projected/59cf1342-5e66-4799-8dae-ba4c89a0dad6-kube-api-access-n4x5n\") pod \"dns-operator-controller-manager-864dd78c4c-d8pvk\" (UID: \"59cf1342-5e66-4799-8dae-ba4c89a0dad6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:23.891211 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.891130 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4x5n\" (UniqueName: \"kubernetes.io/projected/59cf1342-5e66-4799-8dae-ba4c89a0dad6-kube-api-access-n4x5n\") pod \"dns-operator-controller-manager-864dd78c4c-d8pvk\" (UID: \"59cf1342-5e66-4799-8dae-ba4c89a0dad6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:23.902725 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.902690 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4x5n\" (UniqueName: \"kubernetes.io/projected/59cf1342-5e66-4799-8dae-ba4c89a0dad6-kube-api-access-n4x5n\") pod \"dns-operator-controller-manager-864dd78c4c-d8pvk\" (UID: \"59cf1342-5e66-4799-8dae-ba4c89a0dad6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:23.952087 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:23.952060 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:24.085812 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:24.085766 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk"] Jul 24 22:54:24.087852 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:24.087820 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cf1342_5e66_4799_8dae_ba4c89a0dad6.slice/crio-8a403406765457e8054bb30ba9f0c7a60f60dbf9aa6745ed4b63a76f39f9f813 WatchSource:0}: Error finding container 8a403406765457e8054bb30ba9f0c7a60f60dbf9aa6745ed4b63a76f39f9f813: Status 404 returned error can't find the container with id 8a403406765457e8054bb30ba9f0c7a60f60dbf9aa6745ed4b63a76f39f9f813 Jul 24 22:54:24.141859 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:24.141779 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" event={"ID":"59cf1342-5e66-4799-8dae-ba4c89a0dad6","Type":"ContainerStarted","Data":"8a403406765457e8054bb30ba9f0c7a60f60dbf9aa6745ed4b63a76f39f9f813"} Jul 24 22:54:27.158653 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:27.158607 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" event={"ID":"59cf1342-5e66-4799-8dae-ba4c89a0dad6","Type":"ContainerStarted","Data":"d872468e53c937c1a662b62fb19255b88b474ba4990ab258a6f4c00b255e594a"} Jul 24 22:54:27.159111 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:27.158760 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:27.181422 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:27.181375 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" podStartSLOduration=1.915632499 podStartE2EDuration="4.181361772s" totalImagesPullingTime="2.265729273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:54:27.179518643 +0000 UTC m=+493.643707095" watchObservedRunningTime="2026-07-24 22:54:27.181361772 +0000 UTC m=+493.645550197" Jul 24 22:54:28.663054 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.663021 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f"] Jul 24 22:54:28.666461 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.666443 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.669133 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.669110 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l9czn\"" Jul 24 22:54:28.681715 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.681675 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f"] Jul 24 22:54:28.735155 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.735122 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6mxd\" (UniqueName: \"kubernetes.io/projected/df92785c-6c21-4679-8a18-df33fe9793d0-kube-api-access-k6mxd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.735299 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.735193 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df92785c-6c21-4679-8a18-df33fe9793d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.836106 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.836072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df92785c-6c21-4679-8a18-df33fe9793d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.836282 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.836128 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6mxd\" (UniqueName: \"kubernetes.io/projected/df92785c-6c21-4679-8a18-df33fe9793d0-kube-api-access-k6mxd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.836506 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.836487 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df92785c-6c21-4679-8a18-df33fe9793d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.844552 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.844530 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6mxd\" (UniqueName: \"kubernetes.io/projected/df92785c-6c21-4679-8a18-df33fe9793d0-kube-api-access-k6mxd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:28.977430 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:28.977346 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:29.107229 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:29.107198 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f"] Jul 24 22:54:29.108493 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:29.108471 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf92785c_6c21_4679_8a18_df33fe9793d0.slice/crio-2a0ece3803b2e946f546d6682b428eefce198fe77ab386a25d7d208e8bf7bdc6 WatchSource:0}: Error finding container 2a0ece3803b2e946f546d6682b428eefce198fe77ab386a25d7d208e8bf7bdc6: Status 404 returned error can't find the container with id 2a0ece3803b2e946f546d6682b428eefce198fe77ab386a25d7d208e8bf7bdc6 Jul 24 22:54:29.169567 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:29.169538 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" event={"ID":"df92785c-6c21-4679-8a18-df33fe9793d0","Type":"ContainerStarted","Data":"2a0ece3803b2e946f546d6682b428eefce198fe77ab386a25d7d208e8bf7bdc6"} Jul 24 22:54:31.129893 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:31.129856 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lslps" Jul 24 22:54:34.197989 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:34.197949 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" event={"ID":"df92785c-6c21-4679-8a18-df33fe9793d0","Type":"ContainerStarted","Data":"f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a"} Jul 24 22:54:34.198414 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:34.198097 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:34.219252 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:34.219185 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" podStartSLOduration=1.321367167 podStartE2EDuration="6.219169032s" totalImagesPullingTime="4.897801865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:54:34.217303957 +0000 UTC m=+500.681492383" watchObservedRunningTime="2026-07-24 22:54:34.219169032 +0000 UTC m=+500.683357458" Jul 24 22:54:38.165713 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:38.165684 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8pvk" Jul 24 22:54:45.205443 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:45.205410 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:46.969477 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:46.969440 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f"] Jul 24 22:54:46.969897 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:46.969633 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" containerName="manager" containerID="cri-o://f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a" gracePeriod=2 Jul 24 22:54:46.977308 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:46.977279 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f"] Jul 24 22:54:47.006519 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.006488 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5"] Jul 24 22:54:47.006994 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.006967 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" containerName="manager" Jul 24 22:54:47.006994 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.006993 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" containerName="manager" Jul 24 22:54:47.007161 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.007123 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" containerName="manager" Jul 24 22:54:47.010270 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.010246 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.029209 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.029181 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5"] Jul 24 22:54:47.044490 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:54:47.044450 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" is forbidden: User \"system:node:ip-10-0-132-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-39.ec2.internal' and this object" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:47.092567 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.092537 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-47cp5\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.092704 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.092639 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kqft\" (UniqueName: \"kubernetes.io/projected/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-kube-api-access-2kqft\") pod \"kuadrant-operator-controller-manager-8684c9ff49-47cp5\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.193298 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.193259 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-47cp5\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.193432 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.193416 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kqft\" (UniqueName: \"kubernetes.io/projected/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-kube-api-access-2kqft\") pod \"kuadrant-operator-controller-manager-8684c9ff49-47cp5\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.193690 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.193669 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-47cp5\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.201927 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.201905 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kqft\" (UniqueName: \"kubernetes.io/projected/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-kube-api-access-2kqft\") pod \"kuadrant-operator-controller-manager-8684c9ff49-47cp5\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.218406 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.218387 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:47.220615 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:54:47.220572 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" is forbidden: User \"system:node:ip-10-0-132-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-39.ec2.internal' and this object" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:47.269852 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.269823 2585 generic.go:356] "Generic (PLEG): container finished" podID="df92785c-6c21-4679-8a18-df33fe9793d0" containerID="f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a" exitCode=0 Jul 24 22:54:47.269970 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.269871 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:47.269970 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.269930 2585 scope.go:117] "RemoveContainer" containerID="f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a" Jul 24 22:54:47.272122 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:54:47.272101 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" is forbidden: User \"system:node:ip-10-0-132-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-39.ec2.internal' and this object" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:47.278519 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.278504 2585 scope.go:117] "RemoveContainer" containerID="f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a" Jul 24 22:54:47.278764 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:54:47.278747 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a\": container with ID starting with f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a not found: ID does not exist" containerID="f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a" Jul 24 22:54:47.278848 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.278772 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a"} err="failed to get container status \"f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a\": rpc error: code = NotFound desc = could not find container \"f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a\": container with ID starting with f535d53794e66b142fb2b7f2d54a94cfb1193b3e73fdcc197dc475c53e324c8a not found: ID does not exist" Jul 24 22:54:47.294050 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.294028 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6mxd\" (UniqueName: \"kubernetes.io/projected/df92785c-6c21-4679-8a18-df33fe9793d0-kube-api-access-k6mxd\") pod \"df92785c-6c21-4679-8a18-df33fe9793d0\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " Jul 24 22:54:47.294154 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.294071 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df92785c-6c21-4679-8a18-df33fe9793d0-extensions-socket-volume\") pod \"df92785c-6c21-4679-8a18-df33fe9793d0\" (UID: \"df92785c-6c21-4679-8a18-df33fe9793d0\") " Jul 24 22:54:47.294560 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.294537 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df92785c-6c21-4679-8a18-df33fe9793d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "df92785c-6c21-4679-8a18-df33fe9793d0" (UID: "df92785c-6c21-4679-8a18-df33fe9793d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:54:47.296108 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.296089 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df92785c-6c21-4679-8a18-df33fe9793d0-kube-api-access-k6mxd" (OuterVolumeSpecName: "kube-api-access-k6mxd") pod "df92785c-6c21-4679-8a18-df33fe9793d0" (UID: "df92785c-6c21-4679-8a18-df33fe9793d0"). InnerVolumeSpecName "kube-api-access-k6mxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:54:47.347323 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.347296 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:47.394675 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.394642 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df92785c-6c21-4679-8a18-df33fe9793d0-extensions-socket-volume\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:47.394675 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.394671 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6mxd\" (UniqueName: \"kubernetes.io/projected/df92785c-6c21-4679-8a18-df33fe9793d0-kube-api-access-k6mxd\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:54:47.484365 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:47.484339 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5"] Jul 24 22:54:47.486580 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:54:47.486553 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfc70f2_e2d9_4d3f_b1ac_014502581f0b.slice/crio-a870dcc4f35d2278e150d101ac4baa0e18b7c733bcef5ff9a322fd83de8011d8 WatchSource:0}: Error finding container a870dcc4f35d2278e150d101ac4baa0e18b7c733bcef5ff9a322fd83de8011d8: Status 404 returned error can't find the container with id a870dcc4f35d2278e150d101ac4baa0e18b7c733bcef5ff9a322fd83de8011d8 Jul 24 22:54:47.580761 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:54:47.580729 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tv25f\" is forbidden: User \"system:node:ip-10-0-132-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-39.ec2.internal' and this object" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tv25f" Jul 24 22:54:48.052935 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:48.052903 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df92785c-6c21-4679-8a18-df33fe9793d0" path="/var/lib/kubelet/pods/df92785c-6c21-4679-8a18-df33fe9793d0/volumes" Jul 24 22:54:48.279142 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:48.279105 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" event={"ID":"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b","Type":"ContainerStarted","Data":"8c8e3979ed42e82ecd6a3d4975d82958593057dbaee6e2b8169ed9ebd7dd83c1"} Jul 24 22:54:48.279319 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:48.279154 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" event={"ID":"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b","Type":"ContainerStarted","Data":"a870dcc4f35d2278e150d101ac4baa0e18b7c733bcef5ff9a322fd83de8011d8"} Jul 24 22:54:48.279319 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:48.279192 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:54:48.301302 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:48.301251 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" podStartSLOduration=2.301238134 podStartE2EDuration="2.301238134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:54:48.29835051 +0000 UTC m=+514.762538931" watchObservedRunningTime="2026-07-24 22:54:48.301238134 +0000 UTC m=+514.765426559" Jul 24 22:54:59.286260 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:54:59.286231 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:55:16.224925 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.224882 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5"] Jul 24 22:55:16.225391 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.225171 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" podUID="cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" containerName="manager" containerID="cri-o://8c8e3979ed42e82ecd6a3d4975d82958593057dbaee6e2b8169ed9ebd7dd83c1" gracePeriod=10 Jul 24 22:55:16.424091 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.424060 2585 generic.go:356] "Generic (PLEG): container finished" podID="cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" containerID="8c8e3979ed42e82ecd6a3d4975d82958593057dbaee6e2b8169ed9ebd7dd83c1" exitCode=0 Jul 24 22:55:16.424237 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.424140 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" event={"ID":"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b","Type":"ContainerDied","Data":"8c8e3979ed42e82ecd6a3d4975d82958593057dbaee6e2b8169ed9ebd7dd83c1"} Jul 24 22:55:16.459655 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.459613 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh"] Jul 24 22:55:16.487785 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.486105 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.490576 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.490540 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh"] Jul 24 22:55:16.516364 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.516339 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:55:16.542690 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.542655 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3032bf-5264-4de5-9a26-b0c7445453a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgrhh\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.542876 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.542748 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r2db\" (UniqueName: \"kubernetes.io/projected/de3032bf-5264-4de5-9a26-b0c7445453a6-kube-api-access-7r2db\") pod \"kuadrant-operator-controller-manager-86878c769f-wgrhh\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.643632 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.643593 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kqft\" (UniqueName: \"kubernetes.io/projected/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-kube-api-access-2kqft\") pod \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " Jul 24 22:55:16.643824 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.643701 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-extensions-socket-volume\") pod \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\" (UID: \"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b\") " Jul 24 22:55:16.643872 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.643847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r2db\" (UniqueName: \"kubernetes.io/projected/de3032bf-5264-4de5-9a26-b0c7445453a6-kube-api-access-7r2db\") pod \"kuadrant-operator-controller-manager-86878c769f-wgrhh\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.643916 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.643899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3032bf-5264-4de5-9a26-b0c7445453a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgrhh\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.644161 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.644139 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" (UID: "cbfc70f2-e2d9-4d3f-b1ac-014502581f0b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 22:55:16.644288 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.644269 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3032bf-5264-4de5-9a26-b0c7445453a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgrhh\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.645845 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.645822 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-kube-api-access-2kqft" (OuterVolumeSpecName: "kube-api-access-2kqft") pod "cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" (UID: "cbfc70f2-e2d9-4d3f-b1ac-014502581f0b"). InnerVolumeSpecName "kube-api-access-2kqft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:55:16.668763 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.668730 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r2db\" (UniqueName: \"kubernetes.io/projected/de3032bf-5264-4de5-9a26-b0c7445453a6-kube-api-access-7r2db\") pod \"kuadrant-operator-controller-manager-86878c769f-wgrhh\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.744683 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.744590 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-extensions-socket-volume\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:55:16.744683 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.744622 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kqft\" (UniqueName: \"kubernetes.io/projected/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b-kube-api-access-2kqft\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:55:16.812727 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.812676 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:16.949263 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:16.949204 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh"] Jul 24 22:55:16.951678 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:55:16.951650 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3032bf_5264_4de5_9a26_b0c7445453a6.slice/crio-3913de5b4691119f50a51a5290f3baba48abbd229bd3318451112004daf16bb2 WatchSource:0}: Error finding container 3913de5b4691119f50a51a5290f3baba48abbd229bd3318451112004daf16bb2: Status 404 returned error can't find the container with id 3913de5b4691119f50a51a5290f3baba48abbd229bd3318451112004daf16bb2 Jul 24 22:55:17.431163 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.431072 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" event={"ID":"de3032bf-5264-4de5-9a26-b0c7445453a6","Type":"ContainerStarted","Data":"db7fede93dcce8acb0a61f865b63a763665e0607ba6aa5ef4621e01eafa4f832"} Jul 24 22:55:17.431163 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.431131 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" event={"ID":"de3032bf-5264-4de5-9a26-b0c7445453a6","Type":"ContainerStarted","Data":"3913de5b4691119f50a51a5290f3baba48abbd229bd3318451112004daf16bb2"} Jul 24 22:55:17.431635 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.431270 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:17.432491 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.432475 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" Jul 24 22:55:17.432491 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.432482 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5" event={"ID":"cbfc70f2-e2d9-4d3f-b1ac-014502581f0b","Type":"ContainerDied","Data":"a870dcc4f35d2278e150d101ac4baa0e18b7c733bcef5ff9a322fd83de8011d8"} Jul 24 22:55:17.432671 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.432533 2585 scope.go:117] "RemoveContainer" containerID="8c8e3979ed42e82ecd6a3d4975d82958593057dbaee6e2b8169ed9ebd7dd83c1" Jul 24 22:55:17.452348 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.452306 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" podStartSLOduration=1.452291142 podStartE2EDuration="1.452291142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:55:17.449835314 +0000 UTC m=+543.914023733" watchObservedRunningTime="2026-07-24 22:55:17.452291142 +0000 UTC m=+543.916479567" Jul 24 22:55:17.466915 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.466887 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5"] Jul 24 22:55:17.472491 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:17.472460 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-47cp5"] Jul 24 22:55:18.052186 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:18.052152 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" path="/var/lib/kubelet/pods/cbfc70f2-e2d9-4d3f-b1ac-014502581f0b/volumes" Jul 24 22:55:28.441178 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:28.441148 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 22:55:32.582772 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.582736 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj"] Jul 24 22:55:32.583349 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.583327 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" containerName="manager" Jul 24 22:55:32.583349 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.583348 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" containerName="manager" Jul 24 22:55:32.583502 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.583487 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbfc70f2-e2d9-4d3f-b1ac-014502581f0b" containerName="manager" Jul 24 22:55:32.588198 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.588174 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.590954 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.590931 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4r6c9\"" Jul 24 22:55:32.598855 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.598830 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj"] Jul 24 22:55:32.683837 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.683768 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.683837 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.683837 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.683871 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.683932 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1681406b-0693-40c8-9e6f-464f35530f9f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.683958 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhz8\" (UniqueName: \"kubernetes.io/projected/1681406b-0693-40c8-9e6f-464f35530f9f-kube-api-access-sfhz8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.683996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1681406b-0693-40c8-9e6f-464f35530f9f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.684038 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684084 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.684060 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1681406b-0693-40c8-9e6f-464f35530f9f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.684377 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.684103 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.784825 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.784766 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1681406b-0693-40c8-9e6f-464f35530f9f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.784848 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.784876 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1681406b-0693-40c8-9e6f-464f35530f9f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.784911 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.784963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.784986 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785019 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785014 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785317 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1681406b-0693-40c8-9e6f-464f35530f9f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785317 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhz8\" (UniqueName: \"kubernetes.io/projected/1681406b-0693-40c8-9e6f-464f35530f9f-kube-api-access-sfhz8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785416 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785359 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785416 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785391 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785508 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785448 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785642 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785623 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1681406b-0693-40c8-9e6f-464f35530f9f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.785706 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.785646 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.787296 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.787269 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1681406b-0693-40c8-9e6f-464f35530f9f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.787545 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.787527 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1681406b-0693-40c8-9e6f-464f35530f9f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.792545 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.792523 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1681406b-0693-40c8-9e6f-464f35530f9f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.792769 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.792753 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhz8\" (UniqueName: \"kubernetes.io/projected/1681406b-0693-40c8-9e6f-464f35530f9f-kube-api-access-sfhz8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g6qrj\" (UID: \"1681406b-0693-40c8-9e6f-464f35530f9f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:32.899031 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:32.898941 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:33.039267 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.039212 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj"] Jul 24 22:55:33.040351 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:55:33.040320 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1681406b_0693_40c8_9e6f_464f35530f9f.slice/crio-858c6b74793559c0b2dca7f625e44b022ead27f755d69223ade224e94b9d0efe WatchSource:0}: Error finding container 858c6b74793559c0b2dca7f625e44b022ead27f755d69223ade224e94b9d0efe: Status 404 returned error can't find the container with id 858c6b74793559c0b2dca7f625e44b022ead27f755d69223ade224e94b9d0efe Jul 24 22:55:33.042850 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.042811 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:55:33.042962 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.042881 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:55:33.042962 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.042910 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:55:33.526325 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.526291 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" event={"ID":"1681406b-0693-40c8-9e6f-464f35530f9f","Type":"ContainerStarted","Data":"37424917c788aaa05c1479d8a162be4ee5d9d3ba0cb4b61426d979ed3c1d01ad"} Jul 24 22:55:33.526498 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.526344 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" event={"ID":"1681406b-0693-40c8-9e6f-464f35530f9f","Type":"ContainerStarted","Data":"858c6b74793559c0b2dca7f625e44b022ead27f755d69223ade224e94b9d0efe"} Jul 24 22:55:33.546328 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.546281 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" podStartSLOduration=1.546252872 podStartE2EDuration="1.546252872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:55:33.544685097 +0000 UTC m=+560.008873524" watchObservedRunningTime="2026-07-24 22:55:33.546252872 +0000 UTC m=+560.010441296" Jul 24 22:55:33.899689 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:33.899602 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:34.904852 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:34.904823 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:35.359616 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.359581 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8lfkz"] Jul 24 22:55:35.363118 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.363096 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:35.365763 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.365736 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vkkjl\"" Jul 24 22:55:35.371742 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.371713 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8lfkz"] Jul 24 22:55:35.510536 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.510504 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98frr\" (UniqueName: \"kubernetes.io/projected/9804061c-5bab-40b3-93b0-755c763a6a46-kube-api-access-98frr\") pod \"authorino-58cd955675-8lfkz\" (UID: \"9804061c-5bab-40b3-93b0-755c763a6a46\") " pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:35.536936 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.536904 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:35.538049 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.538022 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:55:35.565469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.565430 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-snwws"] Jul 24 22:55:35.569119 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.569091 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:55:35.574901 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.574871 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-snwws"] Jul 24 22:55:35.611745 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.611665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98frr\" (UniqueName: \"kubernetes.io/projected/9804061c-5bab-40b3-93b0-755c763a6a46-kube-api-access-98frr\") pod \"authorino-58cd955675-8lfkz\" (UID: \"9804061c-5bab-40b3-93b0-755c763a6a46\") " pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:35.618872 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.618847 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98frr\" (UniqueName: \"kubernetes.io/projected/9804061c-5bab-40b3-93b0-755c763a6a46-kube-api-access-98frr\") pod \"authorino-58cd955675-8lfkz\" (UID: \"9804061c-5bab-40b3-93b0-755c763a6a46\") " pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:35.676006 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.675978 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:35.712717 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.712673 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkr8p\" (UniqueName: \"kubernetes.io/projected/9bb626c2-bc49-4555-b906-03f3d9ec7d92-kube-api-access-lkr8p\") pod \"authorino-75d556bd77-snwws\" (UID: \"9bb626c2-bc49-4555-b906-03f3d9ec7d92\") " pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:55:35.812272 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.812237 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8lfkz"] Jul 24 22:55:35.813862 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.813840 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkr8p\" (UniqueName: \"kubernetes.io/projected/9bb626c2-bc49-4555-b906-03f3d9ec7d92-kube-api-access-lkr8p\") pod \"authorino-75d556bd77-snwws\" (UID: \"9bb626c2-bc49-4555-b906-03f3d9ec7d92\") " pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:55:35.815235 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:55:35.815212 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9804061c_5bab_40b3_93b0_755c763a6a46.slice/crio-9f97c669bfd181a8c1057cf07b0a4f29210e19e4f0ae31e6dac4bd9c8c7bf23e WatchSource:0}: Error finding container 9f97c669bfd181a8c1057cf07b0a4f29210e19e4f0ae31e6dac4bd9c8c7bf23e: Status 404 returned error can't find the container with id 9f97c669bfd181a8c1057cf07b0a4f29210e19e4f0ae31e6dac4bd9c8c7bf23e Jul 24 22:55:35.821654 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.821631 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkr8p\" (UniqueName: \"kubernetes.io/projected/9bb626c2-bc49-4555-b906-03f3d9ec7d92-kube-api-access-lkr8p\") pod \"authorino-75d556bd77-snwws\" (UID: \"9bb626c2-bc49-4555-b906-03f3d9ec7d92\") " pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:55:35.881888 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:35.881810 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:55:36.020175 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:36.020150 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-snwws"] Jul 24 22:55:36.022002 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:55:36.021967 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bb626c2_bc49_4555_b906_03f3d9ec7d92.slice/crio-f0c681c185cc3f1234d51a01917022924c258aab7498c4e0918cee181b42b806 WatchSource:0}: Error finding container f0c681c185cc3f1234d51a01917022924c258aab7498c4e0918cee181b42b806: Status 404 returned error can't find the container with id f0c681c185cc3f1234d51a01917022924c258aab7498c4e0918cee181b42b806 Jul 24 22:55:36.542966 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:36.542919 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-snwws" event={"ID":"9bb626c2-bc49-4555-b906-03f3d9ec7d92","Type":"ContainerStarted","Data":"f0c681c185cc3f1234d51a01917022924c258aab7498c4e0918cee181b42b806"} Jul 24 22:55:36.544055 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:36.544019 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8lfkz" event={"ID":"9804061c-5bab-40b3-93b0-755c763a6a46","Type":"ContainerStarted","Data":"9f97c669bfd181a8c1057cf07b0a4f29210e19e4f0ae31e6dac4bd9c8c7bf23e"} Jul 24 22:55:39.564679 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:39.564635 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8lfkz" event={"ID":"9804061c-5bab-40b3-93b0-755c763a6a46","Type":"ContainerStarted","Data":"8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd"} Jul 24 22:55:39.566632 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:39.566598 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-snwws" event={"ID":"9bb626c2-bc49-4555-b906-03f3d9ec7d92","Type":"ContainerStarted","Data":"349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad"} Jul 24 22:55:39.581323 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:39.581262 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8lfkz" podStartSLOduration=0.949908665 podStartE2EDuration="4.581240275s" totalImagesPullingTime="3.63133161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:55:39.579269469 +0000 UTC m=+566.043457920" watchObservedRunningTime="2026-07-24 22:55:39.581240275 +0000 UTC m=+566.045428701" Jul 24 22:55:39.597377 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:39.597319 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-snwws" podStartSLOduration=1.16080055 podStartE2EDuration="4.597297826s" totalImagesPullingTime="3.436497276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:55:39.593902159 +0000 UTC m=+566.058090611" watchObservedRunningTime="2026-07-24 22:55:39.597297826 +0000 UTC m=+566.061486251" Jul 24 22:55:39.621092 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:39.621056 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8lfkz"] Jul 24 22:55:41.576954 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:41.576907 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8lfkz" podUID="9804061c-5bab-40b3-93b0-755c763a6a46" containerName="authorino" containerID="cri-o://8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd" gracePeriod=30 Jul 24 22:55:41.824423 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:41.824396 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:41.868725 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:41.868653 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98frr\" (UniqueName: \"kubernetes.io/projected/9804061c-5bab-40b3-93b0-755c763a6a46-kube-api-access-98frr\") pod \"9804061c-5bab-40b3-93b0-755c763a6a46\" (UID: \"9804061c-5bab-40b3-93b0-755c763a6a46\") " Jul 24 22:55:41.870646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:41.870618 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9804061c-5bab-40b3-93b0-755c763a6a46-kube-api-access-98frr" (OuterVolumeSpecName: "kube-api-access-98frr") pod "9804061c-5bab-40b3-93b0-755c763a6a46" (UID: "9804061c-5bab-40b3-93b0-755c763a6a46"). InnerVolumeSpecName "kube-api-access-98frr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:55:41.969967 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:41.969931 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98frr\" (UniqueName: \"kubernetes.io/projected/9804061c-5bab-40b3-93b0-755c763a6a46-kube-api-access-98frr\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:55:42.583355 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.583320 2585 generic.go:356] "Generic (PLEG): container finished" podID="9804061c-5bab-40b3-93b0-755c763a6a46" containerID="8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd" exitCode=0 Jul 24 22:55:42.583751 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.583361 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8lfkz" Jul 24 22:55:42.583751 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.583407 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8lfkz" event={"ID":"9804061c-5bab-40b3-93b0-755c763a6a46","Type":"ContainerDied","Data":"8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd"} Jul 24 22:55:42.583751 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.583453 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8lfkz" event={"ID":"9804061c-5bab-40b3-93b0-755c763a6a46","Type":"ContainerDied","Data":"9f97c669bfd181a8c1057cf07b0a4f29210e19e4f0ae31e6dac4bd9c8c7bf23e"} Jul 24 22:55:42.583751 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.583474 2585 scope.go:117] "RemoveContainer" containerID="8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd" Jul 24 22:55:42.593025 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.593004 2585 scope.go:117] "RemoveContainer" containerID="8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd" Jul 24 22:55:42.593316 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:55:42.593296 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd\": container with ID starting with 8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd not found: ID does not exist" containerID="8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd" Jul 24 22:55:42.593361 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.593326 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd"} err="failed to get container status \"8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd\": rpc error: code = NotFound desc = could not find container \"8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd\": container with ID starting with 8691c5fe8d6bba4e0244bb3f30f5557f51b3ccbb12408f9adfa32a756d7013bd not found: ID does not exist" Jul 24 22:55:42.616327 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.616295 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8lfkz"] Jul 24 22:55:42.621289 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:42.621264 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8lfkz"] Jul 24 22:55:44.052767 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:55:44.052726 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9804061c-5bab-40b3-93b0-755c763a6a46" path="/var/lib/kubelet/pods/9804061c-5bab-40b3-93b0-755c763a6a46/volumes" Jul 24 22:56:02.995931 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:02.995893 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6pj64"] Jul 24 22:56:02.996308 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:02.996273 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9804061c-5bab-40b3-93b0-755c763a6a46" containerName="authorino" Jul 24 22:56:02.996308 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:02.996289 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9804061c-5bab-40b3-93b0-755c763a6a46" containerName="authorino" Jul 24 22:56:02.996449 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:02.996365 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9804061c-5bab-40b3-93b0-755c763a6a46" containerName="authorino" Jul 24 22:56:03.000721 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.000695 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:03.005545 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.005521 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6pj64"] Jul 24 22:56:03.063194 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.063158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7rb\" (UniqueName: \"kubernetes.io/projected/f14e34bc-e2a2-4165-8584-b1353bda1ccc-kube-api-access-bq7rb\") pod \"authorino-5d4b67c446-6pj64\" (UID: \"f14e34bc-e2a2-4165-8584-b1353bda1ccc\") " pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:03.164400 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.164355 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7rb\" (UniqueName: \"kubernetes.io/projected/f14e34bc-e2a2-4165-8584-b1353bda1ccc-kube-api-access-bq7rb\") pod \"authorino-5d4b67c446-6pj64\" (UID: \"f14e34bc-e2a2-4165-8584-b1353bda1ccc\") " pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:03.172637 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.172608 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7rb\" (UniqueName: \"kubernetes.io/projected/f14e34bc-e2a2-4165-8584-b1353bda1ccc-kube-api-access-bq7rb\") pod \"authorino-5d4b67c446-6pj64\" (UID: \"f14e34bc-e2a2-4165-8584-b1353bda1ccc\") " pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:03.213824 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.213780 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6pj64"] Jul 24 22:56:03.214057 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.214044 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:03.236896 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.236868 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66ff674bcd-4462q"] Jul 24 22:56:03.240495 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.240473 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:03.249187 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.249162 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66ff674bcd-4462q"] Jul 24 22:56:03.269488 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.269455 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66ff674bcd-4462q"] Jul 24 22:56:03.269785 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:56:03.269756 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gb2gs], unattached volumes=[], failed to process volumes=[kube-api-access-gb2gs]: context canceled" pod="kuadrant-system/authorino-66ff674bcd-4462q" podUID="0cf99a5e-6798-467a-ab6d-a62e90cb721c" Jul 24 22:56:03.298176 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.298143 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f59fcc886-zh8zr"] Jul 24 22:56:03.301612 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.301590 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.304659 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.304615 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 24 22:56:03.308294 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.308261 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f59fcc886-zh8zr"] Jul 24 22:56:03.360984 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.360958 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6pj64"] Jul 24 22:56:03.362597 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:56:03.362574 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf14e34bc_e2a2_4165_8584_b1353bda1ccc.slice/crio-d38a6102eb344233d9fe96f1b9834d294bc3a251bed5acff11679abad01b8569 WatchSource:0}: Error finding container d38a6102eb344233d9fe96f1b9834d294bc3a251bed5acff11679abad01b8569: Status 404 returned error can't find the container with id d38a6102eb344233d9fe96f1b9834d294bc3a251bed5acff11679abad01b8569 Jul 24 22:56:03.365753 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.365724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzswh\" (UniqueName: \"kubernetes.io/projected/2cd3db1a-d082-4b68-b067-6b2f0590372d-kube-api-access-qzswh\") pod \"authorino-6f59fcc886-zh8zr\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.365871 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.365763 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2gs\" (UniqueName: \"kubernetes.io/projected/0cf99a5e-6798-467a-ab6d-a62e90cb721c-kube-api-access-gb2gs\") pod \"authorino-66ff674bcd-4462q\" (UID: \"0cf99a5e-6798-467a-ab6d-a62e90cb721c\") " pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:03.365871 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.365856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cd3db1a-d082-4b68-b067-6b2f0590372d-tls-cert\") pod \"authorino-6f59fcc886-zh8zr\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.467010 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.466972 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzswh\" (UniqueName: \"kubernetes.io/projected/2cd3db1a-d082-4b68-b067-6b2f0590372d-kube-api-access-qzswh\") pod \"authorino-6f59fcc886-zh8zr\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.467212 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.467021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2gs\" (UniqueName: \"kubernetes.io/projected/0cf99a5e-6798-467a-ab6d-a62e90cb721c-kube-api-access-gb2gs\") pod \"authorino-66ff674bcd-4462q\" (UID: \"0cf99a5e-6798-467a-ab6d-a62e90cb721c\") " pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:03.467212 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.467084 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cd3db1a-d082-4b68-b067-6b2f0590372d-tls-cert\") pod \"authorino-6f59fcc886-zh8zr\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.469605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.469576 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cd3db1a-d082-4b68-b067-6b2f0590372d-tls-cert\") pod \"authorino-6f59fcc886-zh8zr\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.474966 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.474939 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2gs\" (UniqueName: \"kubernetes.io/projected/0cf99a5e-6798-467a-ab6d-a62e90cb721c-kube-api-access-gb2gs\") pod \"authorino-66ff674bcd-4462q\" (UID: \"0cf99a5e-6798-467a-ab6d-a62e90cb721c\") " pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:03.475058 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.474975 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzswh\" (UniqueName: \"kubernetes.io/projected/2cd3db1a-d082-4b68-b067-6b2f0590372d-kube-api-access-qzswh\") pod \"authorino-6f59fcc886-zh8zr\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.613013 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.612917 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:56:03.703519 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.703491 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:03.703923 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.703897 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6pj64" event={"ID":"f14e34bc-e2a2-4165-8584-b1353bda1ccc","Type":"ContainerStarted","Data":"d38a6102eb344233d9fe96f1b9834d294bc3a251bed5acff11679abad01b8569"} Jul 24 22:56:03.734526 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.734498 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:03.750393 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.750369 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f59fcc886-zh8zr"] Jul 24 22:56:03.751696 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:56:03.751673 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cd3db1a_d082_4b68_b067_6b2f0590372d.slice/crio-cfbcfc18dd1d5cf5cbff39ce06389b7bfc9964ff2d00ec884c9403e3a0ccd7d1 WatchSource:0}: Error finding container cfbcfc18dd1d5cf5cbff39ce06389b7bfc9964ff2d00ec884c9403e3a0ccd7d1: Status 404 returned error can't find the container with id cfbcfc18dd1d5cf5cbff39ce06389b7bfc9964ff2d00ec884c9403e3a0ccd7d1 Jul 24 22:56:03.869763 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.869663 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb2gs\" (UniqueName: \"kubernetes.io/projected/0cf99a5e-6798-467a-ab6d-a62e90cb721c-kube-api-access-gb2gs\") pod \"0cf99a5e-6798-467a-ab6d-a62e90cb721c\" (UID: \"0cf99a5e-6798-467a-ab6d-a62e90cb721c\") " Jul 24 22:56:03.871830 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.871785 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf99a5e-6798-467a-ab6d-a62e90cb721c-kube-api-access-gb2gs" (OuterVolumeSpecName: "kube-api-access-gb2gs") pod "0cf99a5e-6798-467a-ab6d-a62e90cb721c" (UID: "0cf99a5e-6798-467a-ab6d-a62e90cb721c"). InnerVolumeSpecName "kube-api-access-gb2gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:56:03.971141 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:03.971097 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb2gs\" (UniqueName: \"kubernetes.io/projected/0cf99a5e-6798-467a-ab6d-a62e90cb721c-kube-api-access-gb2gs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:56:04.710036 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.709999 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6pj64" event={"ID":"f14e34bc-e2a2-4165-8584-b1353bda1ccc","Type":"ContainerStarted","Data":"a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29"} Jul 24 22:56:04.710486 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.710066 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6pj64" podUID="f14e34bc-e2a2-4165-8584-b1353bda1ccc" containerName="authorino" containerID="cri-o://a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29" gracePeriod=30 Jul 24 22:56:04.711626 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.711598 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" event={"ID":"2cd3db1a-d082-4b68-b067-6b2f0590372d","Type":"ContainerStarted","Data":"7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08"} Jul 24 22:56:04.711767 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.711632 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" event={"ID":"2cd3db1a-d082-4b68-b067-6b2f0590372d","Type":"ContainerStarted","Data":"cfbcfc18dd1d5cf5cbff39ce06389b7bfc9964ff2d00ec884c9403e3a0ccd7d1"} Jul 24 22:56:04.711767 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.711678 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66ff674bcd-4462q" Jul 24 22:56:04.725590 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.725549 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6pj64" podStartSLOduration=2.40666606 podStartE2EDuration="2.72553502s" totalImagesPullingTime="318.86896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:56:04.723174037 +0000 UTC m=+591.187362461" watchObservedRunningTime="2026-07-24 22:56:04.72553502 +0000 UTC m=+591.189723445" Jul 24 22:56:04.745367 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.745338 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66ff674bcd-4462q"] Jul 24 22:56:04.750443 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.750414 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66ff674bcd-4462q"] Jul 24 22:56:04.761031 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.760984 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" podStartSLOduration=1.3534236179999999 podStartE2EDuration="1.760969458s" totalImagesPullingTime="407.54584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:56:04.760186055 +0000 UTC m=+591.224374473" watchObservedRunningTime="2026-07-24 22:56:04.760969458 +0000 UTC m=+591.225157883" Jul 24 22:56:04.801928 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.801889 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-snwws"] Jul 24 22:56:04.802131 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:04.802107 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-snwws" podUID="9bb626c2-bc49-4555-b906-03f3d9ec7d92" containerName="authorino" containerID="cri-o://349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad" gracePeriod=30 Jul 24 22:56:05.067206 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.067180 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:05.070059 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.070041 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:56:05.184053 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.184029 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkr8p\" (UniqueName: \"kubernetes.io/projected/9bb626c2-bc49-4555-b906-03f3d9ec7d92-kube-api-access-lkr8p\") pod \"9bb626c2-bc49-4555-b906-03f3d9ec7d92\" (UID: \"9bb626c2-bc49-4555-b906-03f3d9ec7d92\") " Jul 24 22:56:05.184191 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.184084 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq7rb\" (UniqueName: \"kubernetes.io/projected/f14e34bc-e2a2-4165-8584-b1353bda1ccc-kube-api-access-bq7rb\") pod \"f14e34bc-e2a2-4165-8584-b1353bda1ccc\" (UID: \"f14e34bc-e2a2-4165-8584-b1353bda1ccc\") " Jul 24 22:56:05.186250 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.186216 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14e34bc-e2a2-4165-8584-b1353bda1ccc-kube-api-access-bq7rb" (OuterVolumeSpecName: "kube-api-access-bq7rb") pod "f14e34bc-e2a2-4165-8584-b1353bda1ccc" (UID: "f14e34bc-e2a2-4165-8584-b1353bda1ccc"). InnerVolumeSpecName "kube-api-access-bq7rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:56:05.186363 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.186327 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb626c2-bc49-4555-b906-03f3d9ec7d92-kube-api-access-lkr8p" (OuterVolumeSpecName: "kube-api-access-lkr8p") pod "9bb626c2-bc49-4555-b906-03f3d9ec7d92" (UID: "9bb626c2-bc49-4555-b906-03f3d9ec7d92"). InnerVolumeSpecName "kube-api-access-lkr8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:56:05.285297 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.285260 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkr8p\" (UniqueName: \"kubernetes.io/projected/9bb626c2-bc49-4555-b906-03f3d9ec7d92-kube-api-access-lkr8p\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:56:05.285297 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.285289 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq7rb\" (UniqueName: \"kubernetes.io/projected/f14e34bc-e2a2-4165-8584-b1353bda1ccc-kube-api-access-bq7rb\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:56:05.717770 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.717681 2585 generic.go:356] "Generic (PLEG): container finished" podID="f14e34bc-e2a2-4165-8584-b1353bda1ccc" containerID="a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29" exitCode=0 Jul 24 22:56:05.717770 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.717727 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6pj64" Jul 24 22:56:05.718284 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.717761 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6pj64" event={"ID":"f14e34bc-e2a2-4165-8584-b1353bda1ccc","Type":"ContainerDied","Data":"a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29"} Jul 24 22:56:05.718284 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.717838 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6pj64" event={"ID":"f14e34bc-e2a2-4165-8584-b1353bda1ccc","Type":"ContainerDied","Data":"d38a6102eb344233d9fe96f1b9834d294bc3a251bed5acff11679abad01b8569"} Jul 24 22:56:05.718284 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.717863 2585 scope.go:117] "RemoveContainer" containerID="a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29" Jul 24 22:56:05.719222 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.719154 2585 generic.go:356] "Generic (PLEG): container finished" podID="9bb626c2-bc49-4555-b906-03f3d9ec7d92" containerID="349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad" exitCode=0 Jul 24 22:56:05.719222 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.719199 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-snwws" Jul 24 22:56:05.719350 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.719274 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-snwws" event={"ID":"9bb626c2-bc49-4555-b906-03f3d9ec7d92","Type":"ContainerDied","Data":"349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad"} Jul 24 22:56:05.719350 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.719299 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-snwws" event={"ID":"9bb626c2-bc49-4555-b906-03f3d9ec7d92","Type":"ContainerDied","Data":"f0c681c185cc3f1234d51a01917022924c258aab7498c4e0918cee181b42b806"} Jul 24 22:56:05.727305 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.727282 2585 scope.go:117] "RemoveContainer" containerID="a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29" Jul 24 22:56:05.727585 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:56:05.727559 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29\": container with ID starting with a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29 not found: ID does not exist" containerID="a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29" Jul 24 22:56:05.727680 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.727597 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29"} err="failed to get container status \"a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29\": rpc error: code = NotFound desc = could not find container \"a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29\": container with ID starting with a05b8fec7c3c59cc0fca83272c9132cc2f752ddfc8051a6baa993ab4ea433f29 not found: ID does not exist" Jul 24 22:56:05.727680 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.727620 2585 scope.go:117] "RemoveContainer" containerID="349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad" Jul 24 22:56:05.735850 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.735790 2585 scope.go:117] "RemoveContainer" containerID="349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad" Jul 24 22:56:05.736128 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:56:05.736110 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad\": container with ID starting with 349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad not found: ID does not exist" containerID="349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad" Jul 24 22:56:05.736174 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.736133 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad"} err="failed to get container status \"349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad\": rpc error: code = NotFound desc = could not find container \"349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad\": container with ID starting with 349aed21e7d5d953c8102867e00b2790ef4fb039306bfa3822e91be1fcb8f4ad not found: ID does not exist" Jul 24 22:56:05.742438 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.742410 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-snwws"] Jul 24 22:56:05.745424 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.745399 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-snwws"] Jul 24 22:56:05.758009 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.757984 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6pj64"] Jul 24 22:56:05.761475 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:05.761450 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6pj64"] Jul 24 22:56:06.051988 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:06.051948 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf99a5e-6798-467a-ab6d-a62e90cb721c" path="/var/lib/kubelet/pods/0cf99a5e-6798-467a-ab6d-a62e90cb721c/volumes" Jul 24 22:56:06.052297 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:06.052277 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bb626c2-bc49-4555-b906-03f3d9ec7d92" path="/var/lib/kubelet/pods/9bb626c2-bc49-4555-b906-03f3d9ec7d92/volumes" Jul 24 22:56:06.052650 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:06.052632 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14e34bc-e2a2-4165-8584-b1353bda1ccc" path="/var/lib/kubelet/pods/f14e34bc-e2a2-4165-8584-b1353bda1ccc/volumes" Jul 24 22:56:49.961592 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:49.961556 2585 generic.go:356] "Generic (PLEG): container finished" podID="1681406b-0693-40c8-9e6f-464f35530f9f" containerID="37424917c788aaa05c1479d8a162be4ee5d9d3ba0cb4b61426d979ed3c1d01ad" exitCode=0 Jul 24 22:56:49.962070 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:49.961632 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" event={"ID":"1681406b-0693-40c8-9e6f-464f35530f9f","Type":"ContainerDied","Data":"37424917c788aaa05c1479d8a162be4ee5d9d3ba0cb4b61426d979ed3c1d01ad"} Jul 24 22:56:49.962070 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:49.962050 2585 scope.go:117] "RemoveContainer" containerID="37424917c788aaa05c1479d8a162be4ee5d9d3ba0cb4b61426d979ed3c1d01ad" Jul 24 22:56:49.963009 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:49.962981 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:56:49.963088 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:49.963074 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:56:49.963131 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:49.963117 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 22:56:50.537366 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:50.537332 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:56:50.968485 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:50.968398 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" event={"ID":"1681406b-0693-40c8-9e6f-464f35530f9f","Type":"ContainerStarted","Data":"9bffa82ac1864ecf79a4919d8517ea4d64df30b040ea7e23f6d2a7126de6a621"} Jul 24 22:56:51.899220 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:51.899174 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:56:51.900334 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:51.900302 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g6qrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 24 22:56:51.900469 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:51.900393 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" podUID="1681406b-0693-40c8-9e6f-464f35530f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 24 22:56:52.899889 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:52.899846 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g6qrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 24 22:56:52.900292 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:52.899908 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" podUID="1681406b-0693-40c8-9e6f-464f35530f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 24 22:56:53.900439 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:53.900396 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g6qrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 24 22:56:53.900884 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:53.900463 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" podUID="1681406b-0693-40c8-9e6f-464f35530f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 24 22:56:54.903289 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:54.903252 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:56:54.903667 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:54.903539 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:56:54.904318 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:56:54.904296 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g6qrj" Jul 24 22:57:18.649112 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649078 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7"] Jul 24 22:57:18.649605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649424 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14e34bc-e2a2-4165-8584-b1353bda1ccc" containerName="authorino" Jul 24 22:57:18.649605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649435 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14e34bc-e2a2-4165-8584-b1353bda1ccc" containerName="authorino" Jul 24 22:57:18.649605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649451 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb626c2-bc49-4555-b906-03f3d9ec7d92" containerName="authorino" Jul 24 22:57:18.649605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649456 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb626c2-bc49-4555-b906-03f3d9ec7d92" containerName="authorino" Jul 24 22:57:18.649605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649516 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bb626c2-bc49-4555-b906-03f3d9ec7d92" containerName="authorino" Jul 24 22:57:18.649605 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.649524 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14e34bc-e2a2-4165-8584-b1353bda1ccc" containerName="authorino" Jul 24 22:57:18.651721 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.651701 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.654225 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.654203 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 22:57:18.654356 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.654212 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 22:57:18.654356 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.654323 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4rw57\"" Jul 24 22:57:18.654473 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.654381 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 22:57:18.664382 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.664352 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7"] Jul 24 22:57:18.737245 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.737208 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.737245 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.737240 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.737467 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.737260 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdkh7\" (UniqueName: \"kubernetes.io/projected/14487d76-d9ec-4bd7-b021-4655a58bb2f7-kube-api-access-gdkh7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.737467 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.737280 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.737467 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.737295 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14487d76-d9ec-4bd7-b021-4655a58bb2f7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.737467 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.737338 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.838716 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.838677 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.838716 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.838713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839007 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.838733 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdkh7\" (UniqueName: \"kubernetes.io/projected/14487d76-d9ec-4bd7-b021-4655a58bb2f7-kube-api-access-gdkh7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839007 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.838760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839007 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.838782 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14487d76-d9ec-4bd7-b021-4655a58bb2f7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839007 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.838894 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839272 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.839245 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839272 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.839260 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.839369 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.839312 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.841361 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.841330 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14487d76-d9ec-4bd7-b021-4655a58bb2f7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.841466 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.841389 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14487d76-d9ec-4bd7-b021-4655a58bb2f7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.846157 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.846132 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdkh7\" (UniqueName: \"kubernetes.io/projected/14487d76-d9ec-4bd7-b021-4655a58bb2f7-kube-api-access-gdkh7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7\" (UID: \"14487d76-d9ec-4bd7-b021-4655a58bb2f7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:18.963361 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:18.963267 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:19.095912 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:19.095867 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7"] Jul 24 22:57:19.099543 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:57:19.099509 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14487d76_d9ec_4bd7_b021_4655a58bb2f7.slice/crio-c3d215fe0b9fdc745ee62d21960a07945695662e0ff787da42ddf21c3e498054 WatchSource:0}: Error finding container c3d215fe0b9fdc745ee62d21960a07945695662e0ff787da42ddf21c3e498054: Status 404 returned error can't find the container with id c3d215fe0b9fdc745ee62d21960a07945695662e0ff787da42ddf21c3e498054 Jul 24 22:57:19.100882 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:19.100861 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 22:57:19.124543 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:19.124498 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" event={"ID":"14487d76-d9ec-4bd7-b021-4655a58bb2f7","Type":"ContainerStarted","Data":"c3d215fe0b9fdc745ee62d21960a07945695662e0ff787da42ddf21c3e498054"} Jul 24 22:57:21.138574 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:21.138534 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" event={"ID":"14487d76-d9ec-4bd7-b021-4655a58bb2f7","Type":"ContainerStarted","Data":"f0140fc97966fec29b619f2bc22d262312debd639cbf650739ab944743fbc0bc"} Jul 24 22:57:21.157014 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:21.156964 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" podStartSLOduration=2.051507257 podStartE2EDuration="3.156947998s" totalImagesPullingTime="1.105440741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:57:21.154906258 +0000 UTC m=+667.619094684" watchObservedRunningTime="2026-07-24 22:57:21.156947998 +0000 UTC m=+667.621136428" Jul 24 22:57:28.964179 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:28.964131 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:28.964624 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:28.964225 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:28.976919 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:28.976893 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:57:29.192064 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:57:29.192028 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7" Jul 24 22:58:17.251960 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.251866 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk"] Jul 24 22:58:17.255532 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.255505 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.258130 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.258105 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 24 22:58:17.266694 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.266668 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk"] Jul 24 22:58:17.361203 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.361169 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.361373 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.361224 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.361373 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.361270 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.361373 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.361330 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.361373 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.361352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f8g6\" (UniqueName: \"kubernetes.io/projected/edc884c6-1408-4e02-82d9-f4d98193eaa6-kube-api-access-2f8g6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.361529 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.361438 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edc884c6-1408-4e02-82d9-f4d98193eaa6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462498 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462462 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462498 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462499 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462741 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462541 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462741 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462562 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f8g6\" (UniqueName: \"kubernetes.io/projected/edc884c6-1408-4e02-82d9-f4d98193eaa6-kube-api-access-2f8g6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462741 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462585 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edc884c6-1408-4e02-82d9-f4d98193eaa6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462741 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462610 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.462998 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462973 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.463069 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.462986 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.463069 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.463035 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.464740 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.464721 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edc884c6-1408-4e02-82d9-f4d98193eaa6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.465016 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.464999 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edc884c6-1408-4e02-82d9-f4d98193eaa6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.471106 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.471079 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f8g6\" (UniqueName: \"kubernetes.io/projected/edc884c6-1408-4e02-82d9-f4d98193eaa6-kube-api-access-2f8g6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pmxxk\" (UID: \"edc884c6-1408-4e02-82d9-f4d98193eaa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.567018 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.566932 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:17.701505 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:17.701477 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk"] Jul 24 22:58:17.702896 ip-10-0-132-39 kubenswrapper[2585]: W0724 22:58:17.702870 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc884c6_1408_4e02_82d9_f4d98193eaa6.slice/crio-d8fdfd6c6256f40e5443bb36362467528bfcc5d6ee29601658cc3050225bf752 WatchSource:0}: Error finding container d8fdfd6c6256f40e5443bb36362467528bfcc5d6ee29601658cc3050225bf752: Status 404 returned error can't find the container with id d8fdfd6c6256f40e5443bb36362467528bfcc5d6ee29601658cc3050225bf752 Jul 24 22:58:18.437083 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:18.437035 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" event={"ID":"edc884c6-1408-4e02-82d9-f4d98193eaa6","Type":"ContainerStarted","Data":"0482a2ca19653b9769b057de23661248b9aa675d60f2a9fdd2f235c3efb1e8b9"} Jul 24 22:58:18.437476 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:18.437104 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" event={"ID":"edc884c6-1408-4e02-82d9-f4d98193eaa6","Type":"ContainerStarted","Data":"d8fdfd6c6256f40e5443bb36362467528bfcc5d6ee29601658cc3050225bf752"} Jul 24 22:58:18.456036 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:18.455979 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" podStartSLOduration=1.297449979 podStartE2EDuration="1.455964219s" totalImagesPullingTime="158.51424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:58:18.45388314 +0000 UTC m=+724.918071578" watchObservedRunningTime="2026-07-24 22:58:18.455964219 +0000 UTC m=+724.920152644" Jul 24 22:58:27.567091 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:27.567046 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:27.567517 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:27.567123 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:27.579646 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:27.579616 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:58:28.501726 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:58:28.501695 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pmxxk" Jul 24 22:59:35.277507 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.277461 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b8dcb474c-gpdb8"] Jul 24 22:59:35.281203 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.281182 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.288658 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.288624 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8dcb474c-gpdb8"] Jul 24 22:59:35.464182 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.464140 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/571fc4e6-a616-450e-97fc-723fd8736708-tls-cert\") pod \"authorino-7b8dcb474c-gpdb8\" (UID: \"571fc4e6-a616-450e-97fc-723fd8736708\") " pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.464347 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.464262 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55vg\" (UniqueName: \"kubernetes.io/projected/571fc4e6-a616-450e-97fc-723fd8736708-kube-api-access-b55vg\") pod \"authorino-7b8dcb474c-gpdb8\" (UID: \"571fc4e6-a616-450e-97fc-723fd8736708\") " pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.565556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.565452 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/571fc4e6-a616-450e-97fc-723fd8736708-tls-cert\") pod \"authorino-7b8dcb474c-gpdb8\" (UID: \"571fc4e6-a616-450e-97fc-723fd8736708\") " pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.565556 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.565538 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55vg\" (UniqueName: \"kubernetes.io/projected/571fc4e6-a616-450e-97fc-723fd8736708-kube-api-access-b55vg\") pod \"authorino-7b8dcb474c-gpdb8\" (UID: \"571fc4e6-a616-450e-97fc-723fd8736708\") " pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.568085 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.568057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/571fc4e6-a616-450e-97fc-723fd8736708-tls-cert\") pod \"authorino-7b8dcb474c-gpdb8\" (UID: \"571fc4e6-a616-450e-97fc-723fd8736708\") " pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.573778 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.573750 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55vg\" (UniqueName: \"kubernetes.io/projected/571fc4e6-a616-450e-97fc-723fd8736708-kube-api-access-b55vg\") pod \"authorino-7b8dcb474c-gpdb8\" (UID: \"571fc4e6-a616-450e-97fc-723fd8736708\") " pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.591844 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.591813 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" Jul 24 22:59:35.733735 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.733700 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8dcb474c-gpdb8"] Jul 24 22:59:35.854009 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:35.853908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" event={"ID":"571fc4e6-a616-450e-97fc-723fd8736708","Type":"ContainerStarted","Data":"6087a75012226d50197a3a899a1d7c23f7ca91f9026a4d9f911bfcc357080655"} Jul 24 22:59:36.862639 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:36.862597 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" event={"ID":"571fc4e6-a616-450e-97fc-723fd8736708","Type":"ContainerStarted","Data":"c73260b6d43b0365608f006904ab150a73436170e7318d07ae394be160aefe1b"} Jul 24 22:59:36.906431 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:36.906352 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b8dcb474c-gpdb8" podStartSLOduration=1.504154805 podStartE2EDuration="1.906329501s" totalImagesPullingTime="402.174696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:59:36.878745566 +0000 UTC m=+803.342933991" watchObservedRunningTime="2026-07-24 22:59:36.906329501 +0000 UTC m=+803.370517926" Jul 24 22:59:36.909223 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:36.909188 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f59fcc886-zh8zr"] Jul 24 22:59:36.909402 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:36.909379 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" podUID="2cd3db1a-d082-4b68-b067-6b2f0590372d" containerName="authorino" containerID="cri-o://7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08" gracePeriod=30 Jul 24 22:59:37.192264 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.192235 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:59:37.381686 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.381645 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzswh\" (UniqueName: \"kubernetes.io/projected/2cd3db1a-d082-4b68-b067-6b2f0590372d-kube-api-access-qzswh\") pod \"2cd3db1a-d082-4b68-b067-6b2f0590372d\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " Jul 24 22:59:37.381884 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.381718 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cd3db1a-d082-4b68-b067-6b2f0590372d-tls-cert\") pod \"2cd3db1a-d082-4b68-b067-6b2f0590372d\" (UID: \"2cd3db1a-d082-4b68-b067-6b2f0590372d\") " Jul 24 22:59:37.383969 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.383933 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd3db1a-d082-4b68-b067-6b2f0590372d-kube-api-access-qzswh" (OuterVolumeSpecName: "kube-api-access-qzswh") pod "2cd3db1a-d082-4b68-b067-6b2f0590372d" (UID: "2cd3db1a-d082-4b68-b067-6b2f0590372d"). InnerVolumeSpecName "kube-api-access-qzswh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 22:59:37.393255 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.393226 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd3db1a-d082-4b68-b067-6b2f0590372d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2cd3db1a-d082-4b68-b067-6b2f0590372d" (UID: "2cd3db1a-d082-4b68-b067-6b2f0590372d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 22:59:37.483561 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.483467 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzswh\" (UniqueName: \"kubernetes.io/projected/2cd3db1a-d082-4b68-b067-6b2f0590372d-kube-api-access-qzswh\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:59:37.483561 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.483512 2585 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cd3db1a-d082-4b68-b067-6b2f0590372d-tls-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 22:59:37.870636 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.870605 2585 generic.go:356] "Generic (PLEG): container finished" podID="2cd3db1a-d082-4b68-b067-6b2f0590372d" containerID="7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08" exitCode=0 Jul 24 22:59:37.871099 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.870647 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" Jul 24 22:59:37.871099 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.870694 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" event={"ID":"2cd3db1a-d082-4b68-b067-6b2f0590372d","Type":"ContainerDied","Data":"7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08"} Jul 24 22:59:37.871099 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.870752 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f59fcc886-zh8zr" event={"ID":"2cd3db1a-d082-4b68-b067-6b2f0590372d","Type":"ContainerDied","Data":"cfbcfc18dd1d5cf5cbff39ce06389b7bfc9964ff2d00ec884c9403e3a0ccd7d1"} Jul 24 22:59:37.871099 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.870777 2585 scope.go:117] "RemoveContainer" containerID="7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08" Jul 24 22:59:37.882093 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.882076 2585 scope.go:117] "RemoveContainer" containerID="7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08" Jul 24 22:59:37.882413 ip-10-0-132-39 kubenswrapper[2585]: E0724 22:59:37.882392 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08\": container with ID starting with 7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08 not found: ID does not exist" containerID="7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08" Jul 24 22:59:37.882491 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.882425 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08"} err="failed to get container status \"7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08\": rpc error: code = NotFound desc = could not find container \"7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08\": container with ID starting with 7b252bacf6f94ba9429a89948097ed8a7f864bd8a3799f2241f52f94da3cbc08 not found: ID does not exist" Jul 24 22:59:37.896523 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.896479 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f59fcc886-zh8zr"] Jul 24 22:59:37.900284 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:37.900258 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f59fcc886-zh8zr"] Jul 24 22:59:38.053219 ip-10-0-132-39 kubenswrapper[2585]: I0724 22:59:38.053185 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd3db1a-d082-4b68-b067-6b2f0590372d" path="/var/lib/kubelet/pods/2cd3db1a-d082-4b68-b067-6b2f0590372d/volumes" Jul 24 23:06:38.095370 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:38.095339 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh"] Jul 24 23:06:38.095897 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:38.095530 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" podUID="de3032bf-5264-4de5-9a26-b0c7445453a6" containerName="manager" containerID="cri-o://db7fede93dcce8acb0a61f865b63a763665e0607ba6aa5ef4621e01eafa4f832" gracePeriod=10 Jul 24 23:06:40.155554 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.155513 2585 generic.go:356] "Generic (PLEG): container finished" podID="de3032bf-5264-4de5-9a26-b0c7445453a6" containerID="db7fede93dcce8acb0a61f865b63a763665e0607ba6aa5ef4621e01eafa4f832" exitCode=0 Jul 24 23:06:40.155948 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.155567 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" event={"ID":"de3032bf-5264-4de5-9a26-b0c7445453a6","Type":"ContainerDied","Data":"db7fede93dcce8acb0a61f865b63a763665e0607ba6aa5ef4621e01eafa4f832"} Jul 24 23:06:40.255420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.255365 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 23:06:40.307522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.307494 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3032bf-5264-4de5-9a26-b0c7445453a6-extensions-socket-volume\") pod \"de3032bf-5264-4de5-9a26-b0c7445453a6\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " Jul 24 23:06:40.307522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.307527 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r2db\" (UniqueName: \"kubernetes.io/projected/de3032bf-5264-4de5-9a26-b0c7445453a6-kube-api-access-7r2db\") pod \"de3032bf-5264-4de5-9a26-b0c7445453a6\" (UID: \"de3032bf-5264-4de5-9a26-b0c7445453a6\") " Jul 24 23:06:40.307877 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.307855 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3032bf-5264-4de5-9a26-b0c7445453a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "de3032bf-5264-4de5-9a26-b0c7445453a6" (UID: "de3032bf-5264-4de5-9a26-b0c7445453a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:06:40.309476 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.309454 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3032bf-5264-4de5-9a26-b0c7445453a6-kube-api-access-7r2db" (OuterVolumeSpecName: "kube-api-access-7r2db") pod "de3032bf-5264-4de5-9a26-b0c7445453a6" (UID: "de3032bf-5264-4de5-9a26-b0c7445453a6"). InnerVolumeSpecName "kube-api-access-7r2db". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:06:40.408966 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.408937 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3032bf-5264-4de5-9a26-b0c7445453a6-extensions-socket-volume\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:06:40.408966 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:40.408961 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r2db\" (UniqueName: \"kubernetes.io/projected/de3032bf-5264-4de5-9a26-b0c7445453a6-kube-api-access-7r2db\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:06:41.162142 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:41.162109 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" Jul 24 23:06:41.162546 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:41.162143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh" event={"ID":"de3032bf-5264-4de5-9a26-b0c7445453a6","Type":"ContainerDied","Data":"3913de5b4691119f50a51a5290f3baba48abbd229bd3318451112004daf16bb2"} Jul 24 23:06:41.162546 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:41.162207 2585 scope.go:117] "RemoveContainer" containerID="db7fede93dcce8acb0a61f865b63a763665e0607ba6aa5ef4621e01eafa4f832" Jul 24 23:06:41.185157 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:41.185134 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh"] Jul 24 23:06:41.188600 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:41.188578 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgrhh"] Jul 24 23:06:42.053233 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:06:42.053197 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3032bf-5264-4de5-9a26-b0c7445453a6" path="/var/lib/kubelet/pods/de3032bf-5264-4de5-9a26-b0c7445453a6/volumes" Jul 24 23:07:39.232279 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232240 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr"] Jul 24 23:07:39.232696 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232677 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3032bf-5264-4de5-9a26-b0c7445453a6" containerName="manager" Jul 24 23:07:39.232696 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232689 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3032bf-5264-4de5-9a26-b0c7445453a6" containerName="manager" Jul 24 23:07:39.232773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232702 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd3db1a-d082-4b68-b067-6b2f0590372d" containerName="authorino" Jul 24 23:07:39.232773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232708 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd3db1a-d082-4b68-b067-6b2f0590372d" containerName="authorino" Jul 24 23:07:39.232773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232771 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3032bf-5264-4de5-9a26-b0c7445453a6" containerName="manager" Jul 24 23:07:39.232904 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.232783 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd3db1a-d082-4b68-b067-6b2f0590372d" containerName="authorino" Jul 24 23:07:39.236900 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.236883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.239561 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.239540 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l9czn\"" Jul 24 23:07:39.248968 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.248944 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr"] Jul 24 23:07:39.311580 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.311540 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbd5a433-22d8-4cb0-b76b-32d1f6007027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6xvgr\" (UID: \"dbd5a433-22d8-4cb0-b76b-32d1f6007027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.311580 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.311581 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tg7\" (UniqueName: \"kubernetes.io/projected/dbd5a433-22d8-4cb0-b76b-32d1f6007027-kube-api-access-z7tg7\") pod \"kuadrant-operator-controller-manager-86878c769f-6xvgr\" (UID: \"dbd5a433-22d8-4cb0-b76b-32d1f6007027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.412754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.412714 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbd5a433-22d8-4cb0-b76b-32d1f6007027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6xvgr\" (UID: \"dbd5a433-22d8-4cb0-b76b-32d1f6007027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.412754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.412755 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tg7\" (UniqueName: \"kubernetes.io/projected/dbd5a433-22d8-4cb0-b76b-32d1f6007027-kube-api-access-z7tg7\") pod \"kuadrant-operator-controller-manager-86878c769f-6xvgr\" (UID: \"dbd5a433-22d8-4cb0-b76b-32d1f6007027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.413111 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.413086 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbd5a433-22d8-4cb0-b76b-32d1f6007027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6xvgr\" (UID: \"dbd5a433-22d8-4cb0-b76b-32d1f6007027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.421214 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.421194 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tg7\" (UniqueName: \"kubernetes.io/projected/dbd5a433-22d8-4cb0-b76b-32d1f6007027-kube-api-access-z7tg7\") pod \"kuadrant-operator-controller-manager-86878c769f-6xvgr\" (UID: \"dbd5a433-22d8-4cb0-b76b-32d1f6007027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.547052 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.547017 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:39.687236 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:39.687205 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr"] Jul 24 23:07:39.688611 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:07:39.688586 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd5a433_22d8_4cb0_b76b_32d1f6007027.slice/crio-03246bd14d3c960e948b110cb037e5e025e00623d7f1b831ccbf184c330300b3 WatchSource:0}: Error finding container 03246bd14d3c960e948b110cb037e5e025e00623d7f1b831ccbf184c330300b3: Status 404 returned error can't find the container with id 03246bd14d3c960e948b110cb037e5e025e00623d7f1b831ccbf184c330300b3 Jul 24 23:07:40.475541 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:40.475501 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" event={"ID":"dbd5a433-22d8-4cb0-b76b-32d1f6007027","Type":"ContainerStarted","Data":"75ad315d74bb3d2a65ea929cfbcd4054789d9cf8a8203ecd4f531551a4a95e53"} Jul 24 23:07:40.476064 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:40.475565 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" event={"ID":"dbd5a433-22d8-4cb0-b76b-32d1f6007027","Type":"ContainerStarted","Data":"03246bd14d3c960e948b110cb037e5e025e00623d7f1b831ccbf184c330300b3"} Jul 24 23:07:40.476064 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:40.475601 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:07:40.497084 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:40.497028 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" podStartSLOduration=1.49701011 podStartE2EDuration="1.49701011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:07:40.49540837 +0000 UTC m=+1286.959596795" watchObservedRunningTime="2026-07-24 23:07:40.49701011 +0000 UTC m=+1286.961198536" Jul 24 23:07:51.484208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:07:51.484176 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xvgr" Jul 24 23:10:18.261457 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.261373 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj"] Jul 24 23:10:18.264579 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.264561 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.267010 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.266990 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e1e63fa5-kserve-self-signed-certs\"" Jul 24 23:10:18.280314 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.280289 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj"] Jul 24 23:10:18.304004 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.303972 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-home\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.304114 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.304037 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-model-cache\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.304114 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.304105 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-tmp-dir\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.304202 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.304130 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01bce12a-3ed3-46a9-b7be-e74174711f12-tls-certs\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.304202 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.304159 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbfwp\" (UniqueName: \"kubernetes.io/projected/01bce12a-3ed3-46a9-b7be-e74174711f12-kube-api-access-zbfwp\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.304292 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.304223 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-dshm\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.405622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.405589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-tmp-dir\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.405622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.405625 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01bce12a-3ed3-46a9-b7be-e74174711f12-tls-certs\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.405880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.405663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbfwp\" (UniqueName: \"kubernetes.io/projected/01bce12a-3ed3-46a9-b7be-e74174711f12-kube-api-access-zbfwp\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.405880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.405699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-dshm\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.405880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.405740 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-home\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.405880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.405822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-model-cache\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.406066 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.406028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-tmp-dir\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.406166 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.406146 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-home\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.406251 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.406233 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-model-cache\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.407928 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.407910 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-dshm\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.408227 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.408205 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01bce12a-3ed3-46a9-b7be-e74174711f12-tls-certs\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.414122 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.414097 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbfwp\" (UniqueName: \"kubernetes.io/projected/01bce12a-3ed3-46a9-b7be-e74174711f12-kube-api-access-zbfwp\") pod \"e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.574132 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.574050 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:18.703415 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:18.703386 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj"] Jul 24 23:10:18.704831 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:10:18.704780 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01bce12a_3ed3_46a9_b7be_e74174711f12.slice/crio-6471494e0569887bd05bb59ffbc2ae134ad37a109cf288b172898018a5084fe1 WatchSource:0}: Error finding container 6471494e0569887bd05bb59ffbc2ae134ad37a109cf288b172898018a5084fe1: Status 404 returned error can't find the container with id 6471494e0569887bd05bb59ffbc2ae134ad37a109cf288b172898018a5084fe1 Jul 24 23:10:19.323263 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:19.323226 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" event={"ID":"01bce12a-3ed3-46a9-b7be-e74174711f12","Type":"ContainerStarted","Data":"18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7"} Jul 24 23:10:19.323661 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:19.323271 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" event={"ID":"01bce12a-3ed3-46a9-b7be-e74174711f12","Type":"ContainerStarted","Data":"6471494e0569887bd05bb59ffbc2ae134ad37a109cf288b172898018a5084fe1"} Jul 24 23:10:19.342281 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:19.342233 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" podStartSLOduration=1.342217086 podStartE2EDuration="1.342217086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:10:19.341379447 +0000 UTC m=+1445.805567872" watchObservedRunningTime="2026-07-24 23:10:19.342217086 +0000 UTC m=+1445.806405557" Jul 24 23:10:28.574395 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:28.574313 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:28.574395 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:28.574374 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:28.587253 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:28.587228 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:10:29.395710 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:10:29.395667 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:11:06.776199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:06.776166 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj"] Jul 24 23:11:21.796311 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:21.796270 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" podUID="01bce12a-3ed3-46a9-b7be-e74174711f12" containerName="main" containerID="cri-o://18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7" gracePeriod=45 Jul 24 23:11:22.058105 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.058037 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:11:22.155996 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.155967 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01bce12a-3ed3-46a9-b7be-e74174711f12-tls-certs\") pod \"01bce12a-3ed3-46a9-b7be-e74174711f12\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " Jul 24 23:11:22.156143 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156010 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-model-cache\") pod \"01bce12a-3ed3-46a9-b7be-e74174711f12\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " Jul 24 23:11:22.156143 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156046 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbfwp\" (UniqueName: \"kubernetes.io/projected/01bce12a-3ed3-46a9-b7be-e74174711f12-kube-api-access-zbfwp\") pod \"01bce12a-3ed3-46a9-b7be-e74174711f12\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " Jul 24 23:11:22.156143 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156122 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-tmp-dir\") pod \"01bce12a-3ed3-46a9-b7be-e74174711f12\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " Jul 24 23:11:22.156307 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156164 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-home\") pod \"01bce12a-3ed3-46a9-b7be-e74174711f12\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " Jul 24 23:11:22.156307 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156203 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-dshm\") pod \"01bce12a-3ed3-46a9-b7be-e74174711f12\" (UID: \"01bce12a-3ed3-46a9-b7be-e74174711f12\") " Jul 24 23:11:22.156388 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156290 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-model-cache" (OuterVolumeSpecName: "model-cache") pod "01bce12a-3ed3-46a9-b7be-e74174711f12" (UID: "01bce12a-3ed3-46a9-b7be-e74174711f12"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:11:22.156388 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156365 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "01bce12a-3ed3-46a9-b7be-e74174711f12" (UID: "01bce12a-3ed3-46a9-b7be-e74174711f12"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:11:22.156465 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156404 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-home" (OuterVolumeSpecName: "home") pod "01bce12a-3ed3-46a9-b7be-e74174711f12" (UID: "01bce12a-3ed3-46a9-b7be-e74174711f12"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:11:22.156520 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156501 2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-tmp-dir\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:11:22.156583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156525 2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-home\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:11:22.156583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.156536 2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-model-cache\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:11:22.158236 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.158211 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-dshm" (OuterVolumeSpecName: "dshm") pod "01bce12a-3ed3-46a9-b7be-e74174711f12" (UID: "01bce12a-3ed3-46a9-b7be-e74174711f12"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:11:22.158344 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.158217 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01bce12a-3ed3-46a9-b7be-e74174711f12-kube-api-access-zbfwp" (OuterVolumeSpecName: "kube-api-access-zbfwp") pod "01bce12a-3ed3-46a9-b7be-e74174711f12" (UID: "01bce12a-3ed3-46a9-b7be-e74174711f12"). InnerVolumeSpecName "kube-api-access-zbfwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:11:22.158344 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.158237 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bce12a-3ed3-46a9-b7be-e74174711f12-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "01bce12a-3ed3-46a9-b7be-e74174711f12" (UID: "01bce12a-3ed3-46a9-b7be-e74174711f12"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 23:11:22.257471 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.257444 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbfwp\" (UniqueName: \"kubernetes.io/projected/01bce12a-3ed3-46a9-b7be-e74174711f12-kube-api-access-zbfwp\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:11:22.257471 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.257467 2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01bce12a-3ed3-46a9-b7be-e74174711f12-dshm\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:11:22.257471 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.257477 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01bce12a-3ed3-46a9-b7be-e74174711f12-tls-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:11:22.677936 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.677896 2585 generic.go:356] "Generic (PLEG): container finished" podID="01bce12a-3ed3-46a9-b7be-e74174711f12" containerID="18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7" exitCode=0 Jul 24 23:11:22.678132 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.677952 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" Jul 24 23:11:22.678132 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.677983 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" event={"ID":"01bce12a-3ed3-46a9-b7be-e74174711f12","Type":"ContainerDied","Data":"18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7"} Jul 24 23:11:22.678132 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.678031 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj" event={"ID":"01bce12a-3ed3-46a9-b7be-e74174711f12","Type":"ContainerDied","Data":"6471494e0569887bd05bb59ffbc2ae134ad37a109cf288b172898018a5084fe1"} Jul 24 23:11:22.678132 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.678049 2585 scope.go:117] "RemoveContainer" containerID="18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7" Jul 24 23:11:22.687999 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.687982 2585 scope.go:117] "RemoveContainer" containerID="18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7" Jul 24 23:11:22.688257 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:11:22.688222 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7\": container with ID starting with 18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7 not found: ID does not exist" containerID="18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7" Jul 24 23:11:22.688323 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.688269 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7"} err="failed to get container status \"18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7\": rpc error: code = NotFound desc = could not find container \"18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7\": container with ID starting with 18540f82414212541b8068fa211e4ab6e33f440865397a208b10461cd57a0bd7 not found: ID does not exist" Jul 24 23:11:22.699666 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.699641 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj"] Jul 24 23:11:22.702822 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:22.702788 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e1e63fa5-kserve-5ff7879fdc-mw9sj"] Jul 24 23:11:24.053244 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:11:24.053202 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01bce12a-3ed3-46a9-b7be-e74174711f12" path="/var/lib/kubelet/pods/01bce12a-3ed3-46a9-b7be-e74174711f12/volumes" Jul 24 23:14:56.793989 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.793953 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz"] Jul 24 23:14:56.794392 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.794329 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bce12a-3ed3-46a9-b7be-e74174711f12" containerName="main" Jul 24 23:14:56.794392 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.794340 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bce12a-3ed3-46a9-b7be-e74174711f12" containerName="main" Jul 24 23:14:56.794463 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.794399 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bce12a-3ed3-46a9-b7be-e74174711f12" containerName="main" Jul 24 23:14:56.797318 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.797296 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.799996 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.799973 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0e390b4a-openshift-default-dockercfg-m5brw\"" Jul 24 23:14:56.818629 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.818602 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz"] Jul 24 23:14:56.964380 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964346 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-certs\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964380 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964386 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbce8f2d-595d-4a43-b356-041170499440-istio-podinfo\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964620 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964410 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-istio-token\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964620 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964477 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbce8f2d-595d-4a43-b356-041170499440-istiod-ca-cert\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964620 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964509 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62f4n\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-kube-api-access-62f4n\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964620 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964542 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-credential-socket\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964620 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-envoy\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964787 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964654 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-socket\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:56.964787 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:56.964683 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-data\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065555 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065468 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-socket\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065555 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065505 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-data\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065563 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-certs\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065586 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbce8f2d-595d-4a43-b356-041170499440-istio-podinfo\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065607 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-istio-token\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065641 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbce8f2d-595d-4a43-b356-041170499440-istiod-ca-cert\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065664 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62f4n\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-kube-api-access-62f4n\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.065773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065757 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-credential-socket\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.066093 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065820 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-envoy\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.066093 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065939 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-socket\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.066093 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.065984 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-certs\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.066235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.066184 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-data\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.066235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.066221 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-credential-socket\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.066360 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.066340 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbce8f2d-595d-4a43-b356-041170499440-istiod-ca-cert\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.068110 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.068093 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbce8f2d-595d-4a43-b356-041170499440-istio-podinfo\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.068110 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.068100 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-envoy\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.073910 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.073878 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-istio-token\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.074023 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.073967 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62f4n\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-kube-api-access-62f4n\") pod \"e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.108353 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.108328 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:57.249519 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.249492 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz"] Jul 24 23:14:57.250111 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:14:57.250078 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbce8f2d_595d_4a43_b356_041170499440.slice/crio-3b5de95f44b53c918ab590ab2efcf61c877c7868cedad8511359665ce8189030 WatchSource:0}: Error finding container 3b5de95f44b53c918ab590ab2efcf61c877c7868cedad8511359665ce8189030: Status 404 returned error can't find the container with id 3b5de95f44b53c918ab590ab2efcf61c877c7868cedad8511359665ce8189030 Jul 24 23:14:57.252181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.252154 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:14:57.252244 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.252215 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:14:57.252287 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.252241 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:14:57.853444 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.853401 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" event={"ID":"dbce8f2d-595d-4a43-b356-041170499440","Type":"ContainerStarted","Data":"dda48348aa45dba84b0ec29e0335946df83197dc2ca8e9bfd236d3560c216fc5"} Jul 24 23:14:57.853857 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.853469 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" event={"ID":"dbce8f2d-595d-4a43-b356-041170499440","Type":"ContainerStarted","Data":"3b5de95f44b53c918ab590ab2efcf61c877c7868cedad8511359665ce8189030"} Jul 24 23:14:57.882572 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:57.882522 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" podStartSLOduration=1.882506708 podStartE2EDuration="1.882506708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:14:57.881785328 +0000 UTC m=+1724.345973755" watchObservedRunningTime="2026-07-24 23:14:57.882506708 +0000 UTC m=+1724.346695133" Jul 24 23:14:58.109483 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:58.109398 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:58.114419 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:58.114393 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:58.858771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:58.858733 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:14:58.859702 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:14:58.859684 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:12.939250 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:12.939211 2585 generic.go:356] "Generic (PLEG): container finished" podID="dbce8f2d-595d-4a43-b356-041170499440" containerID="dda48348aa45dba84b0ec29e0335946df83197dc2ca8e9bfd236d3560c216fc5" exitCode=0 Jul 24 23:15:12.939689 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:12.939279 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" event={"ID":"dbce8f2d-595d-4a43-b356-041170499440","Type":"ContainerDied","Data":"dda48348aa45dba84b0ec29e0335946df83197dc2ca8e9bfd236d3560c216fc5"} Jul 24 23:15:12.939734 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:12.939700 2585 scope.go:117] "RemoveContainer" containerID="dda48348aa45dba84b0ec29e0335946df83197dc2ca8e9bfd236d3560c216fc5" Jul 24 23:15:12.940690 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:12.940664 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:12.940787 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:12.940730 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:12.940787 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:12.940772 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:13.859452 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:13.859410 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:13.946901 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:13.946865 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" event={"ID":"dbce8f2d-595d-4a43-b356-041170499440","Type":"ContainerStarted","Data":"d3d5a57ea5fd97b84978b2f3769948d013df2b091cbce5c2fe8b510df9cb1cc2"} Jul 24 23:15:14.108725 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:14.108679 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:14.109916 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:14.109850 2585 patch_prober.go:28] interesting pod/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 24 23:15:14.109916 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:14.109897 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 24 23:15:15.109347 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:15.109307 2585 patch_prober.go:28] interesting pod/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 24 23:15:15.109761 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:15.109413 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 24 23:15:16.109179 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:16.109135 2585 patch_prober.go:28] interesting pod/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 24 23:15:16.109361 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:16.109198 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 24 23:15:17.109264 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:17.109223 2585 patch_prober.go:28] interesting pod/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 24 23:15:17.109659 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:17.109280 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 24 23:15:18.112617 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:18.112566 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:18.113084 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:18.112878 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:18.113554 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:18.113534 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:39.999737 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:39.999702 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz"] Jul 24 23:15:40.000166 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:39.999960 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" containerID="cri-o://d3d5a57ea5fd97b84978b2f3769948d013df2b091cbce5c2fe8b510df9cb1cc2" gracePeriod=30 Jul 24 23:15:40.982074 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:40.982042 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj"] Jul 24 23:15:40.985867 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:40.985832 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:40.988711 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:40.988689 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f5e9b15b-gw-openshift-default-dockercfg-lb7c2\"" Jul 24 23:15:40.998641 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:40.998614 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj"] Jul 24 23:15:41.074191 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074149 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-credential-socket\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074200 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-data\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074267 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45038e2-b358-4cf2-85ed-150f1987739a-istio-podinfo\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074365 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45038e2-b358-4cf2-85ed-150f1987739a-istiod-ca-cert\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074471 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdwv\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-kube-api-access-7gdwv\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074522 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-socket\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074548 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-envoy\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074582 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-certs\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.074634 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.074611 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-istio-token\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176062 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdwv\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-kube-api-access-7gdwv\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176062 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-socket\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176085 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-envoy\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-certs\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176123 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-istio-token\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176169 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-credential-socket\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176192 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-data\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176210 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45038e2-b358-4cf2-85ed-150f1987739a-istio-podinfo\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176255 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45038e2-b358-4cf2-85ed-150f1987739a-istiod-ca-cert\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176677 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176547 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-socket\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176677 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176585 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-certs\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176677 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176654 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-credential-socket\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.176888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.176693 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-data\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.177034 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.177014 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45038e2-b358-4cf2-85ed-150f1987739a-istiod-ca-cert\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.178684 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.178663 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-envoy\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.179017 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.178997 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45038e2-b358-4cf2-85ed-150f1987739a-istio-podinfo\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.185232 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.185198 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-istio-token\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.185355 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.185240 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdwv\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-kube-api-access-7gdwv\") pod \"e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.296993 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.296952 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:41.450916 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.450887 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj"] Jul 24 23:15:41.451585 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:15:41.451560 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45038e2_b358_4cf2_85ed_150f1987739a.slice/crio-8d12f0e57ae8c756fc2415065ec6a43b10f3eb2d66fd8f97710eec0dcf6ab14e WatchSource:0}: Error finding container 8d12f0e57ae8c756fc2415065ec6a43b10f3eb2d66fd8f97710eec0dcf6ab14e: Status 404 returned error can't find the container with id 8d12f0e57ae8c756fc2415065ec6a43b10f3eb2d66fd8f97710eec0dcf6ab14e Jul 24 23:15:41.453900 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.453870 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:41.453975 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.453938 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:41.453975 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:41.453966 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:42.108079 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:42.108043 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" event={"ID":"b45038e2-b358-4cf2-85ed-150f1987739a","Type":"ContainerStarted","Data":"bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e"} Jul 24 23:15:42.108475 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:42.108102 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" event={"ID":"b45038e2-b358-4cf2-85ed-150f1987739a","Type":"ContainerStarted","Data":"8d12f0e57ae8c756fc2415065ec6a43b10f3eb2d66fd8f97710eec0dcf6ab14e"} Jul 24 23:15:42.128217 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:42.128167 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" podStartSLOduration=2.128150194 podStartE2EDuration="2.128150194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:15:42.127010635 +0000 UTC m=+1768.591199084" watchObservedRunningTime="2026-07-24 23:15:42.128150194 +0000 UTC m=+1768.592338619" Jul 24 23:15:42.297705 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:42.297663 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:42.302639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:42.302611 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:43.115258 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:43.115216 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:43.121013 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:43.120985 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:45.128135 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.128102 2585 generic.go:356] "Generic (PLEG): container finished" podID="dbce8f2d-595d-4a43-b356-041170499440" containerID="d3d5a57ea5fd97b84978b2f3769948d013df2b091cbce5c2fe8b510df9cb1cc2" exitCode=0 Jul 24 23:15:45.128514 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.128179 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" event={"ID":"dbce8f2d-595d-4a43-b356-041170499440","Type":"ContainerDied","Data":"d3d5a57ea5fd97b84978b2f3769948d013df2b091cbce5c2fe8b510df9cb1cc2"} Jul 24 23:15:45.128514 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.128259 2585 scope.go:117] "RemoveContainer" containerID="dda48348aa45dba84b0ec29e0335946df83197dc2ca8e9bfd236d3560c216fc5" Jul 24 23:15:45.264682 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.264655 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:45.418722 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.418634 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62f4n\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-kube-api-access-62f4n\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.418722 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.418680 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-certs\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.418722 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.418708 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-data\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419041 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.418856 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-istio-token\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419041 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.418935 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbce8f2d-595d-4a43-b356-041170499440-istio-podinfo\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419041 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.418955 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbce8f2d-595d-4a43-b356-041170499440-istiod-ca-cert\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419041 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419007 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-socket\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419275 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419046 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-credential-socket\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419275 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419077 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-envoy\") pod \"dbce8f2d-595d-4a43-b356-041170499440\" (UID: \"dbce8f2d-595d-4a43-b356-041170499440\") " Jul 24 23:15:45.419275 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419236 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:15:45.419428 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419311 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbce8f2d-595d-4a43-b356-041170499440-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:15:45.419488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419429 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbce8f2d-595d-4a43-b356-041170499440-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.419605 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419447 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.419605 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419562 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:15:45.419605 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419577 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:15:45.419882 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.419615 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:15:45.421224 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.421191 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:15:45.421323 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.421237 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbce8f2d-595d-4a43-b356-041170499440-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:15:45.421323 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.421252 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-kube-api-access-62f4n" (OuterVolumeSpecName: "kube-api-access-62f4n") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "kube-api-access-62f4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:15:45.421323 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.421240 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbce8f2d-595d-4a43-b356-041170499440" (UID: "dbce8f2d-595d-4a43-b356-041170499440"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:15:45.521089 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521045 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.521089 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521079 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.521089 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521090 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.521089 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521099 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbce8f2d-595d-4a43-b356-041170499440-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.521360 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521107 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.521360 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521117 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbce8f2d-595d-4a43-b356-041170499440-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:45.521360 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:45.521125 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62f4n\" (UniqueName: \"kubernetes.io/projected/dbce8f2d-595d-4a43-b356-041170499440-kube-api-access-62f4n\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:15:46.134893 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:46.134861 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" Jul 24 23:15:46.134893 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:46.134871 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz" event={"ID":"dbce8f2d-595d-4a43-b356-041170499440","Type":"ContainerDied","Data":"3b5de95f44b53c918ab590ab2efcf61c877c7868cedad8511359665ce8189030"} Jul 24 23:15:46.135376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:46.134943 2585 scope.go:117] "RemoveContainer" containerID="d3d5a57ea5fd97b84978b2f3769948d013df2b091cbce5c2fe8b510df9cb1cc2" Jul 24 23:15:46.154080 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:46.154003 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz"] Jul 24 23:15:46.157080 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:46.157052 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0e390b4a-openshift-default-5b9f74cb6d-h7mjz"] Jul 24 23:15:48.052261 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:48.052224 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbce8f2d-595d-4a43-b356-041170499440" path="/var/lib/kubelet/pods/dbce8f2d-595d-4a43-b356-041170499440/volumes" Jul 24 23:15:57.202041 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:57.201945 2585 generic.go:356] "Generic (PLEG): container finished" podID="b45038e2-b358-4cf2-85ed-150f1987739a" containerID="bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e" exitCode=0 Jul 24 23:15:57.202041 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:57.201993 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" event={"ID":"b45038e2-b358-4cf2-85ed-150f1987739a","Type":"ContainerDied","Data":"bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e"} Jul 24 23:15:57.202473 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:57.202398 2585 scope.go:117] "RemoveContainer" containerID="bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e" Jul 24 23:15:57.203402 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:57.203372 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:57.203460 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:57.203441 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:57.203498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:57.203474 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:15:58.115671 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:58.115625 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:58.209521 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:58.209481 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" event={"ID":"b45038e2-b358-4cf2-85ed-150f1987739a","Type":"ContainerStarted","Data":"55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7"} Jul 24 23:15:58.297391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:58.297356 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:15:58.298307 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:58.298275 2585 patch_prober.go:28] interesting pod/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 24 23:15:58.298431 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:58.298322 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 24 23:15:59.298133 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:59.298095 2585 patch_prober.go:28] interesting pod/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 24 23:15:59.298541 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:15:59.298156 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 24 23:16:00.297549 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:00.297505 2585 patch_prober.go:28] interesting pod/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 24 23:16:00.297769 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:00.297580 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 24 23:16:01.297550 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:01.297509 2585 patch_prober.go:28] interesting pod/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 24 23:16:01.298052 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:01.297575 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 24 23:16:02.301896 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:02.301864 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:16:02.302374 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:02.302238 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:16:02.302974 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:02.302944 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:16:23.806122 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:23.806088 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj"] Jul 24 23:16:23.806575 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:23.806299 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" containerID="cri-o://55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7" gracePeriod=30 Jul 24 23:16:24.599842 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.599789 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5"] Jul 24 23:16:24.600187 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.600174 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" Jul 24 23:16:24.600232 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.600189 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" Jul 24 23:16:24.600272 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.600268 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" Jul 24 23:16:24.600308 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.600277 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" Jul 24 23:16:24.603450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.603433 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.605973 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.605949 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-69a3f527-openshift-default-dockercfg-rl65c\"" Jul 24 23:16:24.617864 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.617839 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5"] Jul 24 23:16:24.686870 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.686842 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-envoy\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.686883 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-credential-socket\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.686922 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-socket\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.686940 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-certs\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.686957 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-data\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.686997 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-podinfo\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.687015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94795152-e6e8-4ca8-a4d0-ac17222091ad-istiod-ca-cert\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.687034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6bw\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-kube-api-access-pv6bw\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.687383 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.687096 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-token\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788193 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788152 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-envoy\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788193 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788199 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-credential-socket\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788224 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-socket\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788267 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-certs\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788285 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-data\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788323 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-podinfo\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788350 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94795152-e6e8-4ca8-a4d0-ac17222091ad-istiod-ca-cert\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788377 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6bw\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-kube-api-access-pv6bw\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788435 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-token\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788764 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788709 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-credential-socket\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.788842 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.788779 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-socket\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.789027 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.789004 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-certs\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.789125 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.789096 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94795152-e6e8-4ca8-a4d0-ac17222091ad-istiod-ca-cert\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.789192 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.789162 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-data\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.790953 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.790933 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-envoy\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.791053 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.790996 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-podinfo\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.796413 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.796389 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-token\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.796579 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.796559 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6bw\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-kube-api-access-pv6bw\") pod \"e2e-ait-69a3f527-openshift-default-7564869f78-v64f5\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:24.915917 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:24.915831 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:25.077867 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.077837 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5"] Jul 24 23:16:25.080149 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:16:25.080117 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94795152_e6e8_4ca8_a4d0_ac17222091ad.slice/crio-5b1f4422d7dfcb25ce0b5fffb152500bd9fcbd89efb01f1cf387c9c0d62b5b09 WatchSource:0}: Error finding container 5b1f4422d7dfcb25ce0b5fffb152500bd9fcbd89efb01f1cf387c9c0d62b5b09: Status 404 returned error can't find the container with id 5b1f4422d7dfcb25ce0b5fffb152500bd9fcbd89efb01f1cf387c9c0d62b5b09 Jul 24 23:16:25.082326 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.082295 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:16:25.082431 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.082373 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:16:25.082431 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.082421 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:16:25.359704 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.359667 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" event={"ID":"94795152-e6e8-4ca8-a4d0-ac17222091ad","Type":"ContainerStarted","Data":"addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea"} Jul 24 23:16:25.359884 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.359723 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" event={"ID":"94795152-e6e8-4ca8-a4d0-ac17222091ad","Type":"ContainerStarted","Data":"5b1f4422d7dfcb25ce0b5fffb152500bd9fcbd89efb01f1cf387c9c0d62b5b09"} Jul 24 23:16:25.382133 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.382079 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" podStartSLOduration=1.382060372 podStartE2EDuration="1.382060372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:16:25.380512811 +0000 UTC m=+1811.844701261" watchObservedRunningTime="2026-07-24 23:16:25.382060372 +0000 UTC m=+1811.846248802" Jul 24 23:16:25.916925 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:25.916890 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:26.920788 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:26.920756 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:27.369513 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:27.369476 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:27.370533 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:27.370501 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:29.068946 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.068891 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:16:29.233161 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233125 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-istio-token\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233222 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45038e2-b358-4cf2-85ed-150f1987739a-istio-podinfo\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233271 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-credential-socket\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233348 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-data\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233375 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45038e2-b358-4cf2-85ed-150f1987739a-istiod-ca-cert\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233684 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233392 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-socket\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233684 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233424 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-envoy\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233684 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233453 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-certs\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233684 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233477 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gdwv\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-kube-api-access-7gdwv\") pod \"b45038e2-b358-4cf2-85ed-150f1987739a\" (UID: \"b45038e2-b358-4cf2-85ed-150f1987739a\") " Jul 24 23:16:29.233912 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233822 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:16:29.233972 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233921 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.234024 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.233961 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45038e2-b358-4cf2-85ed-150f1987739a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:16:29.234602 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.234564 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:16:29.234841 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.234776 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:16:29.234930 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.234844 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:16:29.235970 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.235935 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:16:29.237576 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.237513 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b45038e2-b358-4cf2-85ed-150f1987739a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:16:29.237983 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.237809 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-kube-api-access-7gdwv" (OuterVolumeSpecName: "kube-api-access-7gdwv") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "kube-api-access-7gdwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:16:29.237983 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.237939 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b45038e2-b358-4cf2-85ed-150f1987739a" (UID: "b45038e2-b358-4cf2-85ed-150f1987739a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335148 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335187 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45038e2-b358-4cf2-85ed-150f1987739a-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335197 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335205 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335213 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45038e2-b358-4cf2-85ed-150f1987739a-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335222 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gdwv\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-kube-api-access-7gdwv\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335230 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45038e2-b358-4cf2-85ed-150f1987739a-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.335235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.335240 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45038e2-b358-4cf2-85ed-150f1987739a-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:16:29.382259 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.382223 2585 generic.go:356] "Generic (PLEG): container finished" podID="b45038e2-b358-4cf2-85ed-150f1987739a" containerID="55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7" exitCode=0 Jul 24 23:16:29.382436 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.382266 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" Jul 24 23:16:29.382436 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.382307 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" event={"ID":"b45038e2-b358-4cf2-85ed-150f1987739a","Type":"ContainerDied","Data":"55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7"} Jul 24 23:16:29.382436 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.382379 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj" event={"ID":"b45038e2-b358-4cf2-85ed-150f1987739a","Type":"ContainerDied","Data":"8d12f0e57ae8c756fc2415065ec6a43b10f3eb2d66fd8f97710eec0dcf6ab14e"} Jul 24 23:16:29.382436 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.382413 2585 scope.go:117] "RemoveContainer" containerID="55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7" Jul 24 23:16:29.392505 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.392488 2585 scope.go:117] "RemoveContainer" containerID="bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e" Jul 24 23:16:29.400381 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.400363 2585 scope.go:117] "RemoveContainer" containerID="55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7" Jul 24 23:16:29.400637 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:16:29.400612 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7\": container with ID starting with 55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7 not found: ID does not exist" containerID="55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7" Jul 24 23:16:29.400687 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.400641 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7"} err="failed to get container status \"55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7\": rpc error: code = NotFound desc = could not find container \"55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7\": container with ID starting with 55c534509c0b81135b61f5b316ff82e33c3b992ac058f84f750d8ed9bc5558f7 not found: ID does not exist" Jul 24 23:16:29.400687 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.400659 2585 scope.go:117] "RemoveContainer" containerID="bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e" Jul 24 23:16:29.401028 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:16:29.401010 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e\": container with ID starting with bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e not found: ID does not exist" containerID="bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e" Jul 24 23:16:29.401077 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.401033 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e"} err="failed to get container status \"bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e\": rpc error: code = NotFound desc = could not find container \"bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e\": container with ID starting with bd8b08afbb2a16e4a2bb90617a8baf4408e994502db66b993e536436d533806e not found: ID does not exist" Jul 24 23:16:29.404870 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.404848 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj"] Jul 24 23:16:29.408540 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:29.408520 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f5e9b15b-gw-openshift-default-56d8c57496-q7clj"] Jul 24 23:16:30.052957 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:30.052928 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" path="/var/lib/kubelet/pods/b45038e2-b358-4cf2-85ed-150f1987739a/volumes" Jul 24 23:16:41.451329 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:41.451296 2585 generic.go:356] "Generic (PLEG): container finished" podID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerID="addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea" exitCode=0 Jul 24 23:16:41.451755 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:41.451360 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" event={"ID":"94795152-e6e8-4ca8-a4d0-ac17222091ad","Type":"ContainerDied","Data":"addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea"} Jul 24 23:16:41.451817 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:41.451788 2585 scope.go:117] "RemoveContainer" containerID="addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea" Jul 24 23:16:41.452807 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:41.452767 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:16:41.452914 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:41.452851 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:16:41.452914 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:41.452886 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:16:42.370037 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:42.370005 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:42.458587 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:42.458552 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" event={"ID":"94795152-e6e8-4ca8-a4d0-ac17222091ad","Type":"ContainerStarted","Data":"1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41"} Jul 24 23:16:42.916010 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:42.915969 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:42.917256 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:42.917231 2585 patch_prober.go:28] interesting pod/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 24 23:16:42.917320 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:42.917282 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 24 23:16:43.917181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:43.917143 2585 patch_prober.go:28] interesting pod/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 24 23:16:43.917556 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:43.917196 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 24 23:16:44.916219 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:44.916178 2585 patch_prober.go:28] interesting pod/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 24 23:16:44.916428 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:44.916241 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 24 23:16:45.917137 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:45.917096 2585 patch_prober.go:28] interesting pod/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 24 23:16:45.917543 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:45.917156 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 24 23:16:46.920005 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:46.919975 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:46.920429 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:46.920233 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:16:46.920965 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:16:46.920948 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:17:08.768427 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:08.768391 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5"] Jul 24 23:17:08.769030 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:08.768619 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" containerID="cri-o://1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41" gracePeriod=30 Jul 24 23:17:09.520124 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.520094 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc"] Jul 24 23:17:09.520471 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.520459 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" Jul 24 23:17:09.520527 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.520473 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" Jul 24 23:17:09.520527 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.520501 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" Jul 24 23:17:09.520527 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.520507 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbce8f2d-595d-4a43-b356-041170499440" containerName="istio-proxy" Jul 24 23:17:09.520619 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.520555 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" Jul 24 23:17:09.523583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.523567 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.526009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.525989 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-57bcbd39-openshift-default-dockercfg-v52tj\"" Jul 24 23:17:09.536995 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.536972 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc"] Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618558 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-envoy\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618637 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-podinfo\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618676 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-token\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618709 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istiod-ca-cert\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618762 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-socket\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618790 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-data\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618852 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-credential-socket\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-certs\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.623317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.618925 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgnn\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-kube-api-access-brgnn\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720075 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-podinfo\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720083 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-token\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istiod-ca-cert\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720158 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-socket\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720183 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-data\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720222 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-credential-socket\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720518 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720257 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-certs\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720518 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720289 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgnn\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-kube-api-access-brgnn\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720518 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720356 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-envoy\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720701 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720655 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-certs\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720759 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720715 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-data\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720759 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720725 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-socket\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.720873 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.720790 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-credential-socket\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.721020 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.721001 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istiod-ca-cert\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.722734 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.722705 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-envoy\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.722887 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.722781 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-podinfo\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.727934 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.727915 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgnn\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-kube-api-access-brgnn\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.728157 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.728139 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-token\") pod \"e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.834492 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.834397 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:09.970578 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.970538 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc"] Jul 24 23:17:09.970677 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:17:09.970606 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5a4fb6_51a6_4bfa_bb09_37aa8b2d0a17.slice/crio-b5c074cbc33f5b9c51be0bcf9093fbcab120abe506cb877a2da5ad7bb4072828 WatchSource:0}: Error finding container b5c074cbc33f5b9c51be0bcf9093fbcab120abe506cb877a2da5ad7bb4072828: Status 404 returned error can't find the container with id b5c074cbc33f5b9c51be0bcf9093fbcab120abe506cb877a2da5ad7bb4072828 Jul 24 23:17:09.972994 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.972956 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:17:09.973101 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.973044 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:17:09.973101 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:09.973090 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:17:10.619723 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:10.619685 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" event={"ID":"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17","Type":"ContainerStarted","Data":"01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0"} Jul 24 23:17:10.619916 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:10.619741 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" event={"ID":"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17","Type":"ContainerStarted","Data":"b5c074cbc33f5b9c51be0bcf9093fbcab120abe506cb877a2da5ad7bb4072828"} Jul 24 23:17:10.639759 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:10.639709 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podStartSLOduration=1.6396930520000002 podStartE2EDuration="1.639693052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:17:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:17:10.637578164 +0000 UTC m=+1857.101766590" watchObservedRunningTime="2026-07-24 23:17:10.639693052 +0000 UTC m=+1857.103881477" Jul 24 23:17:10.835105 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:10.835073 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:11.840224 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:11.840194 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:12.631124 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:12.631080 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:12.631993 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:12.631973 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:14.035296 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.035228 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:17:14.163546 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163398 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-credential-socket\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163546 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163425 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-podinfo\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163546 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163469 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-token\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163737 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163571 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-socket\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163737 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163634 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-data\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163737 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163718 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv6bw\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-kube-api-access-pv6bw\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163998 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163746 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-envoy\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163998 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163754 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:14.163998 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163772 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94795152-e6e8-4ca8-a4d0-ac17222091ad-istiod-ca-cert\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163998 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163850 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-certs\") pod \"94795152-e6e8-4ca8-a4d0-ac17222091ad\" (UID: \"94795152-e6e8-4ca8-a4d0-ac17222091ad\") " Jul 24 23:17:14.163998 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.163935 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:14.164283 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.164258 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94795152-e6e8-4ca8-a4d0-ac17222091ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:17:14.164353 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.164328 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.164353 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.164349 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.164556 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.164527 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:14.164639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.164538 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:14.166325 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.166291 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:14.166325 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.166323 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:17:14.166489 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.166363 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:17:14.166489 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.166450 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-kube-api-access-pv6bw" (OuterVolumeSpecName: "kube-api-access-pv6bw") pod "94795152-e6e8-4ca8-a4d0-ac17222091ad" (UID: "94795152-e6e8-4ca8-a4d0-ac17222091ad"). InnerVolumeSpecName "kube-api-access-pv6bw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:17:14.265194 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265167 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.265194 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265192 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94795152-e6e8-4ca8-a4d0-ac17222091ad-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.265366 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265201 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.265366 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265209 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.265366 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265216 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.265366 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265223 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94795152-e6e8-4ca8-a4d0-ac17222091ad-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.265366 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.265231 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv6bw\" (UniqueName: \"kubernetes.io/projected/94795152-e6e8-4ca8-a4d0-ac17222091ad-kube-api-access-pv6bw\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:14.642767 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.642734 2585 generic.go:356] "Generic (PLEG): container finished" podID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerID="1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41" exitCode=0 Jul 24 23:17:14.642972 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.642790 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" Jul 24 23:17:14.642972 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.642823 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" event={"ID":"94795152-e6e8-4ca8-a4d0-ac17222091ad","Type":"ContainerDied","Data":"1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41"} Jul 24 23:17:14.642972 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.642916 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5" event={"ID":"94795152-e6e8-4ca8-a4d0-ac17222091ad","Type":"ContainerDied","Data":"5b1f4422d7dfcb25ce0b5fffb152500bd9fcbd89efb01f1cf387c9c0d62b5b09"} Jul 24 23:17:14.642972 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.642957 2585 scope.go:117] "RemoveContainer" containerID="1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41" Jul 24 23:17:14.651963 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.651945 2585 scope.go:117] "RemoveContainer" containerID="addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea" Jul 24 23:17:14.659709 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.659693 2585 scope.go:117] "RemoveContainer" containerID="1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41" Jul 24 23:17:14.659969 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:17:14.659952 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41\": container with ID starting with 1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41 not found: ID does not exist" containerID="1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41" Jul 24 23:17:14.660024 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.659977 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41"} err="failed to get container status \"1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41\": rpc error: code = NotFound desc = could not find container \"1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41\": container with ID starting with 1680212641aebfb2159aff9ff9fa424bb638503643e08a05ac6c049f268a8b41 not found: ID does not exist" Jul 24 23:17:14.660024 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.659994 2585 scope.go:117] "RemoveContainer" containerID="addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea" Jul 24 23:17:14.660237 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:17:14.660221 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea\": container with ID starting with addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea not found: ID does not exist" containerID="addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea" Jul 24 23:17:14.660285 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.660240 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea"} err="failed to get container status \"addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea\": rpc error: code = NotFound desc = could not find container \"addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea\": container with ID starting with addf2a434568b539f9f0db46f2b318b33ae774011c1dd45e46478582caae51ea not found: ID does not exist" Jul 24 23:17:14.666351 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.666327 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5"] Jul 24 23:17:14.670855 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:14.670833 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-69a3f527-openshift-default-7564869f78-v64f5"] Jul 24 23:17:16.052638 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:16.052605 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" path="/var/lib/kubelet/pods/94795152-e6e8-4ca8-a4d0-ac17222091ad/volumes" Jul 24 23:17:25.711772 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:25.711738 2585 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerID="01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0" exitCode=0 Jul 24 23:17:25.712319 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:25.711815 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" event={"ID":"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17","Type":"ContainerDied","Data":"01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0"} Jul 24 23:17:25.712630 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:25.712340 2585 scope.go:117] "RemoveContainer" containerID="01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0" Jul 24 23:17:25.713488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:25.713459 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:17:25.713558 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:25.713542 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:17:25.713606 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:25.713592 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:17:26.720616 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:26.720574 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" event={"ID":"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17","Type":"ContainerStarted","Data":"27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a"} Jul 24 23:17:26.835525 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:26.835481 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:26.836789 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:26.836756 2585 patch_prober.go:28] interesting pod/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 24 23:17:26.836943 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:26.836826 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 24 23:17:27.631394 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:27.631353 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:27.835260 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:27.835222 2585 patch_prober.go:28] interesting pod/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 24 23:17:27.835641 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:27.835276 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 24 23:17:28.834750 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:28.834716 2585 patch_prober.go:28] interesting pod/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 24 23:17:28.834951 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:28.834768 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 24 23:17:29.835141 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:29.835104 2585 patch_prober.go:28] interesting pod/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 24 23:17:29.835534 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:29.835174 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 24 23:17:30.835750 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:30.835714 2585 patch_prober.go:28] interesting pod/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 24 23:17:30.836281 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:30.835776 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 24 23:17:31.839455 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:31.839425 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:31.840414 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:31.840394 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:52.067480 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:52.067443 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc"] Jul 24 23:17:52.068131 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:52.067734 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" containerID="cri-o://27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a" gracePeriod=30 Jul 24 23:17:57.325145 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.325119 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:57.460728 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460649 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istiod-ca-cert\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.460728 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460681 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-certs\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.460728 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460704 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-socket\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.460728 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460719 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-credential-socket\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.461083 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460780 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-data\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.461083 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460815 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-envoy\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.461083 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460867 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-token\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.461083 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460896 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-podinfo\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.461083 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.460923 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brgnn\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-kube-api-access-brgnn\") pod \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\" (UID: \"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17\") " Jul 24 23:17:57.461083 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.461077 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:57.461362 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.461182 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:57.461362 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.461209 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:17:57.461362 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.461264 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.461517 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.461455 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:57.461691 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.461665 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:57.463019 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.463000 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-kube-api-access-brgnn" (OuterVolumeSpecName: "kube-api-access-brgnn") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "kube-api-access-brgnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:17:57.463154 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.463140 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:17:57.463412 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.463376 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:17:57.463412 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.463401 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" (UID: "ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:17:57.562579 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562543 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562579 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562573 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562579 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562582 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562815 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562592 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562815 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562602 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562815 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562609 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562815 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562617 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.562815 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.562625 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brgnn\" (UniqueName: \"kubernetes.io/projected/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17-kube-api-access-brgnn\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:17:57.889243 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.889208 2585 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerID="27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a" exitCode=0 Jul 24 23:17:57.889417 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.889257 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" Jul 24 23:17:57.889417 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.889287 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" event={"ID":"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17","Type":"ContainerDied","Data":"27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a"} Jul 24 23:17:57.889417 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.889334 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc" event={"ID":"ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17","Type":"ContainerDied","Data":"b5c074cbc33f5b9c51be0bcf9093fbcab120abe506cb877a2da5ad7bb4072828"} Jul 24 23:17:57.889417 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.889354 2585 scope.go:117] "RemoveContainer" containerID="27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a" Jul 24 23:17:57.899454 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.899429 2585 scope.go:117] "RemoveContainer" containerID="01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0" Jul 24 23:17:57.908284 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.908266 2585 scope.go:117] "RemoveContainer" containerID="27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a" Jul 24 23:17:57.908523 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:17:57.908503 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a\": container with ID starting with 27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a not found: ID does not exist" containerID="27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a" Jul 24 23:17:57.908578 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.908533 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a"} err="failed to get container status \"27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a\": rpc error: code = NotFound desc = could not find container \"27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a\": container with ID starting with 27cee6d53f222dc8de6942a5ada5eb845fb0ab6446a86bd18e1a3dd1d080c98a not found: ID does not exist" Jul 24 23:17:57.908578 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.908550 2585 scope.go:117] "RemoveContainer" containerID="01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0" Jul 24 23:17:57.908809 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:17:57.908780 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0\": container with ID starting with 01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0 not found: ID does not exist" containerID="01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0" Jul 24 23:17:57.908929 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.908910 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0"} err="failed to get container status \"01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0\": rpc error: code = NotFound desc = could not find container \"01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0\": container with ID starting with 01330f11948e767d7831e91c95897047f6d561648faea0fdf3e8a2f1c119ffd0 not found: ID does not exist" Jul 24 23:17:57.913407 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.913387 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc"] Jul 24 23:17:57.915436 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:57.915418 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-57bcbd39-openshift-default-6bdc6d54dd-mjtbc"] Jul 24 23:17:58.053014 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:17:58.052981 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" path="/var/lib/kubelet/pods/ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17/volumes" Jul 24 23:19:30.750536 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750453 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4"] Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750822 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750833 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750842 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750849 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750857 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750863 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750882 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750888 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750943 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750951 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5a4fb6-51a6-4bfa-bb09-37aa8b2d0a17" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750958 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45038e2-b358-4cf2-85ed-150f1987739a" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750965 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" Jul 24 23:19:30.751054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.750972 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" Jul 24 23:19:30.754076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.754055 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.758913 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.758889 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-93ae309a-openshift-default-dockercfg-tq88r\"" Jul 24 23:19:30.792464 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.792437 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4"] Jul 24 23:19:30.895984 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.895942 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-data\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.895984 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.895989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istiod-ca-cert\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896045 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-certs\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896091 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2kt\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-kube-api-access-9s2kt\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896142 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-credential-socket\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-token\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896350 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896243 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-socket\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896350 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896262 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-envoy\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.896350 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.896276 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-podinfo\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997474 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-socket\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997529 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-envoy\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997556 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-podinfo\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-data\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997624 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istiod-ca-cert\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997650 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-certs\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997687 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2kt\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-kube-api-access-9s2kt\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997752 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-credential-socket\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.997776 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-token\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.998888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.998555 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-socket\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:30.999710 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:30.999680 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istiod-ca-cert\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.000200 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.000176 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-data\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.000406 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.000184 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-certs\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.000597 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.000400 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-credential-socket\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.003134 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.003101 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-podinfo\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.004904 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.004878 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-envoy\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.008002 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.007943 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-token\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.008698 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.008679 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2kt\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-kube-api-access-9s2kt\") pod \"e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.064901 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.064864 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:31.227093 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.227058 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4"] Jul 24 23:19:31.228290 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:19:31.228263 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4649b8_325f_4aaa_8d4d_04f0c7ba5201.slice/crio-b50fac60ae942b5e9e877bbbddd00c3fd0d314c91ebee625febb1e6d7b2bfe10 WatchSource:0}: Error finding container b50fac60ae942b5e9e877bbbddd00c3fd0d314c91ebee625febb1e6d7b2bfe10: Status 404 returned error can't find the container with id b50fac60ae942b5e9e877bbbddd00c3fd0d314c91ebee625febb1e6d7b2bfe10 Jul 24 23:19:31.230568 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.230536 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:19:31.230695 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.230600 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:19:31.230695 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.230629 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:19:31.398349 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.398312 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" event={"ID":"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201","Type":"ContainerStarted","Data":"eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196"} Jul 24 23:19:31.398545 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.398381 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" event={"ID":"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201","Type":"ContainerStarted","Data":"b50fac60ae942b5e9e877bbbddd00c3fd0d314c91ebee625febb1e6d7b2bfe10"} Jul 24 23:19:31.424719 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:31.424620 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podStartSLOduration=1.424598427 podStartE2EDuration="1.424598427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:19:31.420700842 +0000 UTC m=+1997.884889269" watchObservedRunningTime="2026-07-24 23:19:31.424598427 +0000 UTC m=+1997.888786850" Jul 24 23:19:32.065788 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:32.065751 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:32.080926 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:32.080895 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:32.404820 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:32.404731 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:32.405581 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:32.405555 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:44.478424 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:44.478390 2585 generic.go:356] "Generic (PLEG): container finished" podID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerID="eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196" exitCode=0 Jul 24 23:19:44.478876 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:44.478469 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" event={"ID":"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201","Type":"ContainerDied","Data":"eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196"} Jul 24 23:19:44.478971 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:44.478955 2585 scope.go:117] "RemoveContainer" containerID="eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196" Jul 24 23:19:44.480078 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:44.480051 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:19:44.480208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:44.480134 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:19:44.480208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:44.480184 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:19:45.486258 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:45.486226 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" event={"ID":"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201","Type":"ContainerStarted","Data":"e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353"} Jul 24 23:19:46.065245 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:46.065210 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:46.066409 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:46.066383 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:46.066526 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:46.066441 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:47.065860 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:47.065819 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:47.066250 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:47.065879 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:47.405401 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:47.405310 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:48.065423 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:48.065387 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:48.065596 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:48.065449 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:49.066019 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:49.065979 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:49.066432 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:49.066064 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:50.065891 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:50.065858 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:50.066079 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:50.065908 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:51.065473 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:51.065434 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:51.065666 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:51.065490 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:52.066190 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:52.066151 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 24 23:19:52.066580 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:52.066207 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 24 23:19:53.069337 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:53.069306 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:19:53.070358 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:19:53.070338 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:20:06.905611 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:06.905570 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4"] Jul 24 23:20:06.906153 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:06.905787 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" containerID="cri-o://e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353" gracePeriod=30 Jul 24 23:20:08.072446 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:08.072412 2585 patch_prober.go:28] interesting pod/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 23:20:08.072932 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:08.072466 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 23:20:12.157581 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.157555 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:20:12.295043 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295007 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s2kt\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-kube-api-access-9s2kt\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295069 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-token\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295089 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-envoy\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295140 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-credential-socket\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295164 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-socket\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295197 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istiod-ca-cert\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295231 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-podinfo\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295307 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-data\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295335 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-certs\") pod \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\" (UID: \"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201\") " Jul 24 23:20:12.295583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295484 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:20:12.295583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295499 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:20:12.295839 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295688 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.295839 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295694 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:20:12.295839 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.295707 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.296071 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.296017 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:20:12.296475 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.296449 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:20:12.297487 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.297445 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:20:12.297584 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.297531 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:20:12.297699 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.297679 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-kube-api-access-9s2kt" (OuterVolumeSpecName: "kube-api-access-9s2kt") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "kube-api-access-9s2kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:20:12.297824 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.297783 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" (UID: "ee4649b8-325f-4aaa-8d4d-04f0c7ba5201"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:20:12.396249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396217 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.396249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396244 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.396249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396256 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.396460 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396269 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s2kt\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-kube-api-access-9s2kt\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.396460 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396281 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.396460 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396292 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.396460 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.396302 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:20:12.639712 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.639617 2585 generic.go:356] "Generic (PLEG): container finished" podID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerID="e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353" exitCode=0 Jul 24 23:20:12.639712 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.639693 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" Jul 24 23:20:12.639954 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.639707 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" event={"ID":"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201","Type":"ContainerDied","Data":"e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353"} Jul 24 23:20:12.639954 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.639784 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4" event={"ID":"ee4649b8-325f-4aaa-8d4d-04f0c7ba5201","Type":"ContainerDied","Data":"b50fac60ae942b5e9e877bbbddd00c3fd0d314c91ebee625febb1e6d7b2bfe10"} Jul 24 23:20:12.639954 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.639816 2585 scope.go:117] "RemoveContainer" containerID="e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353" Jul 24 23:20:12.649393 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.649378 2585 scope.go:117] "RemoveContainer" containerID="eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196" Jul 24 23:20:12.657760 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.657737 2585 scope.go:117] "RemoveContainer" containerID="e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353" Jul 24 23:20:12.658038 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:20:12.658020 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353\": container with ID starting with e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353 not found: ID does not exist" containerID="e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353" Jul 24 23:20:12.658111 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.658046 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353"} err="failed to get container status \"e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353\": rpc error: code = NotFound desc = could not find container \"e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353\": container with ID starting with e79dc01d2210ce8e56726e2cc13063ac219bd1faa47fa0f90fb82aa4333e9353 not found: ID does not exist" Jul 24 23:20:12.658111 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.658067 2585 scope.go:117] "RemoveContainer" containerID="eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196" Jul 24 23:20:12.658353 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:20:12.658328 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196\": container with ID starting with eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196 not found: ID does not exist" containerID="eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196" Jul 24 23:20:12.658457 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.658362 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196"} err="failed to get container status \"eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196\": rpc error: code = NotFound desc = could not find container \"eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196\": container with ID starting with eef489d5ae9906b3139fa0e7b24e2c0b461827fc11dd910204195272e3181196 not found: ID does not exist" Jul 24 23:20:12.661403 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.661383 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4"] Jul 24 23:20:12.664927 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:12.664909 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-93ae309a-openshift-default-76dcc6d86d-mdwm4"] Jul 24 23:20:14.053151 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:14.053115 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" path="/var/lib/kubelet/pods/ee4649b8-325f-4aaa-8d4d-04f0c7ba5201/volumes" Jul 24 23:20:26.606014 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.605977 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk"] Jul 24 23:20:26.606375 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606339 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" Jul 24 23:20:26.606375 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606350 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" Jul 24 23:20:26.606375 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606360 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" Jul 24 23:20:26.606375 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606365 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94795152-e6e8-4ca8-a4d0-ac17222091ad" containerName="istio-proxy" Jul 24 23:20:26.606501 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606379 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" Jul 24 23:20:26.606501 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606386 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" Jul 24 23:20:26.606501 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.606438 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" Jul 24 23:20:26.609450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.609425 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.612225 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.612202 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4813d775-openshift-default-dockercfg-2pbrf\"" Jul 24 23:20:26.621765 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.621734 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7d2n\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-kube-api-access-x7d2n\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.621924 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.621823 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-token\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.621924 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.621878 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-envoy\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622049 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.621928 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513f76f2-4647-4fa3-a662-1ef30ec0c360-istiod-ca-cert\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622049 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.621968 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-socket\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622049 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.621984 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-credential-socket\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622049 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.622017 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-certs\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622243 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.622077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-data\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622243 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.622121 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-podinfo\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.622342 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.622260 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk"] Jul 24 23:20:26.723384 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723349 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-podinfo\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723571 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723406 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7d2n\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-kube-api-access-x7d2n\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723571 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723464 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-token\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723571 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723493 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-envoy\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723571 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723518 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513f76f2-4647-4fa3-a662-1ef30ec0c360-istiod-ca-cert\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723571 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-socket\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723571 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-credential-socket\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723958 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723609 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-certs\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.723958 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.723668 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-data\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.724116 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.724091 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-credential-socket\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.724176 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.724123 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-socket\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.724176 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.724153 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-certs\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.724272 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.724253 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-data\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.724408 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.724388 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513f76f2-4647-4fa3-a662-1ef30ec0c360-istiod-ca-cert\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.725807 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.725769 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-envoy\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.726057 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.726039 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-podinfo\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.734741 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.734710 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-token\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.734894 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.734877 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7d2n\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-kube-api-access-x7d2n\") pod \"e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:26.919986 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:26.919905 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:27.066836 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.065183 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk"] Jul 24 23:20:27.072123 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.072078 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:20:27.072245 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.072174 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:20:27.072245 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.072218 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:20:27.723439 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.723404 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" event={"ID":"513f76f2-4647-4fa3-a662-1ef30ec0c360","Type":"ContainerStarted","Data":"bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507"} Jul 24 23:20:27.723848 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.723464 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" event={"ID":"513f76f2-4647-4fa3-a662-1ef30ec0c360","Type":"ContainerStarted","Data":"aece964cc6441f6099fbfb60e11114513840e2c6641082749e6378773849ec12"} Jul 24 23:20:27.761191 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.761142 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podStartSLOduration=1.761127273 podStartE2EDuration="1.761127273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:20:27.758893074 +0000 UTC m=+2054.223081500" watchObservedRunningTime="2026-07-24 23:20:27.761127273 +0000 UTC m=+2054.225315697" Jul 24 23:20:27.920828 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:27.920764 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:28.925807 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:28.925764 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:29.733491 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:29.733460 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:29.734469 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:29.734449 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:42.813933 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:42.813901 2585 generic.go:356] "Generic (PLEG): container finished" podID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerID="bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507" exitCode=0 Jul 24 23:20:42.814373 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:42.813951 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" event={"ID":"513f76f2-4647-4fa3-a662-1ef30ec0c360","Type":"ContainerDied","Data":"bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507"} Jul 24 23:20:42.814373 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:42.814302 2585 scope.go:117] "RemoveContainer" containerID="bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507" Jul 24 23:20:42.815328 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:42.815298 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:20:42.815403 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:42.815386 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:20:42.815450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:42.815437 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:20:43.822451 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:43.822416 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" event={"ID":"513f76f2-4647-4fa3-a662-1ef30ec0c360","Type":"ContainerStarted","Data":"58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17"} Jul 24 23:20:43.920070 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:43.920035 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:43.921007 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:43.920982 2585 patch_prober.go:28] interesting pod/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 24 23:20:43.921071 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:43.921033 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 24 23:20:44.733914 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:44.733884 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:44.921103 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:44.921064 2585 patch_prober.go:28] interesting pod/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 24 23:20:44.921470 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:44.921119 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 24 23:20:45.920509 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:45.920481 2585 patch_prober.go:28] interesting pod/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 24 23:20:45.920752 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:45.920728 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 24 23:20:46.920418 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:46.920386 2585 patch_prober.go:28] interesting pod/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 24 23:20:46.920840 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:46.920441 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 24 23:20:47.920267 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:47.920229 2585 patch_prober.go:28] interesting pod/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 24 23:20:47.920451 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:47.920284 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 24 23:20:48.924491 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:48.924455 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:48.925428 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:48.925407 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:20:51.970969 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.970934 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr"] Jul 24 23:20:51.971577 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.971557 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4649b8-325f-4aaa-8d4d-04f0c7ba5201" containerName="istio-proxy" Jul 24 23:20:51.974464 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.974447 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:51.978122 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.978098 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4813d775\"/\"openshift-service-ca.crt\"" Jul 24 23:20:51.978282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.978128 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4813d775\"/\"e2e-lifecycle-model-4813d775-kserve-self-signed-certs\"" Jul 24 23:20:51.978282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.978158 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4813d775\"/\"default-dockercfg-5flcm\"" Jul 24 23:20:51.978282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.978125 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4813d775\"/\"kube-root-ca.crt\"" Jul 24 23:20:51.984202 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:51.984182 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr"] Jul 24 23:20:52.054862 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.054833 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-home\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.055035 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.054885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-model-cache\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.055035 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.054955 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvz4\" (UniqueName: \"kubernetes.io/projected/778b86da-6d08-4a7d-af20-fc002071fbed-kube-api-access-rkvz4\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.055035 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.054982 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/778b86da-6d08-4a7d-af20-fc002071fbed-tls-certs\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.055035 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.055006 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-tmp-dir\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.055224 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.055097 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-dshm\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156184 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156146 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvz4\" (UniqueName: \"kubernetes.io/projected/778b86da-6d08-4a7d-af20-fc002071fbed-kube-api-access-rkvz4\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156189 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/778b86da-6d08-4a7d-af20-fc002071fbed-tls-certs\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156223 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-tmp-dir\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156290 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-dshm\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156376 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156355 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-home\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156596 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-model-cache\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156702 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156672 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-tmp-dir\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156788 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156766 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-home\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.156872 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.156841 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-model-cache\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.158522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.158502 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-dshm\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.158952 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.158933 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/778b86da-6d08-4a7d-af20-fc002071fbed-tls-certs\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.164210 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.164189 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvz4\" (UniqueName: \"kubernetes.io/projected/778b86da-6d08-4a7d-af20-fc002071fbed-kube-api-access-rkvz4\") pod \"e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.284949 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.284919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:20:52.416647 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.416624 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr"] Jul 24 23:20:52.418206 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:20:52.418171 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod778b86da_6d08_4a7d_af20_fc002071fbed.slice/crio-582b69be1c3cb46b54ee3f8967864e4e428e041e627bb29f989304b7fde3a980 WatchSource:0}: Error finding container 582b69be1c3cb46b54ee3f8967864e4e428e041e627bb29f989304b7fde3a980: Status 404 returned error can't find the container with id 582b69be1c3cb46b54ee3f8967864e4e428e041e627bb29f989304b7fde3a980 Jul 24 23:20:52.870676 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.870644 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" event={"ID":"778b86da-6d08-4a7d-af20-fc002071fbed","Type":"ContainerStarted","Data":"d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3"} Jul 24 23:20:52.870861 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.870686 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" event={"ID":"778b86da-6d08-4a7d-af20-fc002071fbed","Type":"ContainerStarted","Data":"582b69be1c3cb46b54ee3f8967864e4e428e041e627bb29f989304b7fde3a980"} Jul 24 23:20:52.892261 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:20:52.892210 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" podStartSLOduration=1.892194764 podStartE2EDuration="1.892194764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:20:52.890744307 +0000 UTC m=+2079.354932756" watchObservedRunningTime="2026-07-24 23:20:52.892194764 +0000 UTC m=+2079.356383189" Jul 24 23:21:02.285119 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:02.285079 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:21:02.285524 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:02.285138 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:21:02.297375 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:02.297350 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:21:02.932142 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:02.932110 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:21:41.892690 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:41.892658 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr"] Jul 24 23:21:56.911996 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:56.911937 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" podUID="778b86da-6d08-4a7d-af20-fc002071fbed" containerName="main" containerID="cri-o://d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3" gracePeriod=45 Jul 24 23:21:57.166130 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.166076 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:21:57.208271 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.208239 2585 generic.go:356] "Generic (PLEG): container finished" podID="778b86da-6d08-4a7d-af20-fc002071fbed" containerID="d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3" exitCode=0 Jul 24 23:21:57.208420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.208306 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" Jul 24 23:21:57.208420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.208321 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" event={"ID":"778b86da-6d08-4a7d-af20-fc002071fbed","Type":"ContainerDied","Data":"d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3"} Jul 24 23:21:57.208420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.208361 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr" event={"ID":"778b86da-6d08-4a7d-af20-fc002071fbed","Type":"ContainerDied","Data":"582b69be1c3cb46b54ee3f8967864e4e428e041e627bb29f989304b7fde3a980"} Jul 24 23:21:57.208420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.208379 2585 scope.go:117] "RemoveContainer" containerID="d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3" Jul 24 23:21:57.222235 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.222213 2585 scope.go:117] "RemoveContainer" containerID="d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3" Jul 24 23:21:57.222481 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:21:57.222456 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3\": container with ID starting with d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3 not found: ID does not exist" containerID="d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3" Jul 24 23:21:57.222558 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.222487 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3"} err="failed to get container status \"d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3\": rpc error: code = NotFound desc = could not find container \"d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3\": container with ID starting with d9452970fb1d0e0eeb60dadf48c1ff401778dec004923d3023cec30ad96edfb3 not found: ID does not exist" Jul 24 23:21:57.226757 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.226738 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-tmp-dir\") pod \"778b86da-6d08-4a7d-af20-fc002071fbed\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " Jul 24 23:21:57.226871 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.226777 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-home\") pod \"778b86da-6d08-4a7d-af20-fc002071fbed\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " Jul 24 23:21:57.226936 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.226869 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-dshm\") pod \"778b86da-6d08-4a7d-af20-fc002071fbed\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " Jul 24 23:21:57.227006 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.226985 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkvz4\" (UniqueName: \"kubernetes.io/projected/778b86da-6d08-4a7d-af20-fc002071fbed-kube-api-access-rkvz4\") pod \"778b86da-6d08-4a7d-af20-fc002071fbed\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " Jul 24 23:21:57.227064 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227023 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/778b86da-6d08-4a7d-af20-fc002071fbed-tls-certs\") pod \"778b86da-6d08-4a7d-af20-fc002071fbed\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " Jul 24 23:21:57.227064 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227025 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "778b86da-6d08-4a7d-af20-fc002071fbed" (UID: "778b86da-6d08-4a7d-af20-fc002071fbed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:21:57.227064 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227054 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-model-cache\") pod \"778b86da-6d08-4a7d-af20-fc002071fbed\" (UID: \"778b86da-6d08-4a7d-af20-fc002071fbed\") " Jul 24 23:21:57.227222 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227053 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-home" (OuterVolumeSpecName: "home") pod "778b86da-6d08-4a7d-af20-fc002071fbed" (UID: "778b86da-6d08-4a7d-af20-fc002071fbed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:21:57.227278 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227244 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-model-cache" (OuterVolumeSpecName: "model-cache") pod "778b86da-6d08-4a7d-af20-fc002071fbed" (UID: "778b86da-6d08-4a7d-af20-fc002071fbed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:21:57.227361 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227347 2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-tmp-dir\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:21:57.227420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227363 2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-home\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:21:57.227420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.227371 2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-model-cache\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:21:57.229046 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.229018 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-dshm" (OuterVolumeSpecName: "dshm") pod "778b86da-6d08-4a7d-af20-fc002071fbed" (UID: "778b86da-6d08-4a7d-af20-fc002071fbed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:21:57.229163 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.229144 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/778b86da-6d08-4a7d-af20-fc002071fbed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "778b86da-6d08-4a7d-af20-fc002071fbed" (UID: "778b86da-6d08-4a7d-af20-fc002071fbed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 23:21:57.229216 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.229157 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778b86da-6d08-4a7d-af20-fc002071fbed-kube-api-access-rkvz4" (OuterVolumeSpecName: "kube-api-access-rkvz4") pod "778b86da-6d08-4a7d-af20-fc002071fbed" (UID: "778b86da-6d08-4a7d-af20-fc002071fbed"). InnerVolumeSpecName "kube-api-access-rkvz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:21:57.328648 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.328622 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkvz4\" (UniqueName: \"kubernetes.io/projected/778b86da-6d08-4a7d-af20-fc002071fbed-kube-api-access-rkvz4\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:21:57.328648 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.328647 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/778b86da-6d08-4a7d-af20-fc002071fbed-tls-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:21:57.328829 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.328658 2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/778b86da-6d08-4a7d-af20-fc002071fbed-dshm\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:21:57.533092 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.533065 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr"] Jul 24 23:21:57.536653 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:57.536626 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4813d775/e2e-lifecycle-model-4813d775-kserve-7cc99db67f-s4vvr"] Jul 24 23:21:58.052723 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:21:58.052691 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778b86da-6d08-4a7d-af20-fc002071fbed" path="/var/lib/kubelet/pods/778b86da-6d08-4a7d-af20-fc002071fbed/volumes" Jul 24 23:22:24.655898 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:24.655861 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk"] Jul 24 23:22:24.656356 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:24.656153 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" containerID="cri-o://58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17" gracePeriod=30 Jul 24 23:22:29.924962 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:29.924892 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:22:30.026889 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.026856 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-certs\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027061 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.026915 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-envoy\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027061 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.026936 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-podinfo\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027061 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.026975 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-credential-socket\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027061 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027003 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-token\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027061 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027023 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-data\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027061 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027049 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-socket\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027365 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027132 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513f76f2-4647-4fa3-a662-1ef30ec0c360-istiod-ca-cert\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027365 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027145 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:22:30.027365 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027160 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7d2n\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-kube-api-access-x7d2n\") pod \"513f76f2-4647-4fa3-a662-1ef30ec0c360\" (UID: \"513f76f2-4647-4fa3-a662-1ef30ec0c360\") " Jul 24 23:22:30.027365 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027311 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:22:30.027594 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027456 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:22:30.027594 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027500 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.027594 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027521 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.027770 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.027716 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/513f76f2-4647-4fa3-a662-1ef30ec0c360-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:22:30.028145 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.028118 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-data" (OuterVolumeSpecName: "istio-data") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:22:30.029314 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.029274 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-token" (OuterVolumeSpecName: "istio-token") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:22:30.029446 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.029426 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:22:30.029446 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.029433 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:22:30.029752 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.029727 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-kube-api-access-x7d2n" (OuterVolumeSpecName: "kube-api-access-x7d2n") pod "513f76f2-4647-4fa3-a662-1ef30ec0c360" (UID: "513f76f2-4647-4fa3-a662-1ef30ec0c360"). InnerVolumeSpecName "kube-api-access-x7d2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:22:30.128639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128605 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.128639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128635 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.128639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128644 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.128903 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128652 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513f76f2-4647-4fa3-a662-1ef30ec0c360-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.128903 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128663 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7d2n\" (UniqueName: \"kubernetes.io/projected/513f76f2-4647-4fa3-a662-1ef30ec0c360-kube-api-access-x7d2n\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.128903 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128673 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.128903 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.128682 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513f76f2-4647-4fa3-a662-1ef30ec0c360-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:22:30.395059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.395019 2585 generic.go:356] "Generic (PLEG): container finished" podID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerID="58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17" exitCode=0 Jul 24 23:22:30.395254 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.395063 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" Jul 24 23:22:30.395254 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.395102 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" event={"ID":"513f76f2-4647-4fa3-a662-1ef30ec0c360","Type":"ContainerDied","Data":"58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17"} Jul 24 23:22:30.395254 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.395166 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk" event={"ID":"513f76f2-4647-4fa3-a662-1ef30ec0c360","Type":"ContainerDied","Data":"aece964cc6441f6099fbfb60e11114513840e2c6641082749e6378773849ec12"} Jul 24 23:22:30.395254 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.395199 2585 scope.go:117] "RemoveContainer" containerID="58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17" Jul 24 23:22:30.406045 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.406024 2585 scope.go:117] "RemoveContainer" containerID="bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507" Jul 24 23:22:30.417153 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.417133 2585 scope.go:117] "RemoveContainer" containerID="58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17" Jul 24 23:22:30.417475 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:22:30.417455 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17\": container with ID starting with 58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17 not found: ID does not exist" containerID="58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17" Jul 24 23:22:30.417574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.417487 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17"} err="failed to get container status \"58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17\": rpc error: code = NotFound desc = could not find container \"58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17\": container with ID starting with 58c4a38af31b87e2a54c7b5080c1237175ef85f083e0dfcf957a30056495ff17 not found: ID does not exist" Jul 24 23:22:30.417574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.417513 2585 scope.go:117] "RemoveContainer" containerID="bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507" Jul 24 23:22:30.417840 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:22:30.417821 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507\": container with ID starting with bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507 not found: ID does not exist" containerID="bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507" Jul 24 23:22:30.417888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.417846 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507"} err="failed to get container status \"bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507\": rpc error: code = NotFound desc = could not find container \"bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507\": container with ID starting with bf0af82e6f134079244e38ae510d2b2c1fb8c5913daf0b4c7a87902c16ce9507 not found: ID does not exist" Jul 24 23:22:30.418050 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.418030 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk"] Jul 24 23:22:30.423142 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:30.423122 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4813d775-openshift-default-f86bd7b56-fnnfk"] Jul 24 23:22:32.052633 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:22:32.052599 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" path="/var/lib/kubelet/pods/513f76f2-4647-4fa3-a662-1ef30ec0c360/volumes" Jul 24 23:23:19.775785 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.775753 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx"] Jul 24 23:23:19.776189 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776169 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778b86da-6d08-4a7d-af20-fc002071fbed" containerName="main" Jul 24 23:23:19.776189 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776183 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="778b86da-6d08-4a7d-af20-fc002071fbed" containerName="main" Jul 24 23:23:19.776265 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776203 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" Jul 24 23:23:19.776265 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776209 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" Jul 24 23:23:19.776265 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776220 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" Jul 24 23:23:19.776265 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776225 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" Jul 24 23:23:19.776389 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776292 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" Jul 24 23:23:19.776389 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.776300 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="778b86da-6d08-4a7d-af20-fc002071fbed" containerName="main" Jul 24 23:23:19.779044 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.779018 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.782732 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.782710 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-3b391a-openshift-default-dockercfg-2wdtt\"" Jul 24 23:23:19.793666 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.793615 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx"] Jul 24 23:23:19.868437 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.868402 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-data\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.868626 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.868476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-socket\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.868626 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.868513 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istiod-ca-cert\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.868626 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.868539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-token\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.868626 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.868563 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-podinfo\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.868892 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.868860 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-envoy\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.869106 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.869077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-credential-socket\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.869212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.869127 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-certs\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.869212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.869155 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxdj5\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-kube-api-access-bxdj5\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.969980 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.969941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-data\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.969998 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-socket\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istiod-ca-cert\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970039 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-token\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970056 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-podinfo\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970108 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-envoy\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970138 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-credential-socket\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970172 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-certs\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970201 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxdj5\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-kube-api-access-bxdj5\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970426 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-data\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970619 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970515 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-socket\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970748 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istiod-ca-cert\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970841 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970751 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-credential-socket\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.970906 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.970890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-certs\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.972498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.972472 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-envoy\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.972841 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.972823 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-podinfo\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.980102 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.980079 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-token\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:19.980310 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:19.980283 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxdj5\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-kube-api-access-bxdj5\") pod \"e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:20.092387 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.092301 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:20.237277 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.237246 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx"] Jul 24 23:23:20.237587 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:23:20.237560 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da2a9c4_b243_40c8_9e44_3eeb285d2492.slice/crio-d2df62a93f54fe46095fe806b7a4c8bf9570e0f7c7afcc63cccf6e24723a5b33 WatchSource:0}: Error finding container d2df62a93f54fe46095fe806b7a4c8bf9570e0f7c7afcc63cccf6e24723a5b33: Status 404 returned error can't find the container with id d2df62a93f54fe46095fe806b7a4c8bf9570e0f7c7afcc63cccf6e24723a5b33 Jul 24 23:23:20.239847 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.239813 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:20.239928 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.239882 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:20.239928 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.239910 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:20.668155 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.668116 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" event={"ID":"0da2a9c4-b243-40c8-9e44-3eeb285d2492","Type":"ContainerStarted","Data":"9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091"} Jul 24 23:23:20.668333 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.668170 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" event={"ID":"0da2a9c4-b243-40c8-9e44-3eeb285d2492","Type":"ContainerStarted","Data":"d2df62a93f54fe46095fe806b7a4c8bf9570e0f7c7afcc63cccf6e24723a5b33"} Jul 24 23:23:20.688212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:20.688156 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podStartSLOduration=1.688137204 podStartE2EDuration="1.688137204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:23:20.686552007 +0000 UTC m=+2227.150740432" watchObservedRunningTime="2026-07-24 23:23:20.688137204 +0000 UTC m=+2227.152325630" Jul 24 23:23:21.093241 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:21.093206 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:21.098110 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:21.098086 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:21.674329 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:21.674292 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:21.675190 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:21.675170 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:27.674180 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.674138 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9"] Jul 24 23:23:27.674856 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.674835 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="513f76f2-4647-4fa3-a662-1ef30ec0c360" containerName="istio-proxy" Jul 24 23:23:27.678536 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.678515 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.681026 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.681005 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-313c6a-openshift-default-dockercfg-htn8w\"" Jul 24 23:23:27.687670 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.687641 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9"] Jul 24 23:23:27.746853 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.746812 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-socket\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747003 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.746863 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-envoy\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747003 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.746897 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-istio-token\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747003 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.746915 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94520248-ade1-46ec-9868-23ffaf46816f-istio-podinfo\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.746991 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-data\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.747035 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgn2q\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-kube-api-access-xgn2q\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.747078 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-certs\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.747109 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-credential-socket\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.747324 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.747179 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94520248-ade1-46ec-9868-23ffaf46816f-istiod-ca-cert\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848038 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.847988 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-socket\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848038 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848037 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-envoy\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848064 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-istio-token\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848084 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94520248-ade1-46ec-9868-23ffaf46816f-istio-podinfo\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848156 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-data\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848210 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgn2q\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-kube-api-access-xgn2q\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848248 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-certs\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-credential-socket\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848682 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848323 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94520248-ade1-46ec-9868-23ffaf46816f-istiod-ca-cert\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848682 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848472 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-socket\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848682 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848507 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-data\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848682 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848668 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-certs\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848860 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848713 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-credential-socket\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.848994 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.848977 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94520248-ade1-46ec-9868-23ffaf46816f-istiod-ca-cert\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.850973 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.850945 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-envoy\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.851076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.851057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94520248-ade1-46ec-9868-23ffaf46816f-istio-podinfo\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.855774 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.855743 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-istio-token\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.855892 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.855878 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgn2q\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-kube-api-access-xgn2q\") pod \"e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:27.990901 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:27.990866 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:28.137690 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.137659 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9"] Jul 24 23:23:28.138558 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:23:28.138534 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94520248_ade1_46ec_9868_23ffaf46816f.slice/crio-0941a85a2a843829127663642c8a7acc51b5e2a766e14e4073423b50faf74d4e WatchSource:0}: Error finding container 0941a85a2a843829127663642c8a7acc51b5e2a766e14e4073423b50faf74d4e: Status 404 returned error can't find the container with id 0941a85a2a843829127663642c8a7acc51b5e2a766e14e4073423b50faf74d4e Jul 24 23:23:28.140706 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.140674 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:28.140808 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.140744 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:28.140808 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.140774 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:28.715860 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.715790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" event={"ID":"94520248-ade1-46ec-9868-23ffaf46816f","Type":"ContainerStarted","Data":"d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d"} Jul 24 23:23:28.716269 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.715894 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" event={"ID":"94520248-ade1-46ec-9868-23ffaf46816f","Type":"ContainerStarted","Data":"0941a85a2a843829127663642c8a7acc51b5e2a766e14e4073423b50faf74d4e"} Jul 24 23:23:28.735171 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.735115 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podStartSLOduration=1.735100159 podStartE2EDuration="1.735100159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:23:28.732714944 +0000 UTC m=+2235.196903410" watchObservedRunningTime="2026-07-24 23:23:28.735100159 +0000 UTC m=+2235.199288583" Jul 24 23:23:28.991608 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:28.991570 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:29.996831 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:29.996777 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:30.725668 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:30.725633 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:30.726622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:30.726602 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:37.575089 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.575054 2585 patch_prober.go:28] interesting pod/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": read tcp 10.133.0.2:47056->10.133.0.58:15021: read: connection reset by peer" start-of-body= Jul 24 23:23:37.575628 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.575585 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": read tcp 10.133.0.2:47056->10.133.0.58:15021: read: connection reset by peer" Jul 24 23:23:37.764502 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.764431 2585 generic.go:356] "Generic (PLEG): container finished" podID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerID="9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091" exitCode=0 Jul 24 23:23:37.764638 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.764500 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" event={"ID":"0da2a9c4-b243-40c8-9e44-3eeb285d2492","Type":"ContainerDied","Data":"9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091"} Jul 24 23:23:37.764924 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.764908 2585 scope.go:117] "RemoveContainer" containerID="9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091" Jul 24 23:23:37.765900 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.765873 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:37.765956 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.765942 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:37.765992 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:37.765979 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:38.779206 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:38.779163 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" event={"ID":"0da2a9c4-b243-40c8-9e44-3eeb285d2492","Type":"ContainerStarted","Data":"fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8"} Jul 24 23:23:39.093589 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:39.093482 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:39.093773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:39.093619 2585 patch_prober.go:28] interesting pod/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 24 23:23:39.093773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:39.093675 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 24 23:23:40.093292 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:40.093246 2585 patch_prober.go:28] interesting pod/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 24 23:23:40.093820 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:40.093319 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 24 23:23:41.093703 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:41.093655 2585 patch_prober.go:28] interesting pod/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 24 23:23:41.094221 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:41.093738 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 24 23:23:42.093510 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:42.093463 2585 patch_prober.go:28] interesting pod/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 24 23:23:42.093724 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:42.093548 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 24 23:23:43.100685 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:43.100642 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:43.101239 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:43.101045 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:43.102057 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:43.102035 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:23:46.152349 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.151339 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:40976->10.133.0.59:15021: read: connection reset by peer" start-of-body= Jul 24 23:23:46.152349 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.151414 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:40976->10.133.0.59:15021: read: connection reset by peer" Jul 24 23:23:46.842373 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.842338 2585 generic.go:356] "Generic (PLEG): container finished" podID="94520248-ade1-46ec-9868-23ffaf46816f" containerID="d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d" exitCode=0 Jul 24 23:23:46.842545 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.842390 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" event={"ID":"94520248-ade1-46ec-9868-23ffaf46816f","Type":"ContainerDied","Data":"d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d"} Jul 24 23:23:46.842751 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.842736 2585 scope.go:117] "RemoveContainer" containerID="d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d" Jul 24 23:23:46.843720 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.843693 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:46.843784 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.843767 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:46.843843 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:46.843824 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:23:47.849846 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:47.849789 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" event={"ID":"94520248-ade1-46ec-9868-23ffaf46816f","Type":"ContainerStarted","Data":"5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265"} Jul 24 23:23:47.991224 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:47.991184 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:47.991442 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:47.991414 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 24 23:23:47.991529 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:47.991490 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 24 23:23:48.991815 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:48.991759 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 24 23:23:48.992538 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:48.992391 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 24 23:23:49.991629 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:49.991588 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 24 23:23:49.991941 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:49.991898 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 24 23:23:50.991919 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:50.991874 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 24 23:23:50.992133 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:50.991942 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 24 23:23:51.991935 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:51.991894 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 24 23:23:51.992252 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:51.992214 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 24 23:23:52.994763 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:52.994722 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:52.995190 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:52.995169 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:23:52.995827 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:23:52.995791 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:25:27.549227 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:27.549143 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx"] Jul 24 23:25:27.549754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:27.549384 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" containerID="cri-o://fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8" gracePeriod=30 Jul 24 23:25:28.103683 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:28.103631 2585 patch_prober.go:28] interesting pod/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 23:25:28.103861 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:28.103705 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 23:25:32.814332 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.814269 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:25:32.903193 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903165 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-token\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903193 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903198 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-data\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903222 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-credential-socket\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903273 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-podinfo\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903289 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-envoy\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903315 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxdj5\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-kube-api-access-bxdj5\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903335 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-certs\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903352 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-socket\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903391 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903381 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istiod-ca-cert\") pod \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\" (UID: \"0da2a9c4-b243-40c8-9e44-3eeb285d2492\") " Jul 24 23:25:32.903825 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903715 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:32.903893 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903815 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:32.903950 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903909 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:32.904025 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.903999 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:25:32.904287 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.904259 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-data" (OuterVolumeSpecName: "istio-data") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:32.905427 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.905404 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-token" (OuterVolumeSpecName: "istio-token") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:25:32.905564 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.905549 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:25:32.905638 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.905620 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:32.905678 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:32.905642 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-kube-api-access-bxdj5" (OuterVolumeSpecName: "kube-api-access-bxdj5") pod "0da2a9c4-b243-40c8-9e44-3eeb285d2492" (UID: "0da2a9c4-b243-40c8-9e44-3eeb285d2492"). InnerVolumeSpecName "kube-api-access-bxdj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:25:33.004226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004194 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004222 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004232 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004490 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004241 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004490 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004250 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004490 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004258 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxdj5\" (UniqueName: \"kubernetes.io/projected/0da2a9c4-b243-40c8-9e44-3eeb285d2492-kube-api-access-bxdj5\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004490 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004266 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004490 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004275 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da2a9c4-b243-40c8-9e44-3eeb285d2492-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.004490 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.004282 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da2a9c4-b243-40c8-9e44-3eeb285d2492-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:33.423385 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.423357 2585 generic.go:356] "Generic (PLEG): container finished" podID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerID="fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8" exitCode=0 Jul 24 23:25:33.423549 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.423403 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" Jul 24 23:25:33.423549 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.423434 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" event={"ID":"0da2a9c4-b243-40c8-9e44-3eeb285d2492","Type":"ContainerDied","Data":"fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8"} Jul 24 23:25:33.423549 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.423484 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx" event={"ID":"0da2a9c4-b243-40c8-9e44-3eeb285d2492","Type":"ContainerDied","Data":"d2df62a93f54fe46095fe806b7a4c8bf9570e0f7c7afcc63cccf6e24723a5b33"} Jul 24 23:25:33.423549 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.423505 2585 scope.go:117] "RemoveContainer" containerID="fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8" Jul 24 23:25:33.433504 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.433489 2585 scope.go:117] "RemoveContainer" containerID="9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091" Jul 24 23:25:33.441274 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.441226 2585 scope.go:117] "RemoveContainer" containerID="fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8" Jul 24 23:25:33.441523 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:25:33.441507 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8\": container with ID starting with fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8 not found: ID does not exist" containerID="fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8" Jul 24 23:25:33.441562 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.441533 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8"} err="failed to get container status \"fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8\": rpc error: code = NotFound desc = could not find container \"fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8\": container with ID starting with fd988832d92c0587d30a3dc842df097ab4e2eff48322791ac738c85cdb6e74b8 not found: ID does not exist" Jul 24 23:25:33.441562 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.441549 2585 scope.go:117] "RemoveContainer" containerID="9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091" Jul 24 23:25:33.441779 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:25:33.441756 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091\": container with ID starting with 9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091 not found: ID does not exist" containerID="9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091" Jul 24 23:25:33.441888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.441783 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091"} err="failed to get container status \"9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091\": rpc error: code = NotFound desc = could not find container \"9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091\": container with ID starting with 9a3e808986453df6bfba2e8b7227f4d67b55e56aab0f68690cd0e7568c62f091 not found: ID does not exist" Jul 24 23:25:33.445667 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.445646 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx"] Jul 24 23:25:33.449585 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:33.449566 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-3b391a-openshift-default-869fb86b56-z5jkx"] Jul 24 23:25:34.056556 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:34.056513 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" path="/var/lib/kubelet/pods/0da2a9c4-b243-40c8-9e44-3eeb285d2492/volumes" Jul 24 23:25:49.249199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:49.249157 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9"] Jul 24 23:25:49.249931 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:49.249406 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" containerID="cri-o://5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265" gracePeriod=30 Jul 24 23:25:50.105178 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105147 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45"] Jul 24 23:25:50.105513 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105502 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" Jul 24 23:25:50.105574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105517 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" Jul 24 23:25:50.105574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105526 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" Jul 24 23:25:50.105574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105532 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" Jul 24 23:25:50.105669 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105604 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" Jul 24 23:25:50.105669 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.105613 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da2a9c4-b243-40c8-9e44-3eeb285d2492" containerName="istio-proxy" Jul 24 23:25:50.108895 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.108874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.111250 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.111227 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4ab9b5-openshift-default-dockercfg-6xcnw\"" Jul 24 23:25:50.120275 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.120254 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45"] Jul 24 23:25:50.147298 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-envoy\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147409 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147303 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x54vc\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-kube-api-access-x54vc\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147409 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147337 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-certs\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147409 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147370 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-credential-socket\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147432 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-socket\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147478 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-data\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147502 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-istio-token\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147637 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147531 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d968eb1-8914-403b-a623-b193486c4e22-istiod-ca-cert\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.147637 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.147568 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d968eb1-8914-403b-a623-b193486c4e22-istio-podinfo\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248080 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248046 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-credential-socket\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248089 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-socket\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248119 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-data\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-istio-token\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248151 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d968eb1-8914-403b-a623-b193486c4e22-istiod-ca-cert\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d968eb1-8914-403b-a623-b193486c4e22-istio-podinfo\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248224 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-envoy\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248555 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248261 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x54vc\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-kube-api-access-x54vc\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248555 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248307 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-certs\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248555 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248514 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-credential-socket\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248710 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248598 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-socket\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248710 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248624 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-data\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.248710 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.248643 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-certs\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.249088 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.249066 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d968eb1-8914-403b-a623-b193486c4e22-istiod-ca-cert\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.250556 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.250537 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-envoy\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.250907 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.250667 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d968eb1-8914-403b-a623-b193486c4e22-istio-podinfo\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.255841 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.255819 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-istio-token\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.256009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.255991 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x54vc\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-kube-api-access-x54vc\") pod \"e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.421229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.421139 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:50.555359 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.555331 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45"] Jul 24 23:25:50.556415 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:25:50.556390 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d968eb1_8914_403b_a623_b193486c4e22.slice/crio-36db8db463eb17a416d703358d45746a02d3deb7ae9cb1388197beffbb74d60e WatchSource:0}: Error finding container 36db8db463eb17a416d703358d45746a02d3deb7ae9cb1388197beffbb74d60e: Status 404 returned error can't find the container with id 36db8db463eb17a416d703358d45746a02d3deb7ae9cb1388197beffbb74d60e Jul 24 23:25:50.558529 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.558497 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:25:50.558611 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.558561 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:25:50.558611 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:50.558589 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:25:51.521751 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:51.521720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" event={"ID":"9d968eb1-8914-403b-a623-b193486c4e22","Type":"ContainerStarted","Data":"3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c"} Jul 24 23:25:51.522138 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:51.521772 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" event={"ID":"9d968eb1-8914-403b-a623-b193486c4e22","Type":"ContainerStarted","Data":"36db8db463eb17a416d703358d45746a02d3deb7ae9cb1388197beffbb74d60e"} Jul 24 23:25:51.545631 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:51.545590 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podStartSLOduration=1.5455750780000002 podStartE2EDuration="1.545575078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:25:51.543553507 +0000 UTC m=+2378.007741932" watchObservedRunningTime="2026-07-24 23:25:51.545575078 +0000 UTC m=+2378.009763501" Jul 24 23:25:52.421856 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:52.421826 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:52.426597 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:52.426571 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:52.526601 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:52.526571 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:52.527321 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:52.527301 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:25:52.997032 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:52.996993 2585 patch_prober.go:28] interesting pod/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 23:25:52.997186 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:52.997059 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 23:25:54.501228 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.501201 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:25:54.538577 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.538504 2585 generic.go:356] "Generic (PLEG): container finished" podID="94520248-ade1-46ec-9868-23ffaf46816f" containerID="5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265" exitCode=0 Jul 24 23:25:54.538855 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.538584 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" Jul 24 23:25:54.539004 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.538599 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" event={"ID":"94520248-ade1-46ec-9868-23ffaf46816f","Type":"ContainerDied","Data":"5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265"} Jul 24 23:25:54.539004 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.538959 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9" event={"ID":"94520248-ade1-46ec-9868-23ffaf46816f","Type":"ContainerDied","Data":"0941a85a2a843829127663642c8a7acc51b5e2a766e14e4073423b50faf74d4e"} Jul 24 23:25:54.539126 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.538992 2585 scope.go:117] "RemoveContainer" containerID="5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265" Jul 24 23:25:54.550853 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.550788 2585 scope.go:117] "RemoveContainer" containerID="d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d" Jul 24 23:25:54.561383 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.561363 2585 scope.go:117] "RemoveContainer" containerID="5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265" Jul 24 23:25:54.561678 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:25:54.561660 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265\": container with ID starting with 5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265 not found: ID does not exist" containerID="5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265" Jul 24 23:25:54.561746 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.561685 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265"} err="failed to get container status \"5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265\": rpc error: code = NotFound desc = could not find container \"5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265\": container with ID starting with 5722b6805fdf4a99e3f18d5a4e907917f0324a86ad53a312b41d983ca6de6265 not found: ID does not exist" Jul 24 23:25:54.561746 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.561704 2585 scope.go:117] "RemoveContainer" containerID="d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d" Jul 24 23:25:54.561986 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:25:54.561968 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d\": container with ID starting with d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d not found: ID does not exist" containerID="d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d" Jul 24 23:25:54.562056 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.561990 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d"} err="failed to get container status \"d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d\": rpc error: code = NotFound desc = could not find container \"d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d\": container with ID starting with d450b56689d303a10dadcfd9a852ce8be329d86feb53b0f159d07195d4ae149d not found: ID does not exist" Jul 24 23:25:54.587882 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587856 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-istio-token\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587891 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-certs\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587912 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94520248-ade1-46ec-9868-23ffaf46816f-istio-podinfo\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587930 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-data\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587947 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgn2q\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-kube-api-access-xgn2q\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587965 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94520248-ade1-46ec-9868-23ffaf46816f-istiod-ca-cert\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.587998 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-credential-socket\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588325 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588100 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-socket\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588325 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588157 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-envoy\") pod \"94520248-ade1-46ec-9868-23ffaf46816f\" (UID: \"94520248-ade1-46ec-9868-23ffaf46816f\") " Jul 24 23:25:54.588325 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588222 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:54.588483 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588361 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:54.588483 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588441 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:54.588583 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588529 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94520248-ade1-46ec-9868-23ffaf46816f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:25:54.588713 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588696 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.588785 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588717 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.588785 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588730 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94520248-ade1-46ec-9868-23ffaf46816f-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.588785 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588742 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.588969 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.588925 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-data" (OuterVolumeSpecName: "istio-data") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:54.590220 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.590196 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-istio-token" (OuterVolumeSpecName: "istio-token") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:25:54.590542 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.590514 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-kube-api-access-xgn2q" (OuterVolumeSpecName: "kube-api-access-xgn2q") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "kube-api-access-xgn2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:25:54.590542 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.590537 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:25:54.590685 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.590620 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94520248-ade1-46ec-9868-23ffaf46816f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94520248-ade1-46ec-9868-23ffaf46816f" (UID: "94520248-ade1-46ec-9868-23ffaf46816f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:25:54.689906 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.689861 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.689906 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.689900 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.689906 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.689909 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94520248-ade1-46ec-9868-23ffaf46816f-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.689906 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.689919 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94520248-ade1-46ec-9868-23ffaf46816f-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.690165 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.689927 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgn2q\" (UniqueName: \"kubernetes.io/projected/94520248-ade1-46ec-9868-23ffaf46816f-kube-api-access-xgn2q\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:25:54.861479 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.861446 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9"] Jul 24 23:25:54.864751 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:54.864728 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-313c6a-openshift-default-7fd659b8c8-5wjb9"] Jul 24 23:25:56.052447 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:56.052411 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94520248-ade1-46ec-9868-23ffaf46816f" path="/var/lib/kubelet/pods/94520248-ade1-46ec-9868-23ffaf46816f/volumes" Jul 24 23:25:58.649459 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.649425 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t"] Jul 24 23:25:58.650046 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.650025 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" Jul 24 23:25:58.650131 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.650048 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" Jul 24 23:25:58.650131 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.650070 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" Jul 24 23:25:58.650131 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.650078 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" Jul 24 23:25:58.650293 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.650166 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" Jul 24 23:25:58.650293 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.650181 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="94520248-ade1-46ec-9868-23ffaf46816f" containerName="istio-proxy" Jul 24 23:25:58.654953 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.654928 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.657232 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.657205 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-569db3-openshift-default-dockercfg-qgr27\"" Jul 24 23:25:58.664635 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.664611 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t"] Jul 24 23:25:58.732639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732600 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-certs\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732639 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732641 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-data\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732681 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-envoy\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732707 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-socket\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732733 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54832f8-10b6-436c-9460-382c30f58a7b-istio-podinfo\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732756 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b45z\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-kube-api-access-7b45z\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732781 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54832f8-10b6-436c-9460-382c30f58a7b-istiod-ca-cert\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.732880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732830 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-istio-token\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.733077 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.732909 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-credential-socket\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.833994 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.833959 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-istio-token\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834003 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-credential-socket\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834035 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-certs\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834064 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-data\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834104 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-envoy\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834127 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-socket\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834169 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54832f8-10b6-436c-9460-382c30f58a7b-istio-podinfo\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834509 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b45z\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-kube-api-access-7b45z\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834509 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54832f8-10b6-436c-9460-382c30f58a7b-istiod-ca-cert\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834509 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834437 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-credential-socket\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834625 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834517 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-certs\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834625 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834571 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-data\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834756 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834636 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-socket\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.834918 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.834901 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54832f8-10b6-436c-9460-382c30f58a7b-istiod-ca-cert\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.836421 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.836391 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-envoy\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.836877 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.836852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54832f8-10b6-436c-9460-382c30f58a7b-istio-podinfo\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.841718 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.841695 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-istio-token\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.841969 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.841951 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b45z\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-kube-api-access-7b45z\") pod \"e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:58.968244 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:58.968175 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:25:59.105131 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.105102 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t"] Jul 24 23:25:59.106314 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:25:59.106289 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54832f8_10b6_436c_9460_382c30f58a7b.slice/crio-ba353954337eabb66766f67cf3bc4e8aee397bb04bc3d189b2bbf23b95ea3e61 WatchSource:0}: Error finding container ba353954337eabb66766f67cf3bc4e8aee397bb04bc3d189b2bbf23b95ea3e61: Status 404 returned error can't find the container with id ba353954337eabb66766f67cf3bc4e8aee397bb04bc3d189b2bbf23b95ea3e61 Jul 24 23:25:59.108870 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.108840 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:25:59.108940 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.108905 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:25:59.108977 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.108938 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:25:59.567624 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.567578 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" event={"ID":"a54832f8-10b6-436c-9460-382c30f58a7b","Type":"ContainerStarted","Data":"e3ddbfc7fe244cd7d0eb0aa2922150610753dd47aafb8a513db7f156c2db6826"} Jul 24 23:25:59.567807 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.567643 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" event={"ID":"a54832f8-10b6-436c-9460-382c30f58a7b","Type":"ContainerStarted","Data":"ba353954337eabb66766f67cf3bc4e8aee397bb04bc3d189b2bbf23b95ea3e61"} Jul 24 23:25:59.586785 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.586731 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podStartSLOduration=1.5867159100000001 podStartE2EDuration="1.58671591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:25:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:25:59.584860422 +0000 UTC m=+2386.049048847" watchObservedRunningTime="2026-07-24 23:25:59.58671591 +0000 UTC m=+2386.050904334" Jul 24 23:25:59.968998 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:25:59.968917 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:00.974228 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:00.974196 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:01.582541 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:01.582506 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:01.584097 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:01.584069 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:08.092400 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.091310 2585 patch_prober.go:28] interesting pod/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:42328->10.133.0.60:15021: read: connection reset by peer" start-of-body= Jul 24 23:26:08.092400 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.091388 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:42328->10.133.0.60:15021: read: connection reset by peer" Jul 24 23:26:08.628396 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.628366 2585 generic.go:356] "Generic (PLEG): container finished" podID="9d968eb1-8914-403b-a623-b193486c4e22" containerID="3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c" exitCode=0 Jul 24 23:26:08.628569 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.628446 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" event={"ID":"9d968eb1-8914-403b-a623-b193486c4e22","Type":"ContainerDied","Data":"3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c"} Jul 24 23:26:08.628934 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.628911 2585 scope.go:117] "RemoveContainer" containerID="3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c" Jul 24 23:26:08.630009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.629985 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:26:08.630069 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.630051 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:26:08.630104 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:08.630080 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:26:09.635946 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:09.635910 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" event={"ID":"9d968eb1-8914-403b-a623-b193486c4e22","Type":"ContainerStarted","Data":"4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99"} Jul 24 23:26:10.421868 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:10.421833 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:26:10.422068 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:10.421996 2585 patch_prober.go:28] interesting pod/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 24 23:26:10.422068 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:10.422052 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 24 23:26:11.422399 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:11.422360 2585 patch_prober.go:28] interesting pod/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 24 23:26:11.423415 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:11.422991 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 24 23:26:12.422820 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:12.422131 2585 patch_prober.go:28] interesting pod/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 24 23:26:12.422820 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:12.422192 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 24 23:26:13.424484 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:13.424452 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:26:13.424982 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:13.424772 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:26:13.425507 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:13.425489 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:26:17.458196 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.456931 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:36116->10.133.0.61:15021: read: connection reset by peer" start-of-body= Jul 24 23:26:17.458196 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.456994 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:36116->10.133.0.61:15021: read: connection reset by peer" Jul 24 23:26:17.683181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.683111 2585 generic.go:356] "Generic (PLEG): container finished" podID="a54832f8-10b6-436c-9460-382c30f58a7b" containerID="e3ddbfc7fe244cd7d0eb0aa2922150610753dd47aafb8a513db7f156c2db6826" exitCode=0 Jul 24 23:26:17.683322 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.683187 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" event={"ID":"a54832f8-10b6-436c-9460-382c30f58a7b","Type":"ContainerDied","Data":"e3ddbfc7fe244cd7d0eb0aa2922150610753dd47aafb8a513db7f156c2db6826"} Jul 24 23:26:17.683575 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.683559 2585 scope.go:117] "RemoveContainer" containerID="e3ddbfc7fe244cd7d0eb0aa2922150610753dd47aafb8a513db7f156c2db6826" Jul 24 23:26:17.684567 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.684535 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:26:17.684664 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.684605 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:26:17.684664 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:17.684634 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:26:18.691743 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:18.691707 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" event={"ID":"a54832f8-10b6-436c-9460-382c30f58a7b","Type":"ContainerStarted","Data":"05ebe6ed510d8d65e4dfad7b51966b74b9917fc3023e2585ccea967d6bfa747e"} Jul 24 23:26:18.969015 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:18.968926 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:18.969197 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:18.969071 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 24 23:26:18.969197 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:18.969138 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 24 23:26:19.969505 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:19.969467 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 24 23:26:19.969906 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:19.969546 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 24 23:26:20.969314 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:20.969283 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 24 23:26:20.969498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:20.969341 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 24 23:26:21.968477 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:21.968445 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 24 23:26:21.968938 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:21.968502 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 24 23:26:22.969502 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:22.969463 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 24 23:26:22.969924 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:22.969517 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 24 23:26:23.972842 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:23.972784 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:23.973250 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:23.973192 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:23.973960 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:23.973940 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:26:40.214727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:40.214636 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45"] Jul 24 23:26:40.215328 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:40.214879 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" containerID="cri-o://4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99" gracePeriod=30 Jul 24 23:26:43.427131 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:43.427088 2585 patch_prober.go:28] interesting pod/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 23:26:43.427581 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:43.427163 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 23:26:45.473719 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.473694 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:26:45.571481 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571451 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x54vc\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-kube-api-access-x54vc\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.571481 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571489 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d968eb1-8914-403b-a623-b193486c4e22-istio-podinfo\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.571727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571521 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-istio-token\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.571727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571560 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-envoy\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.571727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571587 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-data\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.571727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571626 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-certs\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.571727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571661 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d968eb1-8914-403b-a623-b193486c4e22-istiod-ca-cert\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.572030 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571738 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-credential-socket\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.572030 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.571782 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-socket\") pod \"9d968eb1-8914-403b-a623-b193486c4e22\" (UID: \"9d968eb1-8914-403b-a623-b193486c4e22\") " Jul 24 23:26:45.572143 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.572113 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:26:45.572215 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.572131 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d968eb1-8914-403b-a623-b193486c4e22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:26:45.572359 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.572335 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:26:45.572697 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.572671 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:26:45.572697 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.572685 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:26:45.573841 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.573811 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-kube-api-access-x54vc" (OuterVolumeSpecName: "kube-api-access-x54vc") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "kube-api-access-x54vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:26:45.573934 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.573888 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:26:45.573934 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.573901 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:26:45.574143 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.574116 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d968eb1-8914-403b-a623-b193486c4e22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d968eb1-8914-403b-a623-b193486c4e22" (UID: "9d968eb1-8914-403b-a623-b193486c4e22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:26:45.673510 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673473 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d968eb1-8914-403b-a623-b193486c4e22-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673510 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673502 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673510 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673512 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673521 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x54vc\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-kube-api-access-x54vc\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673532 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d968eb1-8914-403b-a623-b193486c4e22-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673540 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d968eb1-8914-403b-a623-b193486c4e22-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673547 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673554 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.673740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.673562 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d968eb1-8914-403b-a623-b193486c4e22-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:26:45.842267 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.842180 2585 generic.go:356] "Generic (PLEG): container finished" podID="9d968eb1-8914-403b-a623-b193486c4e22" containerID="4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99" exitCode=0 Jul 24 23:26:45.842267 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.842235 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" Jul 24 23:26:45.842450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.842265 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" event={"ID":"9d968eb1-8914-403b-a623-b193486c4e22","Type":"ContainerDied","Data":"4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99"} Jul 24 23:26:45.842450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.842319 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45" event={"ID":"9d968eb1-8914-403b-a623-b193486c4e22","Type":"ContainerDied","Data":"36db8db463eb17a416d703358d45746a02d3deb7ae9cb1388197beffbb74d60e"} Jul 24 23:26:45.842450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.842340 2585 scope.go:117] "RemoveContainer" containerID="4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99" Jul 24 23:26:45.851656 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.851638 2585 scope.go:117] "RemoveContainer" containerID="3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c" Jul 24 23:26:45.860010 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.859995 2585 scope.go:117] "RemoveContainer" containerID="4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99" Jul 24 23:26:45.860254 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:26:45.860237 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99\": container with ID starting with 4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99 not found: ID does not exist" containerID="4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99" Jul 24 23:26:45.860330 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.860265 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99"} err="failed to get container status \"4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99\": rpc error: code = NotFound desc = could not find container \"4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99\": container with ID starting with 4539477c98bca4b3f3709d4d7ecc7d3c550299c110ee0975c0971b1dd76b1d99 not found: ID does not exist" Jul 24 23:26:45.860330 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.860287 2585 scope.go:117] "RemoveContainer" containerID="3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c" Jul 24 23:26:45.860534 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:26:45.860515 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c\": container with ID starting with 3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c not found: ID does not exist" containerID="3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c" Jul 24 23:26:45.860578 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.860540 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c"} err="failed to get container status \"3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c\": rpc error: code = NotFound desc = could not find container \"3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c\": container with ID starting with 3d02f5c52d4b41f9f769a419f855687a1aac180006e51308ff71e2c57886d35c not found: ID does not exist" Jul 24 23:26:45.864596 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.864576 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45"] Jul 24 23:26:45.868094 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:45.868072 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4ab9b5-openshift-default-8486f6984b-6zg45"] Jul 24 23:26:46.053339 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:26:46.053307 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d968eb1-8914-403b-a623-b193486c4e22" path="/var/lib/kubelet/pods/9d968eb1-8914-403b-a623-b193486c4e22/volumes" Jul 24 23:27:06.878993 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:06.878950 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t"] Jul 24 23:27:06.879603 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:06.879203 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" containerID="cri-o://05ebe6ed510d8d65e4dfad7b51966b74b9917fc3023e2585ccea967d6bfa747e" gracePeriod=30 Jul 24 23:27:07.753101 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.753059 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p"] Jul 24 23:27:07.753489 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.753475 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" Jul 24 23:27:07.753489 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.753489 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" Jul 24 23:27:07.753632 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.753502 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" Jul 24 23:27:07.753632 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.753508 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" Jul 24 23:27:07.753632 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.753572 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" Jul 24 23:27:07.756624 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.756605 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.759181 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.759163 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5c850d-openshift-default-dockercfg-9dbfx\"" Jul 24 23:27:07.767530 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.767509 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p"] Jul 24 23:27:07.868622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b7bd9-6e23-43ed-b9d2-b759a362df18-istiod-ca-cert\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868791 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868635 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-data\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868791 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868708 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-envoy\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868791 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868733 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-credential-socket\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868791 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gc4d\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-kube-api-access-6gc4d\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868964 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868814 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-certs\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868964 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868861 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-token\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868964 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-socket\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.868964 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.868912 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-podinfo\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970020 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.969990 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-data\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970032 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-envoy\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970051 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-credential-socket\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970166 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gc4d\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-kube-api-access-6gc4d\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-certs\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970257 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-token\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-socket\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970299 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-podinfo\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970414 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-credential-socket\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970863 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970496 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-data\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970863 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970617 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-certs\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970863 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970633 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-socket\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.970863 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.970822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b7bd9-6e23-43ed-b9d2-b759a362df18-istiod-ca-cert\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.971509 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.971484 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b7bd9-6e23-43ed-b9d2-b759a362df18-istiod-ca-cert\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.972828 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.972773 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-envoy\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.973014 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.972997 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-podinfo\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.977666 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.977638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-token\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:07.978320 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:07.978301 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gc4d\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-kube-api-access-6gc4d\") pod \"e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:08.067324 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.067252 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:08.204461 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.204437 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p"] Jul 24 23:27:08.205724 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:27:08.205695 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478b7bd9_6e23_43ed_b9d2_b759a362df18.slice/crio-054beb5b0af76a852708bf962365d7390877461d85f8fd3428d21c98b66408d5 WatchSource:0}: Error finding container 054beb5b0af76a852708bf962365d7390877461d85f8fd3428d21c98b66408d5: Status 404 returned error can't find the container with id 054beb5b0af76a852708bf962365d7390877461d85f8fd3428d21c98b66408d5 Jul 24 23:27:08.207962 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.207925 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:08.208056 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.207997 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:08.208056 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.208031 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:08.976630 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.976595 2585 patch_prober.go:28] interesting pod/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 23:27:08.977102 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.976672 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 23:27:08.977169 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.977145 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" event={"ID":"478b7bd9-6e23-43ed-b9d2-b759a362df18","Type":"ContainerStarted","Data":"16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3"} Jul 24 23:27:08.977211 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.977201 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" event={"ID":"478b7bd9-6e23-43ed-b9d2-b759a362df18","Type":"ContainerStarted","Data":"054beb5b0af76a852708bf962365d7390877461d85f8fd3428d21c98b66408d5"} Jul 24 23:27:08.997286 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:08.997232 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podStartSLOduration=1.997216535 podStartE2EDuration="1.997216535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:27:08.99521591 +0000 UTC m=+2455.459404335" watchObservedRunningTime="2026-07-24 23:27:08.997216535 +0000 UTC m=+2455.461404959" Jul 24 23:27:09.067746 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:09.067711 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:09.072495 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:09.072467 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:09.984141 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:09.984103 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:09.985211 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:09.985191 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:11.997003 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:11.996975 2585 generic.go:356] "Generic (PLEG): container finished" podID="a54832f8-10b6-436c-9460-382c30f58a7b" containerID="05ebe6ed510d8d65e4dfad7b51966b74b9917fc3023e2585ccea967d6bfa747e" exitCode=0 Jul 24 23:27:11.997383 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:11.997044 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" event={"ID":"a54832f8-10b6-436c-9460-382c30f58a7b","Type":"ContainerDied","Data":"05ebe6ed510d8d65e4dfad7b51966b74b9917fc3023e2585ccea967d6bfa747e"} Jul 24 23:27:11.997383 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:11.997108 2585 scope.go:117] "RemoveContainer" containerID="e3ddbfc7fe244cd7d0eb0aa2922150610753dd47aafb8a513db7f156c2db6826" Jul 24 23:27:12.135882 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.135851 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:27:12.311233 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311198 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-istio-token\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.311233 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311234 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-envoy\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.311498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311254 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-socket\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.311498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311274 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b45z\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-kube-api-access-7b45z\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.311498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311294 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-data\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.311498 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311407 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-credential-socket\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.311970 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.311942 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54832f8-10b6-436c-9460-382c30f58a7b-istio-podinfo\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.312149 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.312134 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-certs\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.312307 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.312291 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54832f8-10b6-436c-9460-382c30f58a7b-istiod-ca-cert\") pod \"a54832f8-10b6-436c-9460-382c30f58a7b\" (UID: \"a54832f8-10b6-436c-9460-382c30f58a7b\") " Jul 24 23:27:12.312554 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.312069 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:27:12.312631 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.312149 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:27:12.312631 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.312514 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:27:12.313160 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.313137 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.313290 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.313275 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.313387 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.313373 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.313897 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.313874 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54832f8-10b6-436c-9460-382c30f58a7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:27:12.314215 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.314169 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:27:12.314315 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.314284 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:27:12.314424 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.314407 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:27:12.321952 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.321816 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a54832f8-10b6-436c-9460-382c30f58a7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:27:12.322366 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.322216 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-kube-api-access-7b45z" (OuterVolumeSpecName: "kube-api-access-7b45z") pod "a54832f8-10b6-436c-9460-382c30f58a7b" (UID: "a54832f8-10b6-436c-9460-382c30f58a7b"). InnerVolumeSpecName "kube-api-access-7b45z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:27:12.414679 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.414642 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54832f8-10b6-436c-9460-382c30f58a7b-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.414679 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.414671 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.414679 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.414680 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54832f8-10b6-436c-9460-382c30f58a7b-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.414679 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.414688 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.414980 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.414695 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54832f8-10b6-436c-9460-382c30f58a7b-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:12.414980 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:12.414704 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b45z\" (UniqueName: \"kubernetes.io/projected/a54832f8-10b6-436c-9460-382c30f58a7b-kube-api-access-7b45z\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:27:13.004533 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:13.004498 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" event={"ID":"a54832f8-10b6-436c-9460-382c30f58a7b","Type":"ContainerDied","Data":"ba353954337eabb66766f67cf3bc4e8aee397bb04bc3d189b2bbf23b95ea3e61"} Jul 24 23:27:13.005000 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:13.004546 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t" Jul 24 23:27:13.005000 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:13.004585 2585 scope.go:117] "RemoveContainer" containerID="05ebe6ed510d8d65e4dfad7b51966b74b9917fc3023e2585ccea967d6bfa747e" Jul 24 23:27:13.028673 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:13.028640 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t"] Jul 24 23:27:13.031755 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:13.031732 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-569db3-openshift-default-6594fd4968-xxd4t"] Jul 24 23:27:14.052898 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:14.052867 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" path="/var/lib/kubelet/pods/a54832f8-10b6-436c-9460-382c30f58a7b/volumes" Jul 24 23:27:15.990085 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990055 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz"] Jul 24 23:27:15.990542 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990491 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" Jul 24 23:27:15.990542 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990503 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" Jul 24 23:27:15.990542 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990522 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" Jul 24 23:27:15.990542 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990530 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" Jul 24 23:27:15.990754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990585 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" Jul 24 23:27:15.990754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.990600 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d968eb1-8914-403b-a623-b193486c4e22" containerName="istio-proxy" Jul 24 23:27:15.995259 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.995235 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:15.998074 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:15.998052 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d08a26-openshift-default-dockercfg-hzts6\"" Jul 24 23:27:16.004254 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.004068 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz"] Jul 24 23:27:16.046894 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.046870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-podinfo\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047029 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.046898 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-data\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047029 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.046931 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-envoy\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047029 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.046986 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-token\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047029 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.047020 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-certs\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047168 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.047053 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-credential-socket\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047168 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.047080 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad7edc11-13c0-432e-8f08-ba4625d12b01-istiod-ca-cert\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047168 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.047102 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-socket\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.047262 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.047186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smbqw\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-kube-api-access-smbqw\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.147732 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147702 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-podinfo\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.147732 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147735 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-data\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.147951 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147850 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-envoy\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.147951 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-token\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.147951 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147932 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-certs\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148086 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147955 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-credential-socket\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148086 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.147997 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad7edc11-13c0-432e-8f08-ba4625d12b01-istiod-ca-cert\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148086 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148033 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-socket\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148092 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbqw\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-kube-api-access-smbqw\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148164 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-data\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148374 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148273 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-certs\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148374 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148350 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-credential-socket\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148488 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148467 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-socket\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.148739 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.148712 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad7edc11-13c0-432e-8f08-ba4625d12b01-istiod-ca-cert\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.150315 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.150288 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-podinfo\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.150416 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.150406 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-envoy\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.155945 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.155916 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-token\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.156046 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.156015 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smbqw\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-kube-api-access-smbqw\") pod \"e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.308126 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.308046 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:16.445260 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.445228 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz"] Jul 24 23:27:16.445438 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:27:16.445414 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7edc11_13c0_432e_8f08_ba4625d12b01.slice/crio-142da57df56f40142c5acab21c78701d0368a9adb28f63a3a0d1a7e8413b9c04 WatchSource:0}: Error finding container 142da57df56f40142c5acab21c78701d0368a9adb28f63a3a0d1a7e8413b9c04: Status 404 returned error can't find the container with id 142da57df56f40142c5acab21c78701d0368a9adb28f63a3a0d1a7e8413b9c04 Jul 24 23:27:16.447628 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.447587 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:16.447724 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.447656 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:16.447724 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:16.447682 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:17.029299 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:17.029257 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" event={"ID":"ad7edc11-13c0-432e-8f08-ba4625d12b01","Type":"ContainerStarted","Data":"32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b"} Jul 24 23:27:17.029706 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:17.029343 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" event={"ID":"ad7edc11-13c0-432e-8f08-ba4625d12b01","Type":"ContainerStarted","Data":"142da57df56f40142c5acab21c78701d0368a9adb28f63a3a0d1a7e8413b9c04"} Jul 24 23:27:17.051097 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:17.051049 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podStartSLOduration=2.051034304 podStartE2EDuration="2.051034304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:27:17.047921804 +0000 UTC m=+2463.512110242" watchObservedRunningTime="2026-07-24 23:27:17.051034304 +0000 UTC m=+2463.515222729" Jul 24 23:27:17.308605 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:17.308513 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:17.313291 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:17.313265 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:18.034385 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:18.034347 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:18.035434 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:18.035415 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:26.025982 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:26.025942 2585 patch_prober.go:28] interesting pod/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 23:27:26.026396 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:26.025999 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 23:27:28.091687 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:28.091655 2585 generic.go:356] "Generic (PLEG): container finished" podID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerID="16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3" exitCode=0 Jul 24 23:27:28.092123 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:28.091712 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" event={"ID":"478b7bd9-6e23-43ed-b9d2-b759a362df18","Type":"ContainerDied","Data":"16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3"} Jul 24 23:27:28.092123 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:28.092006 2585 scope.go:117] "RemoveContainer" containerID="16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3" Jul 24 23:27:28.092960 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:28.092930 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:28.093068 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:28.093012 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:28.093068 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:28.093063 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:29.112255 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:29.112221 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" event={"ID":"478b7bd9-6e23-43ed-b9d2-b759a362df18","Type":"ContainerStarted","Data":"82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f"} Jul 24 23:27:30.067930 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:30.067898 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:30.068160 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:30.068136 2585 patch_prober.go:28] interesting pod/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 24 23:27:30.068253 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:30.068190 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 24 23:27:31.067655 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:31.067616 2585 patch_prober.go:28] interesting pod/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 24 23:27:31.068100 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:31.067675 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 24 23:27:32.068186 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:32.068150 2585 patch_prober.go:28] interesting pod/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 24 23:27:32.068585 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:32.068201 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 24 23:27:33.067953 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:33.067916 2585 patch_prober.go:28] interesting pod/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 24 23:27:33.068115 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:33.067984 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 24 23:27:34.071310 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:34.071272 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:34.071773 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:34.071750 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:34.072437 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:34.072412 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:27:34.075891 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:34.075870 2585 patch_prober.go:28] interesting pod/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 23:27:34.075978 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:34.075919 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 23:27:35.155536 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:35.155511 2585 generic.go:356] "Generic (PLEG): container finished" podID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerID="32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b" exitCode=0 Jul 24 23:27:35.155886 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:35.155579 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" event={"ID":"ad7edc11-13c0-432e-8f08-ba4625d12b01","Type":"ContainerDied","Data":"32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b"} Jul 24 23:27:35.156059 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:35.156043 2585 scope.go:117] "RemoveContainer" containerID="32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b" Jul 24 23:27:35.157039 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:35.157008 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:35.157113 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:35.157074 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:35.157113 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:35.157106 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:27:36.163479 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:36.163436 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" event={"ID":"ad7edc11-13c0-432e-8f08-ba4625d12b01","Type":"ContainerStarted","Data":"6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856"} Jul 24 23:27:36.308874 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:36.308825 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:36.309101 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:36.309074 2585 patch_prober.go:28] interesting pod/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 24 23:27:36.309190 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:36.309132 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 24 23:27:37.309088 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:37.309051 2585 patch_prober.go:28] interesting pod/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 24 23:27:37.309465 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:37.309112 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 24 23:27:38.308551 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:38.308511 2585 patch_prober.go:28] interesting pod/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 24 23:27:38.308723 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:38.308567 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 24 23:27:39.309063 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:39.309021 2585 patch_prober.go:28] interesting pod/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 24 23:27:39.309454 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:39.309078 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 24 23:27:40.311983 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:40.311952 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:40.312440 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:40.312236 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:27:40.312882 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:27:40.312865 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:30:15.050124 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.050089 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9"] Jul 24 23:30:15.050677 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.050658 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54832f8-10b6-436c-9460-382c30f58a7b" containerName="istio-proxy" Jul 24 23:30:15.052695 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.052679 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.055342 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.055320 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5c850d\"/\"openshift-service-ca.crt\"" Jul 24 23:30:15.056344 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.056328 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5c850d\"/\"kube-root-ca.crt\"" Jul 24 23:30:15.056463 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.056417 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5c850d\"/\"sub-test-model-5c850d-kserve-self-signed-certs\"" Jul 24 23:30:15.056531 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.056479 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5c850d\"/\"default-dockercfg-g4tk7\"" Jul 24 23:30:15.064013 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.063993 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9"] Jul 24 23:30:15.161931 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.161904 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-tmp-dir\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.162060 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.161935 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85ls\" (UniqueName: \"kubernetes.io/projected/ed9a45a0-5618-4bb3-a153-97403f5d2183-kube-api-access-f85ls\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.162060 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.161966 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-model-cache\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.162060 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.162044 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-dshm\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.162230 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.162138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed9a45a0-5618-4bb3-a153-97403f5d2183-tls-certs\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.162230 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.162177 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-home\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.263613 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.263582 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-model-cache\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.263845 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.263648 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-dshm\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.263845 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.263710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed9a45a0-5618-4bb3-a153-97403f5d2183-tls-certs\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.263845 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.263727 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-home\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.263845 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.263753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-tmp-dir\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.263845 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.263783 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85ls\" (UniqueName: \"kubernetes.io/projected/ed9a45a0-5618-4bb3-a153-97403f5d2183-kube-api-access-f85ls\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.264141 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.264109 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-model-cache\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.264189 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.264147 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-home\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.264247 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.264225 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-tmp-dir\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.266121 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.266095 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-dshm\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.266336 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.266319 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed9a45a0-5618-4bb3-a153-97403f5d2183-tls-certs\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.271407 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.271380 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85ls\" (UniqueName: \"kubernetes.io/projected/ed9a45a0-5618-4bb3-a153-97403f5d2183-kube-api-access-f85ls\") pod \"sub-test-model-5c850d-kserve-796c694dcc-5qbb9\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.363911 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.363845 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:15.494718 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:15.494686 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9"] Jul 24 23:30:15.495471 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:30:15.495442 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded9a45a0_5618_4bb3_a153_97403f5d2183.slice/crio-ba9fdb31deaf1add84f001edcbff849aa7a871fa14f0e3457df004724d8d1ef1 WatchSource:0}: Error finding container ba9fdb31deaf1add84f001edcbff849aa7a871fa14f0e3457df004724d8d1ef1: Status 404 returned error can't find the container with id ba9fdb31deaf1add84f001edcbff849aa7a871fa14f0e3457df004724d8d1ef1 Jul 24 23:30:16.069389 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:16.069345 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" event={"ID":"ed9a45a0-5618-4bb3-a153-97403f5d2183","Type":"ContainerStarted","Data":"57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2"} Jul 24 23:30:16.069389 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:16.069393 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" event={"ID":"ed9a45a0-5618-4bb3-a153-97403f5d2183","Type":"ContainerStarted","Data":"ba9fdb31deaf1add84f001edcbff849aa7a871fa14f0e3457df004724d8d1ef1"} Jul 24 23:30:16.085321 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:16.085276 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" podStartSLOduration=1.085262835 podStartE2EDuration="1.085262835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:30:16.084590472 +0000 UTC m=+2642.548778899" watchObservedRunningTime="2026-07-24 23:30:16.085262835 +0000 UTC m=+2642.549451330" Jul 24 23:30:25.364523 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:25.364492 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:25.365053 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:25.364758 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:25.377049 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:25.377026 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:30:26.132452 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:30:26.132423 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:31:21.402670 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:21.402618 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9"] Jul 24 23:31:36.423918 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.423865 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" podUID="ed9a45a0-5618-4bb3-a153-97403f5d2183" containerName="main" containerID="cri-o://57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2" gracePeriod=45 Jul 24 23:31:36.682166 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.682109 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:31:36.821389 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821359 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f85ls\" (UniqueName: \"kubernetes.io/projected/ed9a45a0-5618-4bb3-a153-97403f5d2183-kube-api-access-f85ls\") pod \"ed9a45a0-5618-4bb3-a153-97403f5d2183\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " Jul 24 23:31:36.821574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821415 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-tmp-dir\") pod \"ed9a45a0-5618-4bb3-a153-97403f5d2183\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " Jul 24 23:31:36.821574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821455 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-home\") pod \"ed9a45a0-5618-4bb3-a153-97403f5d2183\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " Jul 24 23:31:36.821574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821484 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed9a45a0-5618-4bb3-a153-97403f5d2183-tls-certs\") pod \"ed9a45a0-5618-4bb3-a153-97403f5d2183\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " Jul 24 23:31:36.821574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821499 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-dshm\") pod \"ed9a45a0-5618-4bb3-a153-97403f5d2183\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " Jul 24 23:31:36.821574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821518 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-model-cache\") pod \"ed9a45a0-5618-4bb3-a153-97403f5d2183\" (UID: \"ed9a45a0-5618-4bb3-a153-97403f5d2183\") " Jul 24 23:31:36.821849 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821719 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-home" (OuterVolumeSpecName: "home") pod "ed9a45a0-5618-4bb3-a153-97403f5d2183" (UID: "ed9a45a0-5618-4bb3-a153-97403f5d2183"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:31:36.821849 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821752 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed9a45a0-5618-4bb3-a153-97403f5d2183" (UID: "ed9a45a0-5618-4bb3-a153-97403f5d2183"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:31:36.821963 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821864 2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-home\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:31:36.821963 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821881 2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-tmp-dir\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:31:36.821963 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.821900 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed9a45a0-5618-4bb3-a153-97403f5d2183" (UID: "ed9a45a0-5618-4bb3-a153-97403f5d2183"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:31:36.823774 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.823755 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed9a45a0-5618-4bb3-a153-97403f5d2183-kube-api-access-f85ls" (OuterVolumeSpecName: "kube-api-access-f85ls") pod "ed9a45a0-5618-4bb3-a153-97403f5d2183" (UID: "ed9a45a0-5618-4bb3-a153-97403f5d2183"). InnerVolumeSpecName "kube-api-access-f85ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:31:36.823967 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.823947 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-dshm" (OuterVolumeSpecName: "dshm") pod "ed9a45a0-5618-4bb3-a153-97403f5d2183" (UID: "ed9a45a0-5618-4bb3-a153-97403f5d2183"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:31:36.824032 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.823975 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed9a45a0-5618-4bb3-a153-97403f5d2183-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed9a45a0-5618-4bb3-a153-97403f5d2183" (UID: "ed9a45a0-5618-4bb3-a153-97403f5d2183"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 23:31:36.922999 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.922962 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f85ls\" (UniqueName: \"kubernetes.io/projected/ed9a45a0-5618-4bb3-a153-97403f5d2183-kube-api-access-f85ls\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:31:36.922999 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.922992 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed9a45a0-5618-4bb3-a153-97403f5d2183-tls-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:31:36.922999 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.923005 2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-dshm\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:31:36.923249 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:36.923018 2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed9a45a0-5618-4bb3-a153-97403f5d2183-model-cache\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:31:37.523213 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.523172 2585 generic.go:356] "Generic (PLEG): container finished" podID="ed9a45a0-5618-4bb3-a153-97403f5d2183" containerID="57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2" exitCode=0 Jul 24 23:31:37.523706 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.523230 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" Jul 24 23:31:37.523706 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.523259 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" event={"ID":"ed9a45a0-5618-4bb3-a153-97403f5d2183","Type":"ContainerDied","Data":"57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2"} Jul 24 23:31:37.523706 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.523304 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9" event={"ID":"ed9a45a0-5618-4bb3-a153-97403f5d2183","Type":"ContainerDied","Data":"ba9fdb31deaf1add84f001edcbff849aa7a871fa14f0e3457df004724d8d1ef1"} Jul 24 23:31:37.523706 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.523321 2585 scope.go:117] "RemoveContainer" containerID="57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2" Jul 24 23:31:37.533755 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.533736 2585 scope.go:117] "RemoveContainer" containerID="57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2" Jul 24 23:31:37.534075 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:31:37.534056 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2\": container with ID starting with 57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2 not found: ID does not exist" containerID="57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2" Jul 24 23:31:37.534141 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.534084 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2"} err="failed to get container status \"57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2\": rpc error: code = NotFound desc = could not find container \"57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2\": container with ID starting with 57169b20121f7d0beaea4dbc638fe8034ebb33eb0e9fc0f60e798af64a9e9ff2 not found: ID does not exist" Jul 24 23:31:37.545220 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.545192 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9"] Jul 24 23:31:37.547502 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:37.547482 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5c850d/sub-test-model-5c850d-kserve-796c694dcc-5qbb9"] Jul 24 23:31:38.052751 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:31:38.052714 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed9a45a0-5618-4bb3-a153-97403f5d2183" path="/var/lib/kubelet/pods/ed9a45a0-5618-4bb3-a153-97403f5d2183/volumes" Jul 24 23:32:11.462847 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.462789 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc"] Jul 24 23:32:11.463242 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.463215 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed9a45a0-5618-4bb3-a153-97403f5d2183" containerName="main" Jul 24 23:32:11.463242 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.463230 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed9a45a0-5618-4bb3-a153-97403f5d2183" containerName="main" Jul 24 23:32:11.463320 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.463294 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed9a45a0-5618-4bb3-a153-97403f5d2183" containerName="main" Jul 24 23:32:11.466326 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.466309 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.469961 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.469932 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d08a26\"/\"kube-root-ca.crt\"" Jul 24 23:32:11.470098 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.469980 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d08a26\"/\"rate-test-model-d08a26-kserve-self-signed-certs\"" Jul 24 23:32:11.470098 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.470011 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d08a26\"/\"default-dockercfg-wg8d9\"" Jul 24 23:32:11.470098 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.470032 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d08a26\"/\"openshift-service-ca.crt\"" Jul 24 23:32:11.474912 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.474888 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc"] Jul 24 23:32:11.546819 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.546767 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-home\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.547012 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.546868 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-dshm\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.547012 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.546907 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tmp-dir\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.547012 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.546954 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-model-cache\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.547012 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.546982 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tls-certs\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.547178 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.547048 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgchg\" (UniqueName: \"kubernetes.io/projected/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-kube-api-access-kgchg\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.647952 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.647915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-home\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.647952 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.647957 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-dshm\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.647978 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tmp-dir\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.648018 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-model-cache\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.648044 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tls-certs\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648212 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.648089 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgchg\" (UniqueName: \"kubernetes.io/projected/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-kube-api-access-kgchg\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648416 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.648376 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-home\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648487 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.648441 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-model-cache\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.648487 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.648476 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tmp-dir\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.650432 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.650409 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-dshm\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.650704 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.650685 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tls-certs\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.658427 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.658360 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgchg\" (UniqueName: \"kubernetes.io/projected/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-kube-api-access-kgchg\") pod \"rate-test-model-d08a26-kserve-6d7c874fff-4r2mc\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.777022 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.776987 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:11.907859 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:11.907824 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc"] Jul 24 23:32:11.908984 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:32:11.908956 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c1da5ed_2f74_47c4_8b70_353fb9cede0f.slice/crio-118be8f3174bcfd939a3f1691a1ef7d8bc6b3685ee9f009cdfada942903009d9 WatchSource:0}: Error finding container 118be8f3174bcfd939a3f1691a1ef7d8bc6b3685ee9f009cdfada942903009d9: Status 404 returned error can't find the container with id 118be8f3174bcfd939a3f1691a1ef7d8bc6b3685ee9f009cdfada942903009d9 Jul 24 23:32:12.724701 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:12.724661 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" event={"ID":"4c1da5ed-2f74-47c4-8b70-353fb9cede0f","Type":"ContainerStarted","Data":"1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10"} Jul 24 23:32:12.725136 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:12.724710 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" event={"ID":"4c1da5ed-2f74-47c4-8b70-353fb9cede0f","Type":"ContainerStarted","Data":"118be8f3174bcfd939a3f1691a1ef7d8bc6b3685ee9f009cdfada942903009d9"} Jul 24 23:32:12.742216 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:12.742162 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" podStartSLOduration=1.742147735 podStartE2EDuration="1.742147735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:32:12.738997884 +0000 UTC m=+2759.203186310" watchObservedRunningTime="2026-07-24 23:32:12.742147735 +0000 UTC m=+2759.206336159" Jul 24 23:32:21.777311 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:21.777272 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:21.777908 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:21.777376 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:21.790522 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:21.790495 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:22.794321 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:22.794289 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:32:50.464594 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:32:50.464517 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc"] Jul 24 23:33:05.484084 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.484023 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" podUID="4c1da5ed-2f74-47c4-8b70-353fb9cede0f" containerName="main" containerID="cri-o://1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10" gracePeriod=45 Jul 24 23:33:05.743354 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.743332 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:33:05.868960 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.868925 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tmp-dir\") pod \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " Jul 24 23:33:05.868960 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.868969 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-dshm\") pod \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " Jul 24 23:33:05.869229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869040 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-home\") pod \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " Jul 24 23:33:05.869229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869064 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgchg\" (UniqueName: \"kubernetes.io/projected/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-kube-api-access-kgchg\") pod \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " Jul 24 23:33:05.869229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869088 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-model-cache\") pod \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " Jul 24 23:33:05.869229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869176 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c1da5ed-2f74-47c4-8b70-353fb9cede0f" (UID: "4c1da5ed-2f74-47c4-8b70-353fb9cede0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:33:05.869229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869217 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tls-certs\") pod \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\" (UID: \"4c1da5ed-2f74-47c4-8b70-353fb9cede0f\") " Jul 24 23:33:05.869483 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869356 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-home" (OuterVolumeSpecName: "home") pod "4c1da5ed-2f74-47c4-8b70-353fb9cede0f" (UID: "4c1da5ed-2f74-47c4-8b70-353fb9cede0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:33:05.869483 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869410 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c1da5ed-2f74-47c4-8b70-353fb9cede0f" (UID: "4c1da5ed-2f74-47c4-8b70-353fb9cede0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:33:05.869557 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869542 2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-home\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:33:05.869592 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869555 2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-model-cache\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:33:05.869592 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.869571 2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tmp-dir\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:33:05.871333 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.871303 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c1da5ed-2f74-47c4-8b70-353fb9cede0f" (UID: "4c1da5ed-2f74-47c4-8b70-353fb9cede0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 23:33:05.871433 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.871352 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-dshm" (OuterVolumeSpecName: "dshm") pod "4c1da5ed-2f74-47c4-8b70-353fb9cede0f" (UID: "4c1da5ed-2f74-47c4-8b70-353fb9cede0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:33:05.871433 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.871395 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-kube-api-access-kgchg" (OuterVolumeSpecName: "kube-api-access-kgchg") pod "4c1da5ed-2f74-47c4-8b70-353fb9cede0f" (UID: "4c1da5ed-2f74-47c4-8b70-353fb9cede0f"). InnerVolumeSpecName "kube-api-access-kgchg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:33:05.970668 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.970629 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-tls-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:33:05.970668 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.970661 2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-dshm\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:33:05.970668 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:05.970670 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgchg\" (UniqueName: \"kubernetes.io/projected/4c1da5ed-2f74-47c4-8b70-353fb9cede0f-kube-api-access-kgchg\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:33:06.022866 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.022768 2585 generic.go:356] "Generic (PLEG): container finished" podID="4c1da5ed-2f74-47c4-8b70-353fb9cede0f" containerID="1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10" exitCode=0 Jul 24 23:33:06.022866 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.022826 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" event={"ID":"4c1da5ed-2f74-47c4-8b70-353fb9cede0f","Type":"ContainerDied","Data":"1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10"} Jul 24 23:33:06.022866 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.022844 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" Jul 24 23:33:06.023116 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.022878 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc" event={"ID":"4c1da5ed-2f74-47c4-8b70-353fb9cede0f","Type":"ContainerDied","Data":"118be8f3174bcfd939a3f1691a1ef7d8bc6b3685ee9f009cdfada942903009d9"} Jul 24 23:33:06.023116 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.022897 2585 scope.go:117] "RemoveContainer" containerID="1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10" Jul 24 23:33:06.032864 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.032845 2585 scope.go:117] "RemoveContainer" containerID="1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10" Jul 24 23:33:06.033112 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:33:06.033093 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10\": container with ID starting with 1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10 not found: ID does not exist" containerID="1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10" Jul 24 23:33:06.033173 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.033125 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10"} err="failed to get container status \"1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10\": rpc error: code = NotFound desc = could not find container \"1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10\": container with ID starting with 1cf05381d16aabb58f7440782d9ef34b734815377b92c7b17e75612f9ad0ba10 not found: ID does not exist" Jul 24 23:33:06.043740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.043713 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc"] Jul 24 23:33:06.052690 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:06.052667 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d08a26/rate-test-model-d08a26-kserve-6d7c874fff-4r2mc"] Jul 24 23:33:08.052268 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:08.052231 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1da5ed-2f74-47c4-8b70-353fb9cede0f" path="/var/lib/kubelet/pods/4c1da5ed-2f74-47c4-8b70-353fb9cede0f/volumes" Jul 24 23:33:10.460461 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.460385 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn"] Jul 24 23:33:10.460813 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.460772 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1da5ed-2f74-47c4-8b70-353fb9cede0f" containerName="main" Jul 24 23:33:10.460813 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.460785 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1da5ed-2f74-47c4-8b70-353fb9cede0f" containerName="main" Jul 24 23:33:10.460903 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.460891 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1da5ed-2f74-47c4-8b70-353fb9cede0f" containerName="main" Jul 24 23:33:10.465182 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.465166 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.467635 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.467616 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-eb4c8d-openshift-default-dockercfg-m7k9m\"" Jul 24 23:33:10.476194 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.476171 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn"] Jul 24 23:33:10.614395 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614356 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mxv\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-kube-api-access-96mxv\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614402 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-istio-token\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614435 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-envoy\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614472 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb86143-4c26-482c-840b-1364461eafb6-istio-podinfo\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614495 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-data\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614512 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-credential-socket\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614574 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-certs\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614644 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb86143-4c26-482c-840b-1364461eafb6-istiod-ca-cert\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.614740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.614688 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-socket\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715481 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715373 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb86143-4c26-482c-840b-1364461eafb6-istiod-ca-cert\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715481 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715424 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-socket\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715720 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715558 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mxv\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-kube-api-access-96mxv\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715768 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715711 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-istio-token\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715768 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-envoy\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715920 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715821 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb86143-4c26-482c-840b-1364461eafb6-istio-podinfo\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715920 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715872 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-data\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.715920 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-credential-socket\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.716070 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.716026 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-certs\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.716070 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.715875 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-socket\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.716260 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.716220 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-data\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.716400 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.716302 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb86143-4c26-482c-840b-1364461eafb6-istiod-ca-cert\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.716400 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.716348 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-credential-socket\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.716520 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.716502 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-certs\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.718190 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.718169 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-envoy\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.718481 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.718464 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb86143-4c26-482c-840b-1364461eafb6-istio-podinfo\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.724400 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.724376 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-istio-token\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.724545 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.724527 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mxv\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-kube-api-access-96mxv\") pod \"e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.777694 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.777660 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:10.921994 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.921969 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn"] Jul 24 23:33:10.923676 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:33:10.923650 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb86143_4c26_482c_840b_1364461eafb6.slice/crio-24933dc2befc2004ba3c77aedfc8596659fa6b89461a56db071fd36a1c47a91d WatchSource:0}: Error finding container 24933dc2befc2004ba3c77aedfc8596659fa6b89461a56db071fd36a1c47a91d: Status 404 returned error can't find the container with id 24933dc2befc2004ba3c77aedfc8596659fa6b89461a56db071fd36a1c47a91d Jul 24 23:33:10.925936 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.925903 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:33:10.926037 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.925967 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:33:10.926037 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:10.926013 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:33:11.057535 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:11.057496 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" event={"ID":"eeb86143-4c26-482c-840b-1364461eafb6","Type":"ContainerStarted","Data":"122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d"} Jul 24 23:33:11.057742 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:11.057556 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" event={"ID":"eeb86143-4c26-482c-840b-1364461eafb6","Type":"ContainerStarted","Data":"24933dc2befc2004ba3c77aedfc8596659fa6b89461a56db071fd36a1c47a91d"} Jul 24 23:33:11.086742 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:11.084744 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podStartSLOduration=1.084721522 podStartE2EDuration="1.084721522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:33:11.07481612 +0000 UTC m=+2817.539004618" watchObservedRunningTime="2026-07-24 23:33:11.084721522 +0000 UTC m=+2817.548909948" Jul 24 23:33:11.778898 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:11.778854 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:11.783988 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:11.783959 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:12.062496 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:12.062417 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:12.063368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:12.063350 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:27.064310 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.064270 2585 patch_prober.go:28] interesting pod/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Jul 24 23:33:27.064722 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.064340 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Jul 24 23:33:27.147666 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.147629 2585 generic.go:356] "Generic (PLEG): container finished" podID="eeb86143-4c26-482c-840b-1364461eafb6" containerID="122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d" exitCode=0 Jul 24 23:33:27.147857 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.147701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" event={"ID":"eeb86143-4c26-482c-840b-1364461eafb6","Type":"ContainerDied","Data":"122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d"} Jul 24 23:33:27.148124 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.148109 2585 scope.go:117] "RemoveContainer" containerID="122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d" Jul 24 23:33:27.149133 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.149108 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:33:27.149184 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.149173 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:33:27.149223 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:27.149205 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:33:28.155620 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:28.155579 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" event={"ID":"eeb86143-4c26-482c-840b-1364461eafb6","Type":"ContainerStarted","Data":"23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c"} Jul 24 23:33:28.777991 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:28.777949 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:28.778242 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:28.778213 2585 patch_prober.go:28] interesting pod/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Jul 24 23:33:28.778317 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:28.778282 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Jul 24 23:33:29.779065 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:29.779015 2585 patch_prober.go:28] interesting pod/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Jul 24 23:33:29.779540 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:29.779089 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Jul 24 23:33:30.778715 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:30.778675 2585 patch_prober.go:28] interesting pod/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Jul 24 23:33:30.779052 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:30.779018 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Jul 24 23:33:31.778373 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:31.778332 2585 patch_prober.go:28] interesting pod/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Jul 24 23:33:31.779011 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:31.778975 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Jul 24 23:33:32.783526 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:32.783493 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:32.783987 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:32.783832 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:33:32.784657 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:33:32.784640 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:34:53.837016 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.836984 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q"] Jul 24 23:34:53.840649 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.840632 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.844017 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.843994 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-429acb-openshift-default-dockercfg-48vzl\"" Jul 24 23:34:53.852690 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.852663 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q"] Jul 24 23:34:53.879088 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879058 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-credential-socket\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879284 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879099 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7znp\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-kube-api-access-r7znp\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879284 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879130 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-data\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879284 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-token\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879284 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879249 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-podinfo\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879514 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879312 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-envoy\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879514 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879351 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-certs\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879514 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879385 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-socket\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.879514 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.879413 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980385 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-credential-socket\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980385 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980391 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7znp\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-kube-api-access-r7znp\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980422 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-data\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-token\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-podinfo\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980550 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-envoy\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-certs\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980607 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-socket\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.980654 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980634 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.981058 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.980861 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-credential-socket\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.981122 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.981063 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-certs\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.981122 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.981108 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-socket\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.981206 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.981159 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-data\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.981447 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.981425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.983011 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.982988 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-envoy\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.983256 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.983234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-podinfo\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.988139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.988113 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-token\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:53.988451 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:53.988428 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7znp\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-kube-api-access-r7znp\") pod \"e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:54.151837 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.151739 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:54.285936 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.285902 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q"] Jul 24 23:34:54.286749 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:34:54.286723 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbdc689_6ead_40b9_a5d8_5a1cbd9fa00c.slice/crio-1bc29813c43e51ce2ab25c8324a38c7ab947e2e6e801de0a7c82fcde6b81cbd3 WatchSource:0}: Error finding container 1bc29813c43e51ce2ab25c8324a38c7ab947e2e6e801de0a7c82fcde6b81cbd3: Status 404 returned error can't find the container with id 1bc29813c43e51ce2ab25c8324a38c7ab947e2e6e801de0a7c82fcde6b81cbd3 Jul 24 23:34:54.288895 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.288866 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:34:54.288993 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.288944 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:34:54.289062 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.288989 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:34:54.646774 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.646737 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" event={"ID":"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c","Type":"ContainerStarted","Data":"70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab"} Jul 24 23:34:54.646959 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.646814 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" event={"ID":"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c","Type":"ContainerStarted","Data":"1bc29813c43e51ce2ab25c8324a38c7ab947e2e6e801de0a7c82fcde6b81cbd3"} Jul 24 23:34:54.667631 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:54.667583 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" podStartSLOduration=1.667560182 podStartE2EDuration="1.667560182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:34:54.664993977 +0000 UTC m=+2921.129182405" watchObservedRunningTime="2026-07-24 23:34:54.667560182 +0000 UTC m=+2921.131748607" Jul 24 23:34:55.152407 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:55.152376 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:55.157719 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:55.157695 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:55.652199 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:55.652173 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:34:55.653068 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:34:55.653048 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:09.742593 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:09.742554 2585 generic.go:356] "Generic (PLEG): container finished" podID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerID="70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab" exitCode=0 Jul 24 23:35:09.743073 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:09.742637 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" event={"ID":"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c","Type":"ContainerDied","Data":"70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab"} Jul 24 23:35:09.743155 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:09.743126 2585 scope.go:117] "RemoveContainer" containerID="70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab" Jul 24 23:35:09.744273 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:09.744245 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:35:09.744337 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:09.744323 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:35:09.744373 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:09.744359 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 23:35:10.652229 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:10.652184 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:10.749763 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:10.749729 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" event={"ID":"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c","Type":"ContainerStarted","Data":"44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54"} Jul 24 23:35:11.152663 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:11.152630 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:11.153754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:11.153728 2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Jul 24 23:35:11.153907 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:11.153783 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Jul 24 23:35:12.152049 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:12.152015 2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Jul 24 23:35:12.152456 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:12.152075 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Jul 24 23:35:13.152130 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:13.152091 2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Jul 24 23:35:13.152523 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:13.152145 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Jul 24 23:35:14.153006 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:14.152967 2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Jul 24 23:35:14.153401 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:14.153025 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Jul 24 23:35:15.156689 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:15.156656 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:15.157068 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:15.157005 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:15.157749 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:15.157733 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:33.370846 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:33.370781 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q"] Jul 24 23:35:33.371453 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:33.371097 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" containerID="cri-o://44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54" gracePeriod=30 Jul 24 23:35:38.623852 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.623823 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:38.713965 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.713894 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-podinfo\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.713965 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.713941 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-credential-socket\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714177 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.713984 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-certs\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714177 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714002 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-data\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714177 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714048 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7znp\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-kube-api-access-r7znp\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714177 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714078 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-token\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714177 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714097 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-socket\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714433 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714356 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:35:38.714433 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714361 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istiod-ca-cert\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714548 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714435 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-envoy\") pod \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\" (UID: \"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c\") " Jul 24 23:35:38.714667 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714644 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:35:38.714888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714872 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.714964 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.714893 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.715887 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.715858 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:35:38.716150 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.716120 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:35:38.716254 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.716226 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:35:38.716316 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.716270 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-kube-api-access-r7znp" (OuterVolumeSpecName: "kube-api-access-r7znp") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "kube-api-access-r7znp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:35:38.716470 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.716443 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:35:38.716588 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.716500 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:35:38.716674 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.716657 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" (UID: "cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:35:38.816322 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816294 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7znp\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-kube-api-access-r7znp\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.816322 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816320 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.816519 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816329 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.816519 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816338 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.816519 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816346 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.816519 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816354 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.816519 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.816361 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:35:38.909319 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.909286 2585 generic.go:356] "Generic (PLEG): container finished" podID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerID="44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54" exitCode=0 Jul 24 23:35:38.909464 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.909350 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" Jul 24 23:35:38.909464 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.909378 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" event={"ID":"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c","Type":"ContainerDied","Data":"44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54"} Jul 24 23:35:38.909464 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.909444 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q" event={"ID":"cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c","Type":"ContainerDied","Data":"1bc29813c43e51ce2ab25c8324a38c7ab947e2e6e801de0a7c82fcde6b81cbd3"} Jul 24 23:35:38.909613 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.909476 2585 scope.go:117] "RemoveContainer" containerID="44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54" Jul 24 23:35:38.919191 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.919173 2585 scope.go:117] "RemoveContainer" containerID="70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab" Jul 24 23:35:38.927300 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.927285 2585 scope.go:117] "RemoveContainer" containerID="44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54" Jul 24 23:35:38.927540 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:35:38.927523 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54\": container with ID starting with 44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54 not found: ID does not exist" containerID="44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54" Jul 24 23:35:38.927606 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.927547 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54"} err="failed to get container status \"44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54\": rpc error: code = NotFound desc = could not find container \"44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54\": container with ID starting with 44ccf72689a9184d99aa4eab9c62127667d94b1d2d4e6872e99ab92d852bfe54 not found: ID does not exist" Jul 24 23:35:38.927606 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.927566 2585 scope.go:117] "RemoveContainer" containerID="70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab" Jul 24 23:35:38.927843 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:35:38.927826 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab\": container with ID starting with 70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab not found: ID does not exist" containerID="70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab" Jul 24 23:35:38.927921 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.927852 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab"} err="failed to get container status \"70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab\": rpc error: code = NotFound desc = could not find container \"70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab\": container with ID starting with 70903531ce551bc4d3062c0415656d83753c5817ba9ff499af5fabe599a09aab not found: ID does not exist" Jul 24 23:35:38.933638 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.933618 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q"] Jul 24 23:35:38.937265 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:38.937246 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-429acb-openshift-default-84cfd484c8-8x52q"] Jul 24 23:35:40.058357 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:35:40.058323 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" path="/var/lib/kubelet/pods/cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c/volumes" Jul 24 23:36:50.564158 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:50.564123 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn"] Jul 24 23:36:50.564758 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:50.564371 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" containerID="cri-o://23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c" gracePeriod=30 Jul 24 23:36:55.810566 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.810538 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:36:55.820951 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.820924 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-data\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.820955 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-socket\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821005 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb86143-4c26-482c-840b-1364461eafb6-istiod-ca-cert\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821030 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96mxv\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-kube-api-access-96mxv\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821061 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-istio-token\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821283 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821079 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-certs\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821283 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821104 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb86143-4c26-482c-840b-1364461eafb6-istio-podinfo\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821283 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821143 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-credential-socket\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821283 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821169 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-envoy\") pod \"eeb86143-4c26-482c-840b-1364461eafb6\" (UID: \"eeb86143-4c26-482c-840b-1364461eafb6\") " Jul 24 23:36:55.821283 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821244 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:36:55.821521 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821357 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:36:55.821521 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821438 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb86143-4c26-482c-840b-1364461eafb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:36:55.821521 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821508 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.821685 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821526 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.821685 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821539 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb86143-4c26-482c-840b-1364461eafb6-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.821814 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821762 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:36:55.821878 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.821847 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:36:55.823408 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.823378 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-kube-api-access-96mxv" (OuterVolumeSpecName: "kube-api-access-96mxv") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "kube-api-access-96mxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:36:55.823608 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.823585 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:36:55.823831 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.823783 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:36:55.823932 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.823884 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eeb86143-4c26-482c-840b-1364461eafb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eeb86143-4c26-482c-840b-1364461eafb6" (UID: "eeb86143-4c26-482c-840b-1364461eafb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:36:55.922039 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.922005 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96mxv\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-kube-api-access-96mxv\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.922039 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.922034 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb86143-4c26-482c-840b-1364461eafb6-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.922039 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.922045 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb86143-4c26-482c-840b-1364461eafb6-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.922274 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.922053 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.922274 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.922065 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:55.922274 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:55.922076 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb86143-4c26-482c-840b-1364461eafb6-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:36:56.336054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.336017 2585 generic.go:356] "Generic (PLEG): container finished" podID="eeb86143-4c26-482c-840b-1364461eafb6" containerID="23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c" exitCode=0 Jul 24 23:36:56.336054 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.336056 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" event={"ID":"eeb86143-4c26-482c-840b-1364461eafb6","Type":"ContainerDied","Data":"23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c"} Jul 24 23:36:56.336281 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.336081 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" Jul 24 23:36:56.336281 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.336103 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn" event={"ID":"eeb86143-4c26-482c-840b-1364461eafb6","Type":"ContainerDied","Data":"24933dc2befc2004ba3c77aedfc8596659fa6b89461a56db071fd36a1c47a91d"} Jul 24 23:36:56.336281 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.336125 2585 scope.go:117] "RemoveContainer" containerID="23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c" Jul 24 23:36:56.345431 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.345408 2585 scope.go:117] "RemoveContainer" containerID="122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d" Jul 24 23:36:56.353591 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.353566 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn"] Jul 24 23:36:56.354043 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.354021 2585 scope.go:117] "RemoveContainer" containerID="23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c" Jul 24 23:36:56.354633 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:36:56.354556 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c\": container with ID starting with 23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c not found: ID does not exist" containerID="23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c" Jul 24 23:36:56.354849 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.354600 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c"} err="failed to get container status \"23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c\": rpc error: code = NotFound desc = could not find container \"23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c\": container with ID starting with 23063c0680bcde59686e964a57f4e5795ea9ed7670f0c73c9d301c1682da442c not found: ID does not exist" Jul 24 23:36:56.354849 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.354696 2585 scope.go:117] "RemoveContainer" containerID="122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d" Jul 24 23:36:56.355054 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:36:56.355026 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d\": container with ID starting with 122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d not found: ID does not exist" containerID="122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d" Jul 24 23:36:56.355134 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.355060 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d"} err="failed to get container status \"122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d\": rpc error: code = NotFound desc = could not find container \"122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d\": container with ID starting with 122b3310b7519953a6f3b16a1cb5eb6949acd25305e1ae262dd8897a8d55574d not found: ID does not exist" Jul 24 23:36:56.357220 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:56.357198 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-eb4c8d-openshift-default-7c7fcfbc5d-vc6gn"] Jul 24 23:36:58.053076 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:36:58.053043 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb86143-4c26-482c-840b-1364461eafb6" path="/var/lib/kubelet/pods/eeb86143-4c26-482c-840b-1364461eafb6/volumes" Jul 24 23:37:34.213880 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:34.213842 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p"] Jul 24 23:37:34.214407 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:34.214060 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" containerID="cri-o://82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f" gracePeriod=30 Jul 24 23:37:39.472245 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.472216 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:37:39.581314 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.581271 2585 generic.go:356] "Generic (PLEG): container finished" podID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerID="82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f" exitCode=0 Jul 24 23:37:39.581468 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.581323 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" Jul 24 23:37:39.581468 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.581348 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" event={"ID":"478b7bd9-6e23-43ed-b9d2-b759a362df18","Type":"ContainerDied","Data":"82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f"} Jul 24 23:37:39.581468 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.581403 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p" event={"ID":"478b7bd9-6e23-43ed-b9d2-b759a362df18","Type":"ContainerDied","Data":"054beb5b0af76a852708bf962365d7390877461d85f8fd3428d21c98b66408d5"} Jul 24 23:37:39.581468 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.581435 2585 scope.go:117] "RemoveContainer" containerID="82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f" Jul 24 23:37:39.590108 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.590088 2585 scope.go:117] "RemoveContainer" containerID="16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3" Jul 24 23:37:39.598643 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.598625 2585 scope.go:117] "RemoveContainer" containerID="82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f" Jul 24 23:37:39.598931 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:37:39.598910 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f\": container with ID starting with 82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f not found: ID does not exist" containerID="82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f" Jul 24 23:37:39.599019 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.598943 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f"} err="failed to get container status \"82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f\": rpc error: code = NotFound desc = could not find container \"82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f\": container with ID starting with 82abea622ee012a66e8e0008cec0d70120e14eb865950c658ba9c2e2bddd124f not found: ID does not exist" Jul 24 23:37:39.599019 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.598965 2585 scope.go:117] "RemoveContainer" containerID="16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3" Jul 24 23:37:39.599211 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:37:39.599193 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3\": container with ID starting with 16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3 not found: ID does not exist" containerID="16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3" Jul 24 23:37:39.599252 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.599219 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3"} err="failed to get container status \"16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3\": rpc error: code = NotFound desc = could not find container \"16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3\": container with ID starting with 16f261ccc56ed6cf8e5aa339a5cf6a58dbb437cd9f704350704cd4993a2d2cf3 not found: ID does not exist" Jul 24 23:37:39.618539 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618519 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gc4d\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-kube-api-access-6gc4d\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618552 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-token\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618572 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-data\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618594 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-certs\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618782 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618634 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-credential-socket\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618782 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618691 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-podinfo\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618782 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618717 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b7bd9-6e23-43ed-b9d2-b759a362df18-istiod-ca-cert\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.618782 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618749 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-socket\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.619020 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618831 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-envoy\") pod \"478b7bd9-6e23-43ed-b9d2-b759a362df18\" (UID: \"478b7bd9-6e23-43ed-b9d2-b759a362df18\") " Jul 24 23:37:39.619020 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618970 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:37:39.619020 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.618987 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:37:39.619178 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.619157 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:37:39.619243 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.619195 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/478b7bd9-6e23-43ed-b9d2-b759a362df18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:37:39.619305 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.619248 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.619305 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.619268 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.619305 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.619284 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.619483 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.619457 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-data" (OuterVolumeSpecName: "istio-data") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:37:39.620813 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.620768 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-kube-api-access-6gc4d" (OuterVolumeSpecName: "kube-api-access-6gc4d") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "kube-api-access-6gc4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:37:39.620946 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.620928 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:37:39.621007 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.620947 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:37:39.621081 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.621063 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-token" (OuterVolumeSpecName: "istio-token") pod "478b7bd9-6e23-43ed-b9d2-b759a362df18" (UID: "478b7bd9-6e23-43ed-b9d2-b759a362df18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:37:39.720071 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.720048 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.720071 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.720068 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gc4d\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-kube-api-access-6gc4d\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.720208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.720077 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.720208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.720085 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.720208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.720093 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b7bd9-6e23-43ed-b9d2-b759a362df18-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.720208 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.720100 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b7bd9-6e23-43ed-b9d2-b759a362df18-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:37:39.903047 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.903016 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p"] Jul 24 23:37:39.907510 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:39.907483 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5c850d-openshift-default-6785bb4fc6-t2b9p"] Jul 24 23:37:40.055416 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:40.055382 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" path="/var/lib/kubelet/pods/478b7bd9-6e23-43ed-b9d2-b759a362df18/volumes" Jul 24 23:37:55.970252 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:55.970214 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz"] Jul 24 23:37:55.970740 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:55.970465 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" containerID="cri-o://6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856" gracePeriod=30 Jul 24 23:37:56.650545 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:37:56.650512 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8dcb474c-gpdb8_571fc4e6-a616-450e-97fc-723fd8736708/authorino/0.log" Jul 24 23:38:01.226627 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.226605 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:38:01.305730 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.305695 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-token\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.305912 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.305738 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-envoy\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.305912 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.305758 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-data\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.305912 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.305782 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-podinfo\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.306081 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.305926 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-socket\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.306081 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.305978 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-certs\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.306081 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306047 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-credential-socket\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.306081 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306074 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smbqw\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-kube-api-access-smbqw\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.306282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306141 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad7edc11-13c0-432e-8f08-ba4625d12b01-istiod-ca-cert\") pod \"ad7edc11-13c0-432e-8f08-ba4625d12b01\" (UID: \"ad7edc11-13c0-432e-8f08-ba4625d12b01\") " Jul 24 23:38:01.306282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306209 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:38:01.306282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306266 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:38:01.306442 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306297 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:38:01.306503 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306491 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.306573 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306507 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-workload-certs\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.306573 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306519 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-credential-socket\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.306669 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306576 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad7edc11-13c0-432e-8f08-ba4625d12b01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 23:38:01.306754 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.306732 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:38:01.308231 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.308203 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 23:38:01.308353 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.308248 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-kube-api-access-smbqw" (OuterVolumeSpecName: "kube-api-access-smbqw") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "kube-api-access-smbqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:38:01.308353 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.308330 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 23:38:01.308353 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.308337 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad7edc11-13c0-432e-8f08-ba4625d12b01" (UID: "ad7edc11-13c0-432e-8f08-ba4625d12b01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 23:38:01.407574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.407541 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-token\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.407574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.407567 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-envoy\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.407574 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.407577 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-data\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.407830 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.407591 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad7edc11-13c0-432e-8f08-ba4625d12b01-istio-podinfo\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.407830 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.407601 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smbqw\" (UniqueName: \"kubernetes.io/projected/ad7edc11-13c0-432e-8f08-ba4625d12b01-kube-api-access-smbqw\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.407830 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.407611 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad7edc11-13c0-432e-8f08-ba4625d12b01-istiod-ca-cert\") on node \"ip-10-0-132-39.ec2.internal\" DevicePath \"\"" Jul 24 23:38:01.707973 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.707878 2585 generic.go:356] "Generic (PLEG): container finished" podID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerID="6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856" exitCode=0 Jul 24 23:38:01.707973 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.707943 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" Jul 24 23:38:01.707973 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.707956 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" event={"ID":"ad7edc11-13c0-432e-8f08-ba4625d12b01","Type":"ContainerDied","Data":"6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856"} Jul 24 23:38:01.708238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.708062 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz" event={"ID":"ad7edc11-13c0-432e-8f08-ba4625d12b01","Type":"ContainerDied","Data":"142da57df56f40142c5acab21c78701d0368a9adb28f63a3a0d1a7e8413b9c04"} Jul 24 23:38:01.708238 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.708100 2585 scope.go:117] "RemoveContainer" containerID="6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856" Jul 24 23:38:01.717607 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.717592 2585 scope.go:117] "RemoveContainer" containerID="32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b" Jul 24 23:38:01.725278 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.725262 2585 scope.go:117] "RemoveContainer" containerID="6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856" Jul 24 23:38:01.725518 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:38:01.725497 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856\": container with ID starting with 6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856 not found: ID does not exist" containerID="6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856" Jul 24 23:38:01.725570 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.725526 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856"} err="failed to get container status \"6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856\": rpc error: code = NotFound desc = could not find container \"6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856\": container with ID starting with 6b518d189fb5e397016302278bbc02d96da6a01baed79fb66f38c007fc8eb856 not found: ID does not exist" Jul 24 23:38:01.725570 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.725542 2585 scope.go:117] "RemoveContainer" containerID="32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b" Jul 24 23:38:01.725769 ip-10-0-132-39 kubenswrapper[2585]: E0724 23:38:01.725746 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b\": container with ID starting with 32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b not found: ID does not exist" containerID="32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b" Jul 24 23:38:01.725823 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.725776 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b"} err="failed to get container status \"32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b\": rpc error: code = NotFound desc = could not find container \"32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b\": container with ID starting with 32ad44f3bf4f1c5db431c3c7cb0c46e7a8cd1ee5c604074e008892f00852472b not found: ID does not exist" Jul 24 23:38:01.732837 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.732814 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz"] Jul 24 23:38:01.734928 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:01.734909 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d08a26-openshift-default-5d7476c984-qj2tz"] Jul 24 23:38:02.051953 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:02.051921 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" path="/var/lib/kubelet/pods/ad7edc11-13c0-432e-8f08-ba4625d12b01/volumes" Jul 24 23:38:02.255215 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:02.255186 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-98nbw_8ca28a49-c475-44e6-a150-8bdf7fe6cfc5/server/0.log" Jul 24 23:38:02.372974 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:02.372902 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dcc8r_4d43828c-d0c5-4c9e-b856-19b1633c16ff/manager/0.log" Jul 24 23:38:02.489217 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:02.489189 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d99768bd-7zdxf_35aa88b0-59ce-4cb4-8afe-2c94b8cd6183/copy-manifests/0.log" Jul 24 23:38:02.503468 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:02.503430 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d99768bd-7zdxf_35aa88b0-59ce-4cb4-8afe-2c94b8cd6183/manager/0.log" Jul 24 23:38:04.293518 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.293490 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd_0344517d-8408-4c37-a146-39313c23dcfa/util/0.log" Jul 24 23:38:04.300072 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.300041 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd_0344517d-8408-4c37-a146-39313c23dcfa/pull/0.log" Jul 24 23:38:04.306368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.306351 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd_0344517d-8408-4c37-a146-39313c23dcfa/extract/0.log" Jul 24 23:38:04.420289 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.420258 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv_87d04ac6-8a60-40d9-b912-94656277c488/util/0.log" Jul 24 23:38:04.427416 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.427395 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv_87d04ac6-8a60-40d9-b912-94656277c488/pull/0.log" Jul 24 23:38:04.434250 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.434236 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv_87d04ac6-8a60-40d9-b912-94656277c488/extract/0.log" Jul 24 23:38:04.550142 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.550075 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9_ffdd0e62-2668-4a89-ad4f-0f4715c87417/util/0.log" Jul 24 23:38:04.556931 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.556910 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9_ffdd0e62-2668-4a89-ad4f-0f4715c87417/pull/0.log" Jul 24 23:38:04.563778 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.563756 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9_ffdd0e62-2668-4a89-ad4f-0f4715c87417/extract/0.log" Jul 24 23:38:04.675840 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.675789 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t_28220053-6ac3-4a3e-8343-5e08f64bacfb/util/0.log" Jul 24 23:38:04.682563 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.682544 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t_28220053-6ac3-4a3e-8343-5e08f64bacfb/pull/0.log" Jul 24 23:38:04.689507 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.689489 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t_28220053-6ac3-4a3e-8343-5e08f64bacfb/extract/0.log" Jul 24 23:38:04.802610 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.802534 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8dcb474c-gpdb8_571fc4e6-a616-450e-97fc-723fd8736708/authorino/0.log" Jul 24 23:38:04.923018 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:04.922987 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lslps_233ef833-97fa-4a9c-9659-81ccf5bdfe80/manager/0.log" Jul 24 23:38:05.034972 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:05.034946 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d8pvk_59cf1342-5e66-4799-8dae-ba4c89a0dad6/manager/0.log" Jul 24 23:38:05.262094 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:05.262065 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-krn5d_3a8cd855-0df1-4522-992a-6822493ef001/registry-server/0.log" Jul 24 23:38:05.380226 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:05.380201 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6xvgr_dbd5a433-22d8-4cb0-b76b-32d1f6007027/manager/0.log" Jul 24 23:38:05.978260 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:05.978231 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph_48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b/istio-proxy/0.log" Jul 24 23:38:06.437580 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:06.437549 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/1.log" Jul 24 23:38:07.151718 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:07.151687 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-dlbq7_14487d76-d9ec-4bd7-b021-4655a58bb2f7/main/0.log" Jul 24 23:38:07.620509 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:07.620479 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pmxxk_edc884c6-1408-4e02-82d9-f4d98193eaa6/main/0.log" Jul 24 23:38:13.286672 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.286638 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qntww/must-gather-2pzvj"] Jul 24 23:38:13.287139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287101 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" Jul 24 23:38:13.287139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287121 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" Jul 24 23:38:13.287139 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287137 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287147 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287162 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287171 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287184 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287193 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287317 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287330 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287337 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287344 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287357 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" Jul 24 23:38:13.287368 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287367 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287377 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287387 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287472 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287479 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbdc689-6ead-40b9-a5d8-5a1cbd9fa00c" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287486 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287493 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb86143-4c26-482c-840b-1364461eafb6" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287506 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287513 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b7bd9-6e23-43ed-b9d2-b759a362df18" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287520 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" Jul 24 23:38:13.287771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.287526 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad7edc11-13c0-432e-8f08-ba4625d12b01" containerName="istio-proxy" Jul 24 23:38:13.292182 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.292165 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.294763 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.294743 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qntww\"/\"openshift-service-ca.crt\"" Jul 24 23:38:13.294882 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.294743 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qntww\"/\"default-dockercfg-cs6ws\"" Jul 24 23:38:13.294882 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.294778 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qntww\"/\"kube-root-ca.crt\"" Jul 24 23:38:13.299777 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.299641 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qntww/must-gather-2pzvj"] Jul 24 23:38:13.412663 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.412632 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc9kb\" (UniqueName: \"kubernetes.io/projected/2077d0a9-ae6f-4bc3-bf19-12903ba89f36-kube-api-access-wc9kb\") pod \"must-gather-2pzvj\" (UID: \"2077d0a9-ae6f-4bc3-bf19-12903ba89f36\") " pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.412852 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.412681 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2077d0a9-ae6f-4bc3-bf19-12903ba89f36-must-gather-output\") pod \"must-gather-2pzvj\" (UID: \"2077d0a9-ae6f-4bc3-bf19-12903ba89f36\") " pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.513154 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.513126 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc9kb\" (UniqueName: \"kubernetes.io/projected/2077d0a9-ae6f-4bc3-bf19-12903ba89f36-kube-api-access-wc9kb\") pod \"must-gather-2pzvj\" (UID: \"2077d0a9-ae6f-4bc3-bf19-12903ba89f36\") " pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.513308 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.513176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2077d0a9-ae6f-4bc3-bf19-12903ba89f36-must-gather-output\") pod \"must-gather-2pzvj\" (UID: \"2077d0a9-ae6f-4bc3-bf19-12903ba89f36\") " pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.513450 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.513435 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2077d0a9-ae6f-4bc3-bf19-12903ba89f36-must-gather-output\") pod \"must-gather-2pzvj\" (UID: \"2077d0a9-ae6f-4bc3-bf19-12903ba89f36\") " pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.520521 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.520497 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc9kb\" (UniqueName: \"kubernetes.io/projected/2077d0a9-ae6f-4bc3-bf19-12903ba89f36-kube-api-access-wc9kb\") pod \"must-gather-2pzvj\" (UID: \"2077d0a9-ae6f-4bc3-bf19-12903ba89f36\") " pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.602092 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.602031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qntww/must-gather-2pzvj" Jul 24 23:38:13.761175 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.761142 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qntww/must-gather-2pzvj"] Jul 24 23:38:13.762122 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:38:13.762097 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2077d0a9_ae6f_4bc3_bf19_12903ba89f36.slice/crio-9c34def14b6ee1815d450a0d3826aeedbb63be933184e1551d8faf69099b343a WatchSource:0}: Error finding container 9c34def14b6ee1815d450a0d3826aeedbb63be933184e1551d8faf69099b343a: Status 404 returned error can't find the container with id 9c34def14b6ee1815d450a0d3826aeedbb63be933184e1551d8faf69099b343a Jul 24 23:38:13.764104 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.764084 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 23:38:13.770622 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:13.770599 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qntww/must-gather-2pzvj" event={"ID":"2077d0a9-ae6f-4bc3-bf19-12903ba89f36","Type":"ContainerStarted","Data":"9c34def14b6ee1815d450a0d3826aeedbb63be933184e1551d8faf69099b343a"} Jul 24 23:38:14.780462 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:14.780423 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qntww/must-gather-2pzvj" event={"ID":"2077d0a9-ae6f-4bc3-bf19-12903ba89f36","Type":"ContainerStarted","Data":"a8420397fb28843d1bb0a007f609ab2eaa0b27e0f85d4fd3c2a31f80c6950771"} Jul 24 23:38:15.790721 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:15.790681 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qntww/must-gather-2pzvj" event={"ID":"2077d0a9-ae6f-4bc3-bf19-12903ba89f36","Type":"ContainerStarted","Data":"03da3bfac67dafa830ce78d12088902d0ae765ae60d151c054d0e9e2abf4a3e9"} Jul 24 23:38:15.806272 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:15.806199 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qntww/must-gather-2pzvj" podStartSLOduration=1.978707403 podStartE2EDuration="2.80617842s" totalImagesPullingTime="827.471017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 23:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:38:15.805416545 +0000 UTC m=+3122.269604969" watchObservedRunningTime="2026-07-24 23:38:15.80617842 +0000 UTC m=+3122.270366847" Jul 24 23:38:16.115738 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:16.115663 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5k5b_dc2b5735-0688-4900-83a9-53eda1359d41/global-pull-secret-syncer/0.log" Jul 24 23:38:16.278599 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:16.278569 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d22vc_60f70359-925f-4018-8c1e-8c35bfc8a21c/konnectivity-agent/0.log" Jul 24 23:38:16.342209 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:16.342176 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-39.ec2.internal_c3e94d89104b64808722a056b82536ee/haproxy/0.log" Jul 24 23:38:21.276550 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.276509 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd_0344517d-8408-4c37-a146-39313c23dcfa/extract/0.log" Jul 24 23:38:21.298564 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.298528 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd_0344517d-8408-4c37-a146-39313c23dcfa/util/0.log" Jul 24 23:38:21.321423 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.321386 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759shzqd_0344517d-8408-4c37-a146-39313c23dcfa/pull/0.log" Jul 24 23:38:21.356555 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.356521 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv_87d04ac6-8a60-40d9-b912-94656277c488/extract/0.log" Jul 24 23:38:21.379256 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.379225 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv_87d04ac6-8a60-40d9-b912-94656277c488/util/0.log" Jul 24 23:38:21.402043 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.402004 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gw5fv_87d04ac6-8a60-40d9-b912-94656277c488/pull/0.log" Jul 24 23:38:21.432895 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.432860 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9_ffdd0e62-2668-4a89-ad4f-0f4715c87417/extract/0.log" Jul 24 23:38:21.455931 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.455899 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9_ffdd0e62-2668-4a89-ad4f-0f4715c87417/util/0.log" Jul 24 23:38:21.477565 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.477535 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nsd9_ffdd0e62-2668-4a89-ad4f-0f4715c87417/pull/0.log" Jul 24 23:38:21.509756 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.509723 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t_28220053-6ac3-4a3e-8343-5e08f64bacfb/extract/0.log" Jul 24 23:38:21.533888 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.533818 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t_28220053-6ac3-4a3e-8343-5e08f64bacfb/util/0.log" Jul 24 23:38:21.554727 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:21.554703 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kst4t_28220053-6ac3-4a3e-8343-5e08f64bacfb/pull/0.log" Jul 24 23:38:22.082819 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:22.081420 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8dcb474c-gpdb8_571fc4e6-a616-450e-97fc-723fd8736708/authorino/0.log" Jul 24 23:38:22.110330 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:22.110294 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lslps_233ef833-97fa-4a9c-9659-81ccf5bdfe80/manager/0.log" Jul 24 23:38:22.133009 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:22.132974 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d8pvk_59cf1342-5e66-4799-8dae-ba4c89a0dad6/manager/0.log" Jul 24 23:38:22.203604 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:22.203564 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-krn5d_3a8cd855-0df1-4522-992a-6822493ef001/registry-server/0.log" Jul 24 23:38:22.335420 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:22.335264 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6xvgr_dbd5a433-22d8-4cb0-b76b-32d1f6007027/manager/0.log" Jul 24 23:38:24.214513 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.214449 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2q7rx_cdee2e83-0eea-44a0-b75f-8433b81972c3/kube-state-metrics/0.log" Jul 24 23:38:24.232734 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.232705 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2q7rx_cdee2e83-0eea-44a0-b75f-8433b81972c3/kube-rbac-proxy-main/0.log" Jul 24 23:38:24.253649 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.253584 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2q7rx_cdee2e83-0eea-44a0-b75f-8433b81972c3/kube-rbac-proxy-self/0.log" Jul 24 23:38:24.330042 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.330019 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-266jd_595b8e55-e7f3-4ecc-b3ec-18eb3866cf85/node-exporter/0.log" Jul 24 23:38:24.350848 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.350821 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-266jd_595b8e55-e7f3-4ecc-b3ec-18eb3866cf85/kube-rbac-proxy/0.log" Jul 24 23:38:24.371536 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.371505 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-266jd_595b8e55-e7f3-4ecc-b3ec-18eb3866cf85/init-textfile/0.log" Jul 24 23:38:24.783101 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.783071 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xt69p_c6283a90-c5e3-4973-ac01-ed9c7fc061d5/prometheus-operator/0.log" Jul 24 23:38:24.803698 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.803665 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xt69p_c6283a90-c5e3-4973-ac01-ed9c7fc061d5/kube-rbac-proxy/0.log" Jul 24 23:38:24.829840 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.829759 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-ndj8h_5acf01f9-3e3f-4827-ae20-665b691207cb/prometheus-operator-admission-webhook/0.log" Jul 24 23:38:24.857974 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.857932 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68d66977b4-4kjct_4c0e6ff2-14df-4116-8c1a-02d560dfc6a1/telemeter-client/0.log" Jul 24 23:38:24.878955 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.878911 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68d66977b4-4kjct_4c0e6ff2-14df-4116-8c1a-02d560dfc6a1/reload/0.log" Jul 24 23:38:24.899705 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:24.899671 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68d66977b4-4kjct_4c0e6ff2-14df-4116-8c1a-02d560dfc6a1/kube-rbac-proxy/0.log" Jul 24 23:38:25.999699 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:25.999665 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg"] Jul 24 23:38:26.006037 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.006011 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.015265 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.015241 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg"] Jul 24 23:38:26.149789 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.149748 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-proc\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.150000 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.149836 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-sys\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.150000 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.149903 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dvwh\" (UniqueName: \"kubernetes.io/projected/f63f44e5-4915-4507-9521-9c45b23b9ae6-kube-api-access-2dvwh\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.150000 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.149931 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-podres\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.150000 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.149983 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-lib-modules\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.251077 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.250985 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-proc\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.252274 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.252249 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-sys\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.252607 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.252582 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dvwh\" (UniqueName: \"kubernetes.io/projected/f63f44e5-4915-4507-9521-9c45b23b9ae6-kube-api-access-2dvwh\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.253087 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.253064 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-podres\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.253279 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.253250 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-lib-modules\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.253384 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.252492 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-sys\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.253384 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.253327 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-podres\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.253384 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.251232 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-proc\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.253539 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.253425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f63f44e5-4915-4507-9521-9c45b23b9ae6-lib-modules\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.262841 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.262267 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dvwh\" (UniqueName: \"kubernetes.io/projected/f63f44e5-4915-4507-9521-9c45b23b9ae6-kube-api-access-2dvwh\") pod \"perf-node-gather-daemonset-f6kcg\" (UID: \"f63f44e5-4915-4507-9521-9c45b23b9ae6\") " pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.324394 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.324353 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.511295 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.511260 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg"] Jul 24 23:38:26.511997 ip-10-0-132-39 kubenswrapper[2585]: W0724 23:38:26.511958 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf63f44e5_4915_4507_9521_9c45b23b9ae6.slice/crio-bf412eef67c94481f76776fc7e0b96982c4b606267732b627cb971d989abfbcf WatchSource:0}: Error finding container bf412eef67c94481f76776fc7e0b96982c4b606267732b627cb971d989abfbcf: Status 404 returned error can't find the container with id bf412eef67c94481f76776fc7e0b96982c4b606267732b627cb971d989abfbcf Jul 24 23:38:26.878668 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.878576 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" event={"ID":"f63f44e5-4915-4507-9521-9c45b23b9ae6","Type":"ContainerStarted","Data":"eeed4a6817c0a8d3b1f44baf846c16b8851e9d1c80818645f7c98c575800eb01"} Jul 24 23:38:26.878668 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.878649 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" event={"ID":"f63f44e5-4915-4507-9521-9c45b23b9ae6","Type":"ContainerStarted","Data":"bf412eef67c94481f76776fc7e0b96982c4b606267732b627cb971d989abfbcf"} Jul 24 23:38:26.879510 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.879482 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:26.898857 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:26.898786 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" podStartSLOduration=1.898765977 podStartE2EDuration="1.898765977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 23:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 23:38:26.894283488 +0000 UTC m=+3133.358471914" watchObservedRunningTime="2026-07-24 23:38:26.898765977 +0000 UTC m=+3133.362954403" Jul 24 23:38:27.355806 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:27.355771 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-8xl5m_0855abfd-8fdf-4077-94be-8d4dae23842f/download-server/0.log" Jul 24 23:38:28.952327 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:28.952281 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9z5x_683c14c1-c931-4334-ac0e-400c01d51dc3/dns/0.log" Jul 24 23:38:28.975579 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:28.975550 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9z5x_683c14c1-c931-4334-ac0e-400c01d51dc3/kube-rbac-proxy/0.log" Jul 24 23:38:29.021361 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:29.021335 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-85lrd_d4a20072-e90c-4f9d-a5b6-1b0b453f4c66/dns-node-resolver/0.log" Jul 24 23:38:29.636903 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:29.636869 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58db85c5b4-z4s55_c2ab1c75-ca3d-4940-ae4e-014976c0d95e/registry/0.log" Jul 24 23:38:29.678938 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:29.678914 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxr24_9fdd9652-a28f-4f8b-8190-cf0629da7d63/node-ca/0.log" Jul 24 23:38:30.577381 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:30.577353 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph_48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b/istio-proxy/0.log" Jul 24 23:38:30.794812 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:30.794779 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/0.log" Jul 24 23:38:30.829678 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:30.829601 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/1.log" Jul 24 23:38:31.698954 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:31.698918 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6krcc_46d51505-a901-49de-a502-cf1ad9d190a4/serve-healthcheck-canary/0.log" Jul 24 23:38:32.379221 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:32.379194 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmvt4_4749d72e-e2e8-4e91-acbd-a6abedbda3a2/kube-rbac-proxy/0.log" Jul 24 23:38:32.402004 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:32.401978 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmvt4_4749d72e-e2e8-4e91-acbd-a6abedbda3a2/exporter/0.log" Jul 24 23:38:32.423314 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:32.423279 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmvt4_4749d72e-e2e8-4e91-acbd-a6abedbda3a2/extractor/0.log" Jul 24 23:38:33.910099 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:33.910062 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qntww/perf-node-gather-daemonset-f6kcg" Jul 24 23:38:35.081565 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:35.081521 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-98nbw_8ca28a49-c475-44e6-a150-8bdf7fe6cfc5/server/0.log" Jul 24 23:38:35.183942 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:35.183913 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dcc8r_4d43828c-d0c5-4c9e-b856-19b1633c16ff/manager/0.log" Jul 24 23:38:35.210069 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:35.210045 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d99768bd-7zdxf_35aa88b0-59ce-4cb4-8afe-2c94b8cd6183/manager/0.log" Jul 24 23:38:35.233282 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:35.233251 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d99768bd-7zdxf_35aa88b0-59ce-4cb4-8afe-2c94b8cd6183/copy-manifests/0.log" Jul 24 23:38:36.394455 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:36.394409 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph_48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b/istio-proxy/0.log" Jul 24 23:38:36.567200 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:36.567163 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/0.log" Jul 24 23:38:36.608252 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:36.608218 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/1.log" Jul 24 23:38:36.716818 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:36.716772 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86cd477748-tdgbs_6dc0b360-5bd8-4a63-ae86-564190f89bd9/manager/0.log" Jul 24 23:38:36.745618 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:36.745588 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kppbc_6df8ceb0-ae3f-4842-9c0c-f067f481b78c/openshift-lws-operator/0.log" Jul 24 23:38:38.088250 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:38.088209 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9hph_48b8c2fb-4ad6-4fb7-9629-2a0456a5b51b/istio-proxy/0.log" Jul 24 23:38:38.270822 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:38.270773 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/0.log" Jul 24 23:38:38.307335 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:38.307250 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g6qrj_1681406b-0693-40c8-9e6f-464f35530f9f/istio-proxy/1.log" Jul 24 23:38:41.640975 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:41.640938 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-28hgg_7b568d64-c948-49f9-84b7-960befb04bda/migrator/0.log" Jul 24 23:38:41.666744 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:41.666710 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-28hgg_7b568d64-c948-49f9-84b7-960befb04bda/graceful-termination/0.log" Jul 24 23:38:42.997635 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:42.997602 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6krhr_20675f17-edae-4ad5-960c-9aff1a7fd760/kube-multus/0.log" Jul 24 23:38:43.175275 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.175245 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/kube-multus-additional-cni-plugins/0.log" Jul 24 23:38:43.195771 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.195742 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/egress-router-binary-copy/0.log" Jul 24 23:38:43.216422 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.216391 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/cni-plugins/0.log" Jul 24 23:38:43.236849 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.236822 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/bond-cni-plugin/0.log" Jul 24 23:38:43.257087 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.257020 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/routeoverride-cni/0.log" Jul 24 23:38:43.277246 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.277220 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/whereabouts-cni-bincopy/0.log" Jul 24 23:38:43.297474 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.297446 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcdd2_bb6e4e50-6550-4178-b2b7-f28e7ba59754/whereabouts-cni/0.log" Jul 24 23:38:43.611632 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.611536 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qjswr_ca48d86b-9252-448f-ab1b-5abe1d3c03b4/network-metrics-daemon/0.log" Jul 24 23:38:43.630102 ip-10-0-132-39 kubenswrapper[2585]: I0724 23:38:43.630078 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qjswr_ca48d86b-9252-448f-ab1b-5abe1d3c03b4/kube-rbac-proxy/0.log"